EP2724550A1 - Darstellungsvorrichtung mit ersatz von inhalten - Google Patents

Darstellungsvorrichtung mit ersatz von inhalten

Info

Publication number
EP2724550A1
EP2724550A1 EP12730696.7A EP12730696A EP2724550A1 EP 2724550 A1 EP2724550 A1 EP 2724550A1 EP 12730696 A EP12730696 A EP 12730696A EP 2724550 A1 EP2724550 A1 EP 2724550A1
Authority
EP
European Patent Office
Prior art keywords
segment
substitution
content
substituting
fingerprint
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Ceased
Application number
EP12730696.7A
Other languages
English (en)
French (fr)
Inventor
Alex Dick TERPSTRA
Martijn Maas
Mehmet Utku Celik
Jaap André HAITSMA
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
TELETRAX B.V.
Original Assignee
Civolution BV
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Civolution BV filed Critical Civolution BV
Publication of EP2724550A1 publication Critical patent/EP2724550A1/de
Ceased legal-status Critical Current

Links

Classifications

    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04NPICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N21/00Selective content distribution, e.g. interactive television or video on demand [VOD]
    • H04N21/40Client devices specifically adapted for the reception of or interaction with content, e.g. set-top-box [STB]; Operations thereof
    • H04N21/43Processing of content or additional data, e.g. demultiplexing additional data from a digital video stream; Elementary client operations, e.g. monitoring of home network or synchronising decoder's clock; Client middleware
    • H04N21/44Processing of video elementary streams, e.g. splicing a video clip retrieved from local storage with an incoming video stream or rendering scenes according to encoded video stream scene graphs
    • H04N21/44016Processing of video elementary streams, e.g. splicing a video clip retrieved from local storage with an incoming video stream or rendering scenes according to encoded video stream scene graphs involving splicing one content stream with another content stream, e.g. for substituting a video clip
    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04NPICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N21/00Selective content distribution, e.g. interactive television or video on demand [VOD]
    • H04N21/40Client devices specifically adapted for the reception of or interaction with content, e.g. set-top-box [STB]; Operations thereof
    • H04N21/43Processing of content or additional data, e.g. demultiplexing additional data from a digital video stream; Elementary client operations, e.g. monitoring of home network or synchronising decoder's clock; Client middleware
    • H04N21/44Processing of video elementary streams, e.g. splicing a video clip retrieved from local storage with an incoming video stream or rendering scenes according to encoded video stream scene graphs
    • H04N21/44008Processing of video elementary streams, e.g. splicing a video clip retrieved from local storage with an incoming video stream or rendering scenes according to encoded video stream scene graphs involving operations for analysing video streams, e.g. detecting features or characteristics in the video stream
    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04NPICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N21/00Selective content distribution, e.g. interactive television or video on demand [VOD]
    • H04N21/40Client devices specifically adapted for the reception of or interaction with content, e.g. set-top-box [STB]; Operations thereof
    • H04N21/45Management operations performed by the client for facilitating the reception of or the interaction with the content or administrating data related to the end-user or to the client device itself, e.g. learning user preferences for recommending movies, resolving scheduling conflicts
    • H04N21/462Content or additional data management, e.g. creating a master electronic program guide from data received from the Internet and a Head-end, controlling the complexity of a video stream by scaling the resolution or bit-rate based on the client capabilities
    • H04N21/4622Retrieving content or additional data from different sources, e.g. from a broadcast channel and the Internet
    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04NPICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N21/00Selective content distribution, e.g. interactive television or video on demand [VOD]
    • H04N21/80Generation or processing of content or additional data by content creator independently of the distribution process; Content per se
    • H04N21/81Monomedia components thereof
    • H04N21/812Monomedia components thereof involving advertisement data
    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04NPICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N21/00Selective content distribution, e.g. interactive television or video on demand [VOD]
    • H04N21/80Generation or processing of content or additional data by content creator independently of the distribution process; Content per se
    • H04N21/83Generation or processing of protective or descriptive data associated with content; Content structuring
    • H04N21/835Generation of protective data, e.g. certificates
    • H04N21/8358Generation of protective data, e.g. certificates involving watermark

Definitions

  • the invention relates to a device for rendering content from a first source comprising substitution module for substituting a segment of the content with a content item from a second source.
  • An advertisement placed in broadcast television or radio programming has the advantage of having a wide reach; millions of households see the same advertisement.
  • broadcasting a single advertisement to all viewers is likely to have a low response rate as the advertisement is necessarily very generic.
  • a significant improvement in consumer response rate is achieved when the advertisement is targeted to an individual household or even an individual viewer.
  • a car manufacturer may have different commercials for cars in low and high price categories.
  • a commercial embedded in a television signal has to address the widest audience and so would advertise the lower-priced car. If the preference profile of a particular viewer reveals that this viewer has a high income, the advertiser wants the commercial to be replaced by the one for the higher price category. As a consequence a targeted advertisement generates significantly more revenue than a regular
  • advertisement replacement in devices such as set-top boxes by itself is known. Typically this involves building up a preference profile for the viewer or household, and downloading advertisements to a rendering device (e.g. television or radio) that well suit the preference profile.
  • the downloaded advertisements are kept in local storage and substituted whenever the device detects the presence (or, more particularly, the beginning) of an advertisement in the incoming content stream.
  • Such advertisement substitution is usually controlled by a cable or satellite operator that provides signal transmission to end users operating on the set-top boxes (STBs) that descramble and decode broadcast signals. In that situation, the operator has control over the broadcast stream and can place swap codes in the broadcast stream to signal when the advertisement will arrive.
  • content substitution is more difficult.
  • Such other situation may arise when content substitution is performed in the rendering device itself, wherein the content is supplied to the rendering device from an external origin, e.g. another device such as a set-top box as a first source.
  • the external device selects the content from a plurality of channels to supply it to the rendering device. In that situation, the external device may switch to different content while the content substitution in the rendering device is in progress, for example when the user changes the channel on the set-top box, switches from television signals to DVD playback or calls up an electronic program guide or Teletext service.
  • the rendering device is unable to detect this switch.
  • the external device only delivers a single signal, seamlessly switching its content as the user selects other content or another content source.
  • the substitution since normally the substitution only ceases when the substitution content finishes, the rendering device would continue the segment substitution, and only present the newly selected content, e.g. another channel, after the substitution content item has finished. This is undesirable as it conflicts with viewer expectations: if the viewer switches to another channel, this channel should display immediately and the currently-playing advertisement should cease.
  • the invention solves the above-mentioned technical problem by a device for rendering content from a first source comprising a first input for receiving the content from the first source, a second input for receiving a substitution content item from a second source, substitution module for substituting a segment of the content with the substitution content item , and rendering means for rendering the content wherein the segment is substituted with the substitution content item.
  • the rendering device has a monitoring module for monitoring the reception of the segment, and controlling the substitution module dependent on the segment is being received, such that the substitution module ceases the substitution of the segment by the substitution content item upon failure to receive the segment.
  • the segment is the part of the content which is to be substituted by the substitution content item. When the segment is no longer being received, due to at least one of removal or finishing of the segment, change to a diffferent source and any other disturbance or interruption, detected by the monitoring module, the substitution module must stop the substituting process.
  • the monitoring module comprises a first watermark detector configured for detecting a substitution watermark in one or more initial frames of the segment and controlling the substitution module to initiate the substitution upon such detection.
  • the substitution watermark can be a simple low-bit watermark that only serves the purpose of indicating that the segment may be substituted by alternative content .
  • the watermark can carry more information, e.g. indicating the length of the segment or even metadata comprising e.g. the type of product or the target audience. With that metadata a better selection of the substitute content item can be made.
  • the device can easily determine that the substitution is to take place. Exactly which one or more initial frames are used depends on the watermarking algorithm and the way the detector operates. The phrase is not intended to mean only the very first frame.
  • the monitoring module comprise a second watermark detector for detecting a segment watermark embedded in the segment, wherein the monitoring module is arranged to control the substitution module to cease the substitution when the segment watermark .
  • the segment watermark may be a straightforward low-bit watermark that serves the purpose of indicating the fact that the segment is still being received. Such a low-bit watermark is easier to detect than a watermark providing a unique segment identifier.
  • the segment watermark detector is further arranged for extracting an identifier from the segment watermark, and the substitution module are configured to select the substitute content item based at least on the identifier.
  • advertisement or other content substitution of the segment can be done accurately.
  • the device may have access to a list that maps the segment identifiers to one or plural associated substitute advertisements to facilitate selection.
  • the segment identifier may be associated with locally available metadata, indicating e.g. the type of product or the target audience. With that metadata a better selection of the substitute content item can be made.
  • the monitoring module comprises a fingerprint calculator for calculating a content fingerprint for the segment and a matching module for matching the calculated content fingerprint against a set of records, the substitution module being configured for controlling the substitution module to initiate the substitution upon the matching module detecting a match between the calculated content fingerprint and the set of records.
  • digital content fingerprinting is used instead of watermarking as in the above embodiments.
  • the reference records can be available in a local storage means.
  • the reference records may be available from a remote source, such as an Internet service to retrieve information for a fingerprint or a storage device in a local network to which the device is connected.
  • the substitution module are configured to select the content item based at least on the calculated content fingerprint.
  • advertisement (or other content) substitution of the segment can be done accurately based on the identifying fingerprint.
  • the monitoring module comprises a fingerprint calculator for calculating a content fingerprint for the segment, and a matching means for matching the calculated content fingerprint against a set of records, the monitoring module being configured for controlling the substitution module upon the matching means detecting a mismatch between the calculated content fingerprint and the set of records to cease the substitution of the segment with the substitution content item.
  • the set of records is available from a remote source, such as an Internet service to retrieve information for a fingerprint or a storage device in a local network to which the device is connected. This allows a content provider who wants to enable the rendering device to perform the content substitution to update the records used for the fingerprinting and keep control over the substitution process.
  • the fingerprint calculator and/or the matching means are comprised in an external device with which the device communicates over a network such as the Internet or a local network, allowing the rendering device to be as slim as possible and allow the content provider to keep control over the substitution process.
  • the monitoring module is configured for detecting a disturbance in the reception of the segment and causing the substitution module to cease substitution upon detection of the disturbance. This allows ceasing the substitution when a user selects another source for the content or otherwise such that an interruption in receiving the segment being substituted by the substitution content item occurs.
  • the segment is substituted by a sequence of plural content items from the second source whose combined length approximates the length of the segment.
  • the segment may be substituted by a single locally available content item, which requires that the content item be substantially the same length as the segment. This may not be feasible in all situations. By substituting plural items this disadvantage can be overcome.
  • the device comprises a processor, a memory, programmable with executable instructions wherein the monitoring module and substitution module in operation are performed by the executable instructions. This allows a flexible set up of the rendering device which functionality can also be updated and improved remotely.
  • the problem is also solved according to the invention in a method for rendering content form a first source in a rendering device, the method comprising receiving the content having a first segment, receiving a substitution content item from a second source, substituting the segment by the substitution content item, rendering the substitution content item.
  • the method further comprises according to the invention continuously monitoring the receiving of the segment in the content, and ceasing the substitution the segment with the substitution content item upon failure of the receiving of the segment.
  • a computer program product comprising a data carrier, having stored thereon executable instructions, which when loaded and executed by a rendering device having a processor and memory as described, perform the steps of the method as described above.
  • FIG. 1 schematically shows a device for rendering content from a first source
  • Fig. 2 schematically shows an embodiment of the device that employs watermark detection
  • Fig. 3 schematically shows an embodiment of the device that employs content fingerprinting
  • Fig. 4 schematically shows an embodiment of the device that employs a combination of watermarking and fingerprinting.
  • Fig. 1 schematically shows a device 100 for rendering content from a first input 150.
  • the device 100 is embodied as a television with display 101 and loudspeakers 102, coupled to rendering module 103 which decodes, processes and renders the content from input 150 using these output devices 101 , 102.
  • the first input 150 is coupled to an external device 180, as shown a set-top box, acting as a source that in turn receives the content from yet other sources such as over-the-air, cable or IP-based transmission.
  • the first input 150 may for example also be a device for reading pre-stored substitution content items, such as a DVD or CD player for receiving a pre-recorded disc or an Universal Serial Bus (USB) port for connecting to an USB memory device having the pre- recorded items.
  • the content may be of analog or digital nature, and can comprise any type of data, but preferably comprises audio and/or video data.
  • the first input 150 may be provided with an internal storage such as a hard disk for receiving content which may be stored and rendered in a later stage.
  • Input 150 and external device 180 are preferably connected via a standard connector 104 such as HDMI, and optionally employ a content protection mechanism such as HDCP to ensure that content is provided only between compliant devices.
  • a standard connector 104 such as HDMI
  • a content protection mechanism such as HDCP
  • While the invention is presented here in the context of television display devices, the invention also is useful for other programmable devices that provide the ability to render content, such as radios, laptops, desktop computers, smartphones and netbooks.
  • the device 100 comprises a substitution module 130 connected via connection 105 to the first input 150 and connected to the second input 160 via connection 106.
  • the substitution module 130 is configured for substituting a segment of the content from the first input 150 with a content item from a second input 160.
  • the substitution module 130 then causes via connection 108 the rendering module 103 to render this substitution content item instead of the segment from the first input 150.
  • the substitution module 130 causes the rendering module 103 to resume rendering the content from the first input 150. It is usually desired that the substitution content item and the segment are of substantially the same length to ensure the substitution is smooth and hardly noticeable to the viewer.
  • the segment from the first input 150 may also substituted by a sequence of plural content items from the second input 160 whose combined length approximates the length of the segment.
  • the second input 160 may be a coupling 1 10 via a data network 1 1 1 to an external source 112 for substitution content items such as an Internet Protocol-based communication channel from which the content item is obtained, e.g. from a network-attached storage device in a home network.
  • the second input 160 can be equipped with an internal storage medium such as an internal hard disk or similar storage medium, allowing the desired substitution content item(s) to be received well before the substitution is to occur.
  • the second input 160 may for example also be a device for reading pre-stored substitution content items, such as a DVD or CD player for receiving a pre-recorded disc or an Universal Serial Bus (USB) port for connecting to an USB memory device having the prerecorded items.
  • USB Universal Serial Bus
  • the substitution module 130 may select the substitution content item from the second input 160 in a variety of ways.
  • the substitution module 130 is coupled to a profiling module 140 that maintains a preference profile based on content that is being rendered and/or user input and/or other relevant sources of information. Maintaining such profiles and selecting content based on a profile is well-known in the art and will not be elaborated upon.
  • the selected content item will be a close match with the viewer's personal preferences and/or interests.
  • the substitution module 130 may select the substitution content item from the second input 160 based on an identifier for the segment.
  • the substitution content items available from the second input 160 carry indications, e.g. a metadata record, for which identifiers they are an appropriate substitute.
  • a list of mappings of identifiers to content at the second input 160 could be provided in another way.
  • the segment from the first input 150 and the substitution content item from the second input 160 are typically advertisements, in which case the device 100 is used to provide substitute advertisements for the advertisements contained in the content from the first input 150.
  • the segment and its substitute may comprise other types of content, for example music, audio dialogue dubs, child-friendly versions of content, local news or weather reports or subtitles in a different language.
  • the device 100 further comprises a monitoring module 170 connected via connection 105 to the first input 150 and via connection 107 with the substitution module 107 fo controlling the substitution process.
  • the monitoring module 170 is configured for continuously monitoring the first input 150 while the substitution module 130 is causing via connection 107 the substitution content item from the second input 160 to be rendered.
  • Monitoring module 170 receives the content from an external source having the segment to be substituted.
  • the monitoring module 170 is provided with a detector for detecting when the substitution should start.
  • Detection of the start of a segment for substitution can be performed in a variety of ways.
  • the commercials or other segments from the first input 150 can be recognized with embedded codes, e.g. in a vertical blanking interval.
  • an examination of content characteristics typically associated with the type of content to be substituted can be performed. For example, the appearance of one or more black frames together with a significant change in audio volume is indicative of a transition to a commercial break.
  • Several techniques are known in the art to detect commercial breaks or other types of content changes.
  • the monitoring module 170 monitors that the segment to be substituted is continuously received from the first input 150. As long as the segment is received, the substitution may continue. However, upon failing to receive the segment, monitoring module 170 signals the substitution module 130 to cease the substitution. This in turn causes the rendering module 103 to resume rendering the content from the first input 150.
  • the monitoring module 170 may employ a variety of techniques to monitor the segment being received. For example, where the beginning of the segment has been previously detected, the monitoring module 170 may scan for disturbances in the content received from the first input such as interruptions or glitches, e.g. black frames, silences, partial frames, optionally in combination with audio glitches or silence, which typically indicate that the segment is no longer being received from the first input 150. For instance, when dealing with digital audio-visual signals, the reception of several substantially black frames accompanied by a first audio glitch followed by silence is characteristic of the signal having changed from a first channel to a second channel. This characteristic is caused by the fact that the channel change requires a flush of the content buffer (both audio and video) and the reception of the first l-frame of the new channel.
  • interruptions or glitches e.g. black frames, silences, partial frames
  • audio glitches or silence typically indicate that the segment is no longer being received from the first input 150.
  • interruptions or glitches e.g. black frames, silences
  • the monitoring module 170 assumes that the segment is no longer received and signals to the substitution module 130 that the substitution must cease.
  • the monitoring of the segment being received may comprise some kind of verification or check to compensate for a false detection that is not due to an actual absence of the segment.
  • a video frame could for example be corrupted or missing due to transmission errors, but that should not cause the monitoring module 170 to conclude that rendering must resume from the first input 150.
  • the monitoring module 170 is optionally configured to only signal the substitution module 130 to cease substitution if the disturbances persist for say three or five, frames. Whether this verification is useful depends on the type of content, the way the disturbances may be present and the chance of errors that may obscure, corrupt or omit the detection of these disturbances.
  • Fig. 2 schematically shows an embodiment of the device 100 that employs watermark detection for monitoring the first source, that the segment for substitution is being received.
  • Watermarks are, generally speaking, markers in the content that are
  • the monitoring module 170 further comprises a substitution watermark detector 210 which is configured for continuously monitoring the content received from the first input 150 in order to detect a particular watermark therein.
  • This particular watermark serves to indicate the beginning of a segment for which content substitution may be performed. Thus, it will typically be present in initial frames of the segment, preferably somewhere in the first second of the segment.
  • the watermark detector 210 signals via connection 107 to the substitution module 130 that the substitution of the segment with a content item from the second input 160 is to be initiated.
  • the monitoring device 170 comprises a segment watermark detector 220 for detecting a segment watermark embedded in the entire segment.
  • This watermark detector 220 continuously monitors the first input 150 while the substitution module 130 is causing the substitution content item from the second input 160 to be rendered instead of the segment. As long as the segment watermark is being detected, the substitution may continue. However, upon the watermark detector 220 failing to detect the segment watermark, monitoring module 170 signals 107 the substitution module 130 to cease the substitution. This in turn causes the rendering module to resume rendering the content from the first input 150.
  • the watermark detector 220 may employ a verification to ensure that a single mismatch does not trigger the switching back to the first input 150.
  • the segment watermark can be a simple low-bit watermark that merely indicates that the segment is still present in the content from the first input 150.
  • the segment watermark may provide an identifier for the segment. This identifier can be specific to the segment, or be a more generic identifier such as "this content is an advertisement for a car" or "this content is a weather announcement”. This identifier is then supplied to the substitution module 130 to be part of the selection of the content item from the second input 160.
  • the two watermark detectors 210, 220 may be combined into a single watermark detector that can detect both the watermark indicating the beginning of a segment and the watermark that indicates the continued reception of the segment.
  • These two watermarks can be one and the same: a watermark that indicates "this segment is an advertisement" or provides an identifier for the watermark does not necessarily need to be different in initial and subsequent frames.
  • the watermark in the initial frames may be optimized for fast detection to allow a fast switch to the second input 160.
  • the segment watermark in the subsequent frames that serves to indicate the continuous presence of the segment may be optimized for other purposes.
  • Fig. 3 schematically shows an embodiment of the device 100 that employs content fingerprinting.
  • Content fingerprinting is a technique wherein perceptually relevant features of a content segment are processed and combined into a code - the fingerprint - that is unique for the segment and that is the same even if the segment is slightly altered, for example when transcoding from one format to another or when resizing or rotating the segment. Unlike watermarking, content fingerprinting does not need to alter the signal itself. Content fingerprinting is sometimes also known as robust fingerprinting or robust hashing.
  • the monitoring module 130 comprises a fingerprint calculator 310 which is configured for calculating a content fingerprint 31 1 for the segment.
  • the calculator 310 is coupled to a matching module 320 that attempts to match the calculated content fingerprint 311 against a set of records of pre-calculated fingerprints, as shown available from database 325. If a match occurs, the matching module 320 signals to the substitution module 130 that the substitution is to be initiated. Fingerprint calculation and matching as such is a well-known technique.
  • the content fingerprint 31 1 is preferably based on a set of frames near the beginning of the content instead of the whole segment, allowing the substitution to begin as soon as a match with the fingerprint is found.
  • database 325 is local to the device 100.
  • the records in database 325 may alternatively be available from a remote source, e.g. using an Internet service to retrieve information for a fingerprint or connecting to a network storage device in the home network that contains the information.
  • the fingerprint calculator 310 and/or matching module 320 is or are placed outside of the device 100.
  • the device 100 then communicates with these modules 310 and/or 320 over a network, e.g. the home network or the Internet. This way the device 100 does not have to be equipped with these modules 310, 320 itself, which saves costs. Further, one device comprising these modules 310, 320 may be deployed for a multitude of devices like device 100.
  • the substitution module 130 is configured to select the content item from the second input 160 based at least on the calculated content fingerprint in the segment to be substituted from the first input 150.
  • the fingerprint is unique for the segment and thus may serve as an identifier for a selection of the substitution content item, allowing content-specific substitution to be performed.
  • the fingerprint calculator 310 is configured to calculate a content fingerprint 31 1 for the segment. This calculated indication fingerprint 31 1 then must be matched against a set of records, e.g. from database 325, to determine if the calculated fingerprint 311 is still part of the segment. If so, the monitoring module 170 establishes that the segment to be substituted is present. Typically this fingerprint is calculated separately for each frame or other elementary part of the segment as received from input 150.
  • the set of records 325 provides a set of reference fingerprints comprising a reference fingerprint 327 for each elementary part of the segment.
  • the substitution may continue. However, as soon as the calculated fingerprint 31 1 differs from the corresponding reference fingerprint 327, the monitoring module 170 signals the substitution module 130 to cease the substitution. This in turn causes the rendering module 103 to resume rendering the content from the first input 150.
  • the fingerprint calculator 310 may employ a verification to ensure that a single mismatch does not trigger the switching back to the first input 150.
  • the device 100 employs segment watermark detector 220 in combination with fingerprint detection. After the matching module 320 has signalled 107 to the substitution module 130 that the substitution is to be initiated, the watermark detector 220 is activated and searches for the substitution watermark embedded in the segment. Upon failing to detect the substitution watermark, monitoring module 170 signals the substitution module 130 to cease the substitution.
  • Fig. 4 schematically shows an embodiment of the device 100 that employs a combination of watermarking and fingerprinting as disclosed previously.
  • the substitution watermark detector 210 is used to detect a segment from the first input 150 for which content substitution is to be performed. While substitution is being performed, the fingerprint calculator 310 is used to continuously calculate the content fingerprint 31 1 for the segment. As soon as the calculated fingerprint 311 differs from a corresponding reference fingerprint 327, the monitoring module 170 signals 107 the substitution module 130 to cease the substitution.
  • This combined embodiment employs the benefit of watermark detection for recognizing segments that may be substituted with the benefits of content fingerprinting for monitoring the segment while substitution takes place.
  • the invention can be implemented in a computer program product, i.e. a collection of computer program instructions stored on a computer readable storage device for execution by a processor.
  • the instructions of the present invention may be in any interpretable or executable code mechanism, including but not limited to scripts, interpretable programs, dynamic link libraries (DLLs) or Java classes.
  • the instructions can be provided as complete executable programs, as modifications to existing programs or extensions ("plug-ins") for existing programs.
  • parts of the processing of the present invention may be distributed over multiple computers or processors for better performance, reliability, and/or cost.
  • Machine-readable storage devices suitable for storing computer program instructions include all forms of non-volatile memory, including by way of example semiconductor memory devices, such as ROM, RAM, EPROM, EEPROM, and flash memory devices, magnetic disks such as the internal and external hard disk drives and removable disks, magneto-optical disks and CD-ROM disks.
  • the computer program product can be distributed on such a storage device, or may be offered for download through HTTP, FTP or similar mechanism using a server connected to a network such as the Internet. To this end one may connect a server system comprising the storage medium discussed above to a network, and arrange this server for allowing the instructions to be downloaded to client systems connected directly or indirectly to the network.
  • the computer program instructions may be loaded into a memory and be executed on a processor embedded in the rendering device as described above.
  • the processor while executing the computer program instructions implement the various modules and functions, such as the monitoring module170, the substitution module 130, the segment watermark detector 210, the substitution watermark detector 220, the fingerprint calculator 310, the fingerprint matching module 320 as described.
  • the embedded processor is connected to the memory to allow the program to be loaded and executed.
  • the processor can be further communicatively connected to the first and second inputs 150, 160 and the rendering device 103.
  • any mention of reference signs shall not be regarded as a limitation of the claimed feature to the referenced feature or embodiment.
  • the use of the word "comprising” in the claims does not exclude the presence of other features than claimed in a system, product or method implementing the invention. Any reference to a claim feature in the singular shall not exclude the presence of a plurality of this feature.
  • the word "means” in a claim can refer to a single means or to plural means for providing the indicated function.

Landscapes

  • Engineering & Computer Science (AREA)
  • Multimedia (AREA)
  • Signal Processing (AREA)
  • Databases & Information Systems (AREA)
  • Business, Economics & Management (AREA)
  • Marketing (AREA)
  • Computer Security & Cryptography (AREA)
  • Two-Way Televisions, Distribution Of Moving Picture Or The Like (AREA)
EP12730696.7A 2011-06-21 2012-06-20 Darstellungsvorrichtung mit ersatz von inhalten Ceased EP2724550A1 (de)

Applications Claiming Priority (2)

Application Number Priority Date Filing Date Title
NL2006978A NL2006978C2 (en) 2011-06-21 2011-06-21 Rendering device with content substitution.
PCT/NL2012/050430 WO2012177126A1 (en) 2011-06-21 2012-06-20 Rendering device with content substitution

Publications (1)

Publication Number Publication Date
EP2724550A1 true EP2724550A1 (de) 2014-04-30

Family

ID=46397605

Family Applications (1)

Application Number Title Priority Date Filing Date
EP12730696.7A Ceased EP2724550A1 (de) 2011-06-21 2012-06-20 Darstellungsvorrichtung mit ersatz von inhalten

Country Status (6)

Country Link
US (1) US20140196071A1 (de)
EP (1) EP2724550A1 (de)
JP (1) JP2014520480A (de)
CN (1) CN103782605A (de)
NL (1) NL2006978C2 (de)
WO (1) WO2012177126A1 (de)

Families Citing this family (27)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US9609278B2 (en) 2000-04-07 2017-03-28 Koplar Interactive Systems International, Llc Method and system for auxiliary data detection and delivery
US7330511B2 (en) 2003-08-18 2008-02-12 Koplar Interactive Systems International, L.L.C. Method and system for embedding device positional data in video signals
US20090111584A1 (en) 2007-10-31 2009-04-30 Koplar Interactive Systems International, L.L.C. Method and system for encoded information processing
US8582781B2 (en) 2009-01-20 2013-11-12 Koplar Interactive Systems International, L.L.C. Echo modulation methods and systems
US8715083B2 (en) 2009-06-18 2014-05-06 Koplar Interactive Systems International, L.L.C. Methods and systems for processing gaming data
US10504200B2 (en) 2014-03-13 2019-12-10 Verance Corporation Metadata acquisition using embedded watermarks
CN106170988A (zh) 2014-03-13 2016-11-30 凡瑞斯公司 使用嵌入式代码的交互式内容获取
EP3183883A4 (de) 2014-08-20 2018-03-28 Verance Corporation Wasserzeichendetektion mithilfe einer vielzahl von vorhergesagten mustern
US20160105689A1 (en) * 2014-10-13 2016-04-14 Vigor Systems Inc. Replacing a corrupted video frame
US9769543B2 (en) 2014-11-25 2017-09-19 Verance Corporation Enhanced metadata and content delivery using watermarks
US9942602B2 (en) 2014-11-25 2018-04-10 Verance Corporation Watermark detection and metadata delivery associated with a primary content
WO2016100916A1 (en) 2014-12-18 2016-06-23 Verance Corporation Service signaling recovery for multimedia content using embedded watermarks
US10027995B2 (en) * 2016-01-21 2018-07-17 Treepodia Ltd. System and method for generating media content in evolutionary manner
US20170269893A1 (en) * 2016-03-16 2017-09-21 Google Inc. Remote rendering of locally displayed content
US11418858B2 (en) * 2017-09-01 2022-08-16 Roku, Inc. Interactive content when the secondary content is server stitched
US11234060B2 (en) 2017-09-01 2022-01-25 Roku, Inc. Weave streaming content into a linear viewing experience
KR101976428B1 (ko) * 2017-12-21 2019-05-10 애니포인트미디어 주식회사 개인화 홈쇼핑 방송 시스템
US10791312B2 (en) 2018-07-16 2020-09-29 Gracenote, Inc. Modifying playback of replacement content responsive to detection of remote control signals that modify operation of the playback device
US11272252B2 (en) 2018-07-19 2022-03-08 Roku, Inc. Modifying playback of replacement content based on control messages
WO2020231813A1 (en) * 2019-05-10 2020-11-19 The Nielsen Company (Us), Llc Content-modification system with responsive transmission of reference fingerprint data feature
WO2020231927A1 (en) 2019-05-10 2020-11-19 The Nielsen Company (Us), Llc Content-modification system with responsive transmission of reference fingerprint data feature
US11373440B2 (en) 2019-05-10 2022-06-28 Roku, Inc. Content-modification system with fingerprint data match and mismatch detection feature
US11234050B2 (en) 2019-06-18 2022-01-25 Roku, Inc. Use of steganographically-encoded data as basis to control dynamic content modification as to at least one modifiable-content segment identified based on fingerprint analysis
US11006191B2 (en) * 2019-08-02 2021-05-11 The Nielsen Company (Us), Llc Use of watermarking to control abandonment of dynamic content modification
CN111757178B (zh) * 2020-07-14 2022-05-27 北京字节跳动网络技术有限公司 视频生成方法、装置、电子设备和计算机可读介质
US11632597B2 (en) 2020-07-22 2023-04-18 Roku, Inc. Responding to emergency-alert audio tone by abandoning dynamic content modification
US11722741B2 (en) 2021-02-08 2023-08-08 Verance Corporation System and method for tracking content timeline in the presence of playback rate changes

Family Cites Families (9)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US20020188570A1 (en) * 1999-03-24 2002-12-12 Donna Coningsby Partial protection of content
US7266832B2 (en) * 2001-06-14 2007-09-04 Digeo, Inc. Advertisement swapping using an aggregator for an interactive television system
US7263202B2 (en) * 2001-07-05 2007-08-28 Digimarc Corporation Watermarking to control video recording
US20030139966A1 (en) * 2002-01-23 2003-07-24 Sirota Peter L. Advertisement delivery for streaming program
CN101317454B (zh) * 2003-11-12 2011-11-16 索尼电子有限公司 通过pid映射基于宏块的内容替换
US8156520B2 (en) * 2008-05-30 2012-04-10 EchoStar Technologies, L.L.C. Methods and apparatus for presenting substitute content in an audio/video stream using text data
US20100005486A1 (en) * 2008-07-02 2010-01-07 Xerox Corporation Apparatus and method for embedding commercials
US9015741B2 (en) * 2009-04-17 2015-04-21 Gracenote, Inc. Method and system for remotely controlling consumer electronic devices
US8798442B2 (en) * 2009-12-12 2014-08-05 At&T Intellectual Property I, Lp System, method and computer program product for updating advertising data for recorded video data

Non-Patent Citations (2)

* Cited by examiner, † Cited by third party
Title
None *
See also references of WO2012177126A1 *

Also Published As

Publication number Publication date
WO2012177126A1 (en) 2012-12-27
JP2014520480A (ja) 2014-08-21
US20140196071A1 (en) 2014-07-10
NL2006978C2 (en) 2012-12-28
WO2012177126A4 (en) 2013-03-07
CN103782605A (zh) 2014-05-07

Similar Documents

Publication Publication Date Title
NL2006978C2 (en) Rendering device with content substitution.
US12052446B2 (en) Methods and apparatus for monitoring the insertion of local media into a program stream
US11070892B2 (en) Methods and apparatus to present supplemental media on a second screen
US11317144B2 (en) Detection of mute and compensation therefor during media replacement event
US8978060B2 (en) Systems, methods, and media for presenting advertisements
US9215496B1 (en) Determining the location of a point of interest in a media stream that includes caption data
JP2024069189A (ja) スポーツイベントテレビジョン番組において群衆ノイズの発生を検出するためのオーディオ処理
US20160124596A1 (en) Media presentation modification using audio segment marking
EP2097865A2 (de) Vorrichtung und verfahren für den zugang zu daten in zusammenhang mit primären mediendaten
KR101541048B1 (ko) 컴퓨터-기반 미디어 프리젠테이션을 측정하기 위한 방법 및 장치
CN113424552A (zh) 将媒体中检测到的不同水印关联的装置和方法
WO2019046536A1 (en) REAL TIME MULTIMEDIA CONTENT WEAVING IN A LINEAR VIEWING EXPERIENCE
WO2014159416A2 (en) Methods and apparatus to present supplemental media on a second screen

Legal Events

Date Code Title Description
PUAI Public reference made under article 153(3) epc to a published international application that has entered the european phase

Free format text: ORIGINAL CODE: 0009012

17P Request for examination filed

Effective date: 20140114

AK Designated contracting states

Kind code of ref document: A1

Designated state(s): AL AT BE BG CH CY CZ DE DK EE ES FI FR GB GR HR HU IE IS IT LI LT LU LV MC MK MT NL NO PL PT RO RS SE SI SK SM TR

DAX Request for extension of the european patent (deleted)
17Q First examination report despatched

Effective date: 20150205

RAP1 Party data changed (applicant data changed or rights of an application transferred)

Owner name: TELETRAX B.V.

REG Reference to a national code

Ref country code: DE

Ref legal event code: R003

STAA Information on the status of an ep patent application or granted ep patent

Free format text: STATUS: THE APPLICATION HAS BEEN REFUSED

18R Application refused

Effective date: 20170420