EP2724550A1 - Darstellungsvorrichtung mit ersatz von inhalten - Google Patents
Darstellungsvorrichtung mit ersatz von inhaltenInfo
- Publication number
- EP2724550A1 EP2724550A1 EP12730696.7A EP12730696A EP2724550A1 EP 2724550 A1 EP2724550 A1 EP 2724550A1 EP 12730696 A EP12730696 A EP 12730696A EP 2724550 A1 EP2724550 A1 EP 2724550A1
- Authority
- EP
- European Patent Office
- Prior art keywords
- segment
- substitution
- content
- substituting
- fingerprint
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Ceased
Links
- 238000006467 substitution reaction Methods 0.000 title claims abstract description 140
- 238000009877 rendering Methods 0.000 title claims abstract description 43
- 238000012544 monitoring process Methods 0.000 claims abstract description 49
- 230000001419 dependent effect Effects 0.000 claims abstract description 4
- 238000000034 method Methods 0.000 claims description 18
- 238000001514 detection method Methods 0.000 claims description 15
- 238000004590 computer program Methods 0.000 claims description 8
- 230000000977 initiatory effect Effects 0.000 claims 1
- 230000008569 process Effects 0.000 description 5
- 230000007246 mechanism Effects 0.000 description 4
- 238000012795 verification Methods 0.000 description 4
- 230000008901 benefit Effects 0.000 description 3
- 230000008859 change Effects 0.000 description 3
- 230000006872 improvement Effects 0.000 description 3
- 230000005540 biological transmission Effects 0.000 description 2
- 238000005516 engineering process Methods 0.000 description 2
- 230000006870 function Effects 0.000 description 2
- 238000012986 modification Methods 0.000 description 2
- 230000004048 modification Effects 0.000 description 2
- 230000004044 response Effects 0.000 description 2
- 238000004422 calculation algorithm Methods 0.000 description 1
- 238000004364 calculation method Methods 0.000 description 1
- 238000004891 communication Methods 0.000 description 1
- 230000008878 coupling Effects 0.000 description 1
- 238000010168 coupling process Methods 0.000 description 1
- 238000005859 coupling reaction Methods 0.000 description 1
- 238000013507 mapping Methods 0.000 description 1
- 238000012806 monitoring device Methods 0.000 description 1
- 238000012545 processing Methods 0.000 description 1
- 238000013515 script Methods 0.000 description 1
- 239000004065 semiconductor Substances 0.000 description 1
- 230000008054 signal transmission Effects 0.000 description 1
- 230000007704 transition Effects 0.000 description 1
Classifications
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
- H04N21/40—Client devices specifically adapted for the reception of or interaction with content, e.g. set-top-box [STB]; Operations thereof
- H04N21/43—Processing of content or additional data, e.g. demultiplexing additional data from a digital video stream; Elementary client operations, e.g. monitoring of home network or synchronising decoder's clock; Client middleware
- H04N21/44—Processing of video elementary streams, e.g. splicing a video clip retrieved from local storage with an incoming video stream or rendering scenes according to encoded video stream scene graphs
- H04N21/44016—Processing of video elementary streams, e.g. splicing a video clip retrieved from local storage with an incoming video stream or rendering scenes according to encoded video stream scene graphs involving splicing one content stream with another content stream, e.g. for substituting a video clip
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
- H04N21/40—Client devices specifically adapted for the reception of or interaction with content, e.g. set-top-box [STB]; Operations thereof
- H04N21/43—Processing of content or additional data, e.g. demultiplexing additional data from a digital video stream; Elementary client operations, e.g. monitoring of home network or synchronising decoder's clock; Client middleware
- H04N21/44—Processing of video elementary streams, e.g. splicing a video clip retrieved from local storage with an incoming video stream or rendering scenes according to encoded video stream scene graphs
- H04N21/44008—Processing of video elementary streams, e.g. splicing a video clip retrieved from local storage with an incoming video stream or rendering scenes according to encoded video stream scene graphs involving operations for analysing video streams, e.g. detecting features or characteristics in the video stream
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
- H04N21/40—Client devices specifically adapted for the reception of or interaction with content, e.g. set-top-box [STB]; Operations thereof
- H04N21/45—Management operations performed by the client for facilitating the reception of or the interaction with the content or administrating data related to the end-user or to the client device itself, e.g. learning user preferences for recommending movies, resolving scheduling conflicts
- H04N21/462—Content or additional data management, e.g. creating a master electronic program guide from data received from the Internet and a Head-end, controlling the complexity of a video stream by scaling the resolution or bit-rate based on the client capabilities
- H04N21/4622—Retrieving content or additional data from different sources, e.g. from a broadcast channel and the Internet
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
- H04N21/80—Generation or processing of content or additional data by content creator independently of the distribution process; Content per se
- H04N21/81—Monomedia components thereof
- H04N21/812—Monomedia components thereof involving advertisement data
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
- H04N21/80—Generation or processing of content or additional data by content creator independently of the distribution process; Content per se
- H04N21/83—Generation or processing of protective or descriptive data associated with content; Content structuring
- H04N21/835—Generation of protective data, e.g. certificates
- H04N21/8358—Generation of protective data, e.g. certificates involving watermark
Definitions
- the invention relates to a device for rendering content from a first source comprising substitution module for substituting a segment of the content with a content item from a second source.
- An advertisement placed in broadcast television or radio programming has the advantage of having a wide reach; millions of households see the same advertisement.
- broadcasting a single advertisement to all viewers is likely to have a low response rate as the advertisement is necessarily very generic.
- a significant improvement in consumer response rate is achieved when the advertisement is targeted to an individual household or even an individual viewer.
- a car manufacturer may have different commercials for cars in low and high price categories.
- a commercial embedded in a television signal has to address the widest audience and so would advertise the lower-priced car. If the preference profile of a particular viewer reveals that this viewer has a high income, the advertiser wants the commercial to be replaced by the one for the higher price category. As a consequence a targeted advertisement generates significantly more revenue than a regular
- advertisement replacement in devices such as set-top boxes by itself is known. Typically this involves building up a preference profile for the viewer or household, and downloading advertisements to a rendering device (e.g. television or radio) that well suit the preference profile.
- the downloaded advertisements are kept in local storage and substituted whenever the device detects the presence (or, more particularly, the beginning) of an advertisement in the incoming content stream.
- Such advertisement substitution is usually controlled by a cable or satellite operator that provides signal transmission to end users operating on the set-top boxes (STBs) that descramble and decode broadcast signals. In that situation, the operator has control over the broadcast stream and can place swap codes in the broadcast stream to signal when the advertisement will arrive.
- content substitution is more difficult.
- Such other situation may arise when content substitution is performed in the rendering device itself, wherein the content is supplied to the rendering device from an external origin, e.g. another device such as a set-top box as a first source.
- the external device selects the content from a plurality of channels to supply it to the rendering device. In that situation, the external device may switch to different content while the content substitution in the rendering device is in progress, for example when the user changes the channel on the set-top box, switches from television signals to DVD playback or calls up an electronic program guide or Teletext service.
- the rendering device is unable to detect this switch.
- the external device only delivers a single signal, seamlessly switching its content as the user selects other content or another content source.
- the substitution since normally the substitution only ceases when the substitution content finishes, the rendering device would continue the segment substitution, and only present the newly selected content, e.g. another channel, after the substitution content item has finished. This is undesirable as it conflicts with viewer expectations: if the viewer switches to another channel, this channel should display immediately and the currently-playing advertisement should cease.
- the invention solves the above-mentioned technical problem by a device for rendering content from a first source comprising a first input for receiving the content from the first source, a second input for receiving a substitution content item from a second source, substitution module for substituting a segment of the content with the substitution content item , and rendering means for rendering the content wherein the segment is substituted with the substitution content item.
- the rendering device has a monitoring module for monitoring the reception of the segment, and controlling the substitution module dependent on the segment is being received, such that the substitution module ceases the substitution of the segment by the substitution content item upon failure to receive the segment.
- the segment is the part of the content which is to be substituted by the substitution content item. When the segment is no longer being received, due to at least one of removal or finishing of the segment, change to a diffferent source and any other disturbance or interruption, detected by the monitoring module, the substitution module must stop the substituting process.
- the monitoring module comprises a first watermark detector configured for detecting a substitution watermark in one or more initial frames of the segment and controlling the substitution module to initiate the substitution upon such detection.
- the substitution watermark can be a simple low-bit watermark that only serves the purpose of indicating that the segment may be substituted by alternative content .
- the watermark can carry more information, e.g. indicating the length of the segment or even metadata comprising e.g. the type of product or the target audience. With that metadata a better selection of the substitute content item can be made.
- the device can easily determine that the substitution is to take place. Exactly which one or more initial frames are used depends on the watermarking algorithm and the way the detector operates. The phrase is not intended to mean only the very first frame.
- the monitoring module comprise a second watermark detector for detecting a segment watermark embedded in the segment, wherein the monitoring module is arranged to control the substitution module to cease the substitution when the segment watermark .
- the segment watermark may be a straightforward low-bit watermark that serves the purpose of indicating the fact that the segment is still being received. Such a low-bit watermark is easier to detect than a watermark providing a unique segment identifier.
- the segment watermark detector is further arranged for extracting an identifier from the segment watermark, and the substitution module are configured to select the substitute content item based at least on the identifier.
- advertisement or other content substitution of the segment can be done accurately.
- the device may have access to a list that maps the segment identifiers to one or plural associated substitute advertisements to facilitate selection.
- the segment identifier may be associated with locally available metadata, indicating e.g. the type of product or the target audience. With that metadata a better selection of the substitute content item can be made.
- the monitoring module comprises a fingerprint calculator for calculating a content fingerprint for the segment and a matching module for matching the calculated content fingerprint against a set of records, the substitution module being configured for controlling the substitution module to initiate the substitution upon the matching module detecting a match between the calculated content fingerprint and the set of records.
- digital content fingerprinting is used instead of watermarking as in the above embodiments.
- the reference records can be available in a local storage means.
- the reference records may be available from a remote source, such as an Internet service to retrieve information for a fingerprint or a storage device in a local network to which the device is connected.
- the substitution module are configured to select the content item based at least on the calculated content fingerprint.
- advertisement (or other content) substitution of the segment can be done accurately based on the identifying fingerprint.
- the monitoring module comprises a fingerprint calculator for calculating a content fingerprint for the segment, and a matching means for matching the calculated content fingerprint against a set of records, the monitoring module being configured for controlling the substitution module upon the matching means detecting a mismatch between the calculated content fingerprint and the set of records to cease the substitution of the segment with the substitution content item.
- the set of records is available from a remote source, such as an Internet service to retrieve information for a fingerprint or a storage device in a local network to which the device is connected. This allows a content provider who wants to enable the rendering device to perform the content substitution to update the records used for the fingerprinting and keep control over the substitution process.
- the fingerprint calculator and/or the matching means are comprised in an external device with which the device communicates over a network such as the Internet or a local network, allowing the rendering device to be as slim as possible and allow the content provider to keep control over the substitution process.
- the monitoring module is configured for detecting a disturbance in the reception of the segment and causing the substitution module to cease substitution upon detection of the disturbance. This allows ceasing the substitution when a user selects another source for the content or otherwise such that an interruption in receiving the segment being substituted by the substitution content item occurs.
- the segment is substituted by a sequence of plural content items from the second source whose combined length approximates the length of the segment.
- the segment may be substituted by a single locally available content item, which requires that the content item be substantially the same length as the segment. This may not be feasible in all situations. By substituting plural items this disadvantage can be overcome.
- the device comprises a processor, a memory, programmable with executable instructions wherein the monitoring module and substitution module in operation are performed by the executable instructions. This allows a flexible set up of the rendering device which functionality can also be updated and improved remotely.
- the problem is also solved according to the invention in a method for rendering content form a first source in a rendering device, the method comprising receiving the content having a first segment, receiving a substitution content item from a second source, substituting the segment by the substitution content item, rendering the substitution content item.
- the method further comprises according to the invention continuously monitoring the receiving of the segment in the content, and ceasing the substitution the segment with the substitution content item upon failure of the receiving of the segment.
- a computer program product comprising a data carrier, having stored thereon executable instructions, which when loaded and executed by a rendering device having a processor and memory as described, perform the steps of the method as described above.
- FIG. 1 schematically shows a device for rendering content from a first source
- Fig. 2 schematically shows an embodiment of the device that employs watermark detection
- Fig. 3 schematically shows an embodiment of the device that employs content fingerprinting
- Fig. 4 schematically shows an embodiment of the device that employs a combination of watermarking and fingerprinting.
- Fig. 1 schematically shows a device 100 for rendering content from a first input 150.
- the device 100 is embodied as a television with display 101 and loudspeakers 102, coupled to rendering module 103 which decodes, processes and renders the content from input 150 using these output devices 101 , 102.
- the first input 150 is coupled to an external device 180, as shown a set-top box, acting as a source that in turn receives the content from yet other sources such as over-the-air, cable or IP-based transmission.
- the first input 150 may for example also be a device for reading pre-stored substitution content items, such as a DVD or CD player for receiving a pre-recorded disc or an Universal Serial Bus (USB) port for connecting to an USB memory device having the pre- recorded items.
- the content may be of analog or digital nature, and can comprise any type of data, but preferably comprises audio and/or video data.
- the first input 150 may be provided with an internal storage such as a hard disk for receiving content which may be stored and rendered in a later stage.
- Input 150 and external device 180 are preferably connected via a standard connector 104 such as HDMI, and optionally employ a content protection mechanism such as HDCP to ensure that content is provided only between compliant devices.
- a standard connector 104 such as HDMI
- a content protection mechanism such as HDCP
- While the invention is presented here in the context of television display devices, the invention also is useful for other programmable devices that provide the ability to render content, such as radios, laptops, desktop computers, smartphones and netbooks.
- the device 100 comprises a substitution module 130 connected via connection 105 to the first input 150 and connected to the second input 160 via connection 106.
- the substitution module 130 is configured for substituting a segment of the content from the first input 150 with a content item from a second input 160.
- the substitution module 130 then causes via connection 108 the rendering module 103 to render this substitution content item instead of the segment from the first input 150.
- the substitution module 130 causes the rendering module 103 to resume rendering the content from the first input 150. It is usually desired that the substitution content item and the segment are of substantially the same length to ensure the substitution is smooth and hardly noticeable to the viewer.
- the segment from the first input 150 may also substituted by a sequence of plural content items from the second input 160 whose combined length approximates the length of the segment.
- the second input 160 may be a coupling 1 10 via a data network 1 1 1 to an external source 112 for substitution content items such as an Internet Protocol-based communication channel from which the content item is obtained, e.g. from a network-attached storage device in a home network.
- the second input 160 can be equipped with an internal storage medium such as an internal hard disk or similar storage medium, allowing the desired substitution content item(s) to be received well before the substitution is to occur.
- the second input 160 may for example also be a device for reading pre-stored substitution content items, such as a DVD or CD player for receiving a pre-recorded disc or an Universal Serial Bus (USB) port for connecting to an USB memory device having the prerecorded items.
- USB Universal Serial Bus
- the substitution module 130 may select the substitution content item from the second input 160 in a variety of ways.
- the substitution module 130 is coupled to a profiling module 140 that maintains a preference profile based on content that is being rendered and/or user input and/or other relevant sources of information. Maintaining such profiles and selecting content based on a profile is well-known in the art and will not be elaborated upon.
- the selected content item will be a close match with the viewer's personal preferences and/or interests.
- the substitution module 130 may select the substitution content item from the second input 160 based on an identifier for the segment.
- the substitution content items available from the second input 160 carry indications, e.g. a metadata record, for which identifiers they are an appropriate substitute.
- a list of mappings of identifiers to content at the second input 160 could be provided in another way.
- the segment from the first input 150 and the substitution content item from the second input 160 are typically advertisements, in which case the device 100 is used to provide substitute advertisements for the advertisements contained in the content from the first input 150.
- the segment and its substitute may comprise other types of content, for example music, audio dialogue dubs, child-friendly versions of content, local news or weather reports or subtitles in a different language.
- the device 100 further comprises a monitoring module 170 connected via connection 105 to the first input 150 and via connection 107 with the substitution module 107 fo controlling the substitution process.
- the monitoring module 170 is configured for continuously monitoring the first input 150 while the substitution module 130 is causing via connection 107 the substitution content item from the second input 160 to be rendered.
- Monitoring module 170 receives the content from an external source having the segment to be substituted.
- the monitoring module 170 is provided with a detector for detecting when the substitution should start.
- Detection of the start of a segment for substitution can be performed in a variety of ways.
- the commercials or other segments from the first input 150 can be recognized with embedded codes, e.g. in a vertical blanking interval.
- an examination of content characteristics typically associated with the type of content to be substituted can be performed. For example, the appearance of one or more black frames together with a significant change in audio volume is indicative of a transition to a commercial break.
- Several techniques are known in the art to detect commercial breaks or other types of content changes.
- the monitoring module 170 monitors that the segment to be substituted is continuously received from the first input 150. As long as the segment is received, the substitution may continue. However, upon failing to receive the segment, monitoring module 170 signals the substitution module 130 to cease the substitution. This in turn causes the rendering module 103 to resume rendering the content from the first input 150.
- the monitoring module 170 may employ a variety of techniques to monitor the segment being received. For example, where the beginning of the segment has been previously detected, the monitoring module 170 may scan for disturbances in the content received from the first input such as interruptions or glitches, e.g. black frames, silences, partial frames, optionally in combination with audio glitches or silence, which typically indicate that the segment is no longer being received from the first input 150. For instance, when dealing with digital audio-visual signals, the reception of several substantially black frames accompanied by a first audio glitch followed by silence is characteristic of the signal having changed from a first channel to a second channel. This characteristic is caused by the fact that the channel change requires a flush of the content buffer (both audio and video) and the reception of the first l-frame of the new channel.
- interruptions or glitches e.g. black frames, silences, partial frames
- audio glitches or silence typically indicate that the segment is no longer being received from the first input 150.
- interruptions or glitches e.g. black frames, silences
- the monitoring module 170 assumes that the segment is no longer received and signals to the substitution module 130 that the substitution must cease.
- the monitoring of the segment being received may comprise some kind of verification or check to compensate for a false detection that is not due to an actual absence of the segment.
- a video frame could for example be corrupted or missing due to transmission errors, but that should not cause the monitoring module 170 to conclude that rendering must resume from the first input 150.
- the monitoring module 170 is optionally configured to only signal the substitution module 130 to cease substitution if the disturbances persist for say three or five, frames. Whether this verification is useful depends on the type of content, the way the disturbances may be present and the chance of errors that may obscure, corrupt or omit the detection of these disturbances.
- Fig. 2 schematically shows an embodiment of the device 100 that employs watermark detection for monitoring the first source, that the segment for substitution is being received.
- Watermarks are, generally speaking, markers in the content that are
- the monitoring module 170 further comprises a substitution watermark detector 210 which is configured for continuously monitoring the content received from the first input 150 in order to detect a particular watermark therein.
- This particular watermark serves to indicate the beginning of a segment for which content substitution may be performed. Thus, it will typically be present in initial frames of the segment, preferably somewhere in the first second of the segment.
- the watermark detector 210 signals via connection 107 to the substitution module 130 that the substitution of the segment with a content item from the second input 160 is to be initiated.
- the monitoring device 170 comprises a segment watermark detector 220 for detecting a segment watermark embedded in the entire segment.
- This watermark detector 220 continuously monitors the first input 150 while the substitution module 130 is causing the substitution content item from the second input 160 to be rendered instead of the segment. As long as the segment watermark is being detected, the substitution may continue. However, upon the watermark detector 220 failing to detect the segment watermark, monitoring module 170 signals 107 the substitution module 130 to cease the substitution. This in turn causes the rendering module to resume rendering the content from the first input 150.
- the watermark detector 220 may employ a verification to ensure that a single mismatch does not trigger the switching back to the first input 150.
- the segment watermark can be a simple low-bit watermark that merely indicates that the segment is still present in the content from the first input 150.
- the segment watermark may provide an identifier for the segment. This identifier can be specific to the segment, or be a more generic identifier such as "this content is an advertisement for a car" or "this content is a weather announcement”. This identifier is then supplied to the substitution module 130 to be part of the selection of the content item from the second input 160.
- the two watermark detectors 210, 220 may be combined into a single watermark detector that can detect both the watermark indicating the beginning of a segment and the watermark that indicates the continued reception of the segment.
- These two watermarks can be one and the same: a watermark that indicates "this segment is an advertisement" or provides an identifier for the watermark does not necessarily need to be different in initial and subsequent frames.
- the watermark in the initial frames may be optimized for fast detection to allow a fast switch to the second input 160.
- the segment watermark in the subsequent frames that serves to indicate the continuous presence of the segment may be optimized for other purposes.
- Fig. 3 schematically shows an embodiment of the device 100 that employs content fingerprinting.
- Content fingerprinting is a technique wherein perceptually relevant features of a content segment are processed and combined into a code - the fingerprint - that is unique for the segment and that is the same even if the segment is slightly altered, for example when transcoding from one format to another or when resizing or rotating the segment. Unlike watermarking, content fingerprinting does not need to alter the signal itself. Content fingerprinting is sometimes also known as robust fingerprinting or robust hashing.
- the monitoring module 130 comprises a fingerprint calculator 310 which is configured for calculating a content fingerprint 31 1 for the segment.
- the calculator 310 is coupled to a matching module 320 that attempts to match the calculated content fingerprint 311 against a set of records of pre-calculated fingerprints, as shown available from database 325. If a match occurs, the matching module 320 signals to the substitution module 130 that the substitution is to be initiated. Fingerprint calculation and matching as such is a well-known technique.
- the content fingerprint 31 1 is preferably based on a set of frames near the beginning of the content instead of the whole segment, allowing the substitution to begin as soon as a match with the fingerprint is found.
- database 325 is local to the device 100.
- the records in database 325 may alternatively be available from a remote source, e.g. using an Internet service to retrieve information for a fingerprint or connecting to a network storage device in the home network that contains the information.
- the fingerprint calculator 310 and/or matching module 320 is or are placed outside of the device 100.
- the device 100 then communicates with these modules 310 and/or 320 over a network, e.g. the home network or the Internet. This way the device 100 does not have to be equipped with these modules 310, 320 itself, which saves costs. Further, one device comprising these modules 310, 320 may be deployed for a multitude of devices like device 100.
- the substitution module 130 is configured to select the content item from the second input 160 based at least on the calculated content fingerprint in the segment to be substituted from the first input 150.
- the fingerprint is unique for the segment and thus may serve as an identifier for a selection of the substitution content item, allowing content-specific substitution to be performed.
- the fingerprint calculator 310 is configured to calculate a content fingerprint 31 1 for the segment. This calculated indication fingerprint 31 1 then must be matched against a set of records, e.g. from database 325, to determine if the calculated fingerprint 311 is still part of the segment. If so, the monitoring module 170 establishes that the segment to be substituted is present. Typically this fingerprint is calculated separately for each frame or other elementary part of the segment as received from input 150.
- the set of records 325 provides a set of reference fingerprints comprising a reference fingerprint 327 for each elementary part of the segment.
- the substitution may continue. However, as soon as the calculated fingerprint 31 1 differs from the corresponding reference fingerprint 327, the monitoring module 170 signals the substitution module 130 to cease the substitution. This in turn causes the rendering module 103 to resume rendering the content from the first input 150.
- the fingerprint calculator 310 may employ a verification to ensure that a single mismatch does not trigger the switching back to the first input 150.
- the device 100 employs segment watermark detector 220 in combination with fingerprint detection. After the matching module 320 has signalled 107 to the substitution module 130 that the substitution is to be initiated, the watermark detector 220 is activated and searches for the substitution watermark embedded in the segment. Upon failing to detect the substitution watermark, monitoring module 170 signals the substitution module 130 to cease the substitution.
- Fig. 4 schematically shows an embodiment of the device 100 that employs a combination of watermarking and fingerprinting as disclosed previously.
- the substitution watermark detector 210 is used to detect a segment from the first input 150 for which content substitution is to be performed. While substitution is being performed, the fingerprint calculator 310 is used to continuously calculate the content fingerprint 31 1 for the segment. As soon as the calculated fingerprint 311 differs from a corresponding reference fingerprint 327, the monitoring module 170 signals 107 the substitution module 130 to cease the substitution.
- This combined embodiment employs the benefit of watermark detection for recognizing segments that may be substituted with the benefits of content fingerprinting for monitoring the segment while substitution takes place.
- the invention can be implemented in a computer program product, i.e. a collection of computer program instructions stored on a computer readable storage device for execution by a processor.
- the instructions of the present invention may be in any interpretable or executable code mechanism, including but not limited to scripts, interpretable programs, dynamic link libraries (DLLs) or Java classes.
- the instructions can be provided as complete executable programs, as modifications to existing programs or extensions ("plug-ins") for existing programs.
- parts of the processing of the present invention may be distributed over multiple computers or processors for better performance, reliability, and/or cost.
- Machine-readable storage devices suitable for storing computer program instructions include all forms of non-volatile memory, including by way of example semiconductor memory devices, such as ROM, RAM, EPROM, EEPROM, and flash memory devices, magnetic disks such as the internal and external hard disk drives and removable disks, magneto-optical disks and CD-ROM disks.
- the computer program product can be distributed on such a storage device, or may be offered for download through HTTP, FTP or similar mechanism using a server connected to a network such as the Internet. To this end one may connect a server system comprising the storage medium discussed above to a network, and arrange this server for allowing the instructions to be downloaded to client systems connected directly or indirectly to the network.
- the computer program instructions may be loaded into a memory and be executed on a processor embedded in the rendering device as described above.
- the processor while executing the computer program instructions implement the various modules and functions, such as the monitoring module170, the substitution module 130, the segment watermark detector 210, the substitution watermark detector 220, the fingerprint calculator 310, the fingerprint matching module 320 as described.
- the embedded processor is connected to the memory to allow the program to be loaded and executed.
- the processor can be further communicatively connected to the first and second inputs 150, 160 and the rendering device 103.
- any mention of reference signs shall not be regarded as a limitation of the claimed feature to the referenced feature or embodiment.
- the use of the word "comprising” in the claims does not exclude the presence of other features than claimed in a system, product or method implementing the invention. Any reference to a claim feature in the singular shall not exclude the presence of a plurality of this feature.
- the word "means” in a claim can refer to a single means or to plural means for providing the indicated function.
Landscapes
- Engineering & Computer Science (AREA)
- Multimedia (AREA)
- Signal Processing (AREA)
- Databases & Information Systems (AREA)
- Business, Economics & Management (AREA)
- Marketing (AREA)
- Computer Security & Cryptography (AREA)
- Two-Way Televisions, Distribution Of Moving Picture Or The Like (AREA)
Applications Claiming Priority (2)
Application Number | Priority Date | Filing Date | Title |
---|---|---|---|
NL2006978A NL2006978C2 (en) | 2011-06-21 | 2011-06-21 | Rendering device with content substitution. |
PCT/NL2012/050430 WO2012177126A1 (en) | 2011-06-21 | 2012-06-20 | Rendering device with content substitution |
Publications (1)
Publication Number | Publication Date |
---|---|
EP2724550A1 true EP2724550A1 (de) | 2014-04-30 |
Family
ID=46397605
Family Applications (1)
Application Number | Title | Priority Date | Filing Date |
---|---|---|---|
EP12730696.7A Ceased EP2724550A1 (de) | 2011-06-21 | 2012-06-20 | Darstellungsvorrichtung mit ersatz von inhalten |
Country Status (6)
Country | Link |
---|---|
US (1) | US20140196071A1 (de) |
EP (1) | EP2724550A1 (de) |
JP (1) | JP2014520480A (de) |
CN (1) | CN103782605A (de) |
NL (1) | NL2006978C2 (de) |
WO (1) | WO2012177126A1 (de) |
Families Citing this family (27)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
US9609278B2 (en) | 2000-04-07 | 2017-03-28 | Koplar Interactive Systems International, Llc | Method and system for auxiliary data detection and delivery |
US7330511B2 (en) | 2003-08-18 | 2008-02-12 | Koplar Interactive Systems International, L.L.C. | Method and system for embedding device positional data in video signals |
US20090111584A1 (en) | 2007-10-31 | 2009-04-30 | Koplar Interactive Systems International, L.L.C. | Method and system for encoded information processing |
US8582781B2 (en) | 2009-01-20 | 2013-11-12 | Koplar Interactive Systems International, L.L.C. | Echo modulation methods and systems |
US8715083B2 (en) | 2009-06-18 | 2014-05-06 | Koplar Interactive Systems International, L.L.C. | Methods and systems for processing gaming data |
US10504200B2 (en) | 2014-03-13 | 2019-12-10 | Verance Corporation | Metadata acquisition using embedded watermarks |
CN106170988A (zh) | 2014-03-13 | 2016-11-30 | 凡瑞斯公司 | 使用嵌入式代码的交互式内容获取 |
EP3183883A4 (de) | 2014-08-20 | 2018-03-28 | Verance Corporation | Wasserzeichendetektion mithilfe einer vielzahl von vorhergesagten mustern |
US20160105689A1 (en) * | 2014-10-13 | 2016-04-14 | Vigor Systems Inc. | Replacing a corrupted video frame |
US9769543B2 (en) | 2014-11-25 | 2017-09-19 | Verance Corporation | Enhanced metadata and content delivery using watermarks |
US9942602B2 (en) | 2014-11-25 | 2018-04-10 | Verance Corporation | Watermark detection and metadata delivery associated with a primary content |
WO2016100916A1 (en) | 2014-12-18 | 2016-06-23 | Verance Corporation | Service signaling recovery for multimedia content using embedded watermarks |
US10027995B2 (en) * | 2016-01-21 | 2018-07-17 | Treepodia Ltd. | System and method for generating media content in evolutionary manner |
US20170269893A1 (en) * | 2016-03-16 | 2017-09-21 | Google Inc. | Remote rendering of locally displayed content |
US11418858B2 (en) * | 2017-09-01 | 2022-08-16 | Roku, Inc. | Interactive content when the secondary content is server stitched |
US11234060B2 (en) | 2017-09-01 | 2022-01-25 | Roku, Inc. | Weave streaming content into a linear viewing experience |
KR101976428B1 (ko) * | 2017-12-21 | 2019-05-10 | 애니포인트미디어 주식회사 | 개인화 홈쇼핑 방송 시스템 |
US10791312B2 (en) | 2018-07-16 | 2020-09-29 | Gracenote, Inc. | Modifying playback of replacement content responsive to detection of remote control signals that modify operation of the playback device |
US11272252B2 (en) | 2018-07-19 | 2022-03-08 | Roku, Inc. | Modifying playback of replacement content based on control messages |
WO2020231813A1 (en) * | 2019-05-10 | 2020-11-19 | The Nielsen Company (Us), Llc | Content-modification system with responsive transmission of reference fingerprint data feature |
WO2020231927A1 (en) | 2019-05-10 | 2020-11-19 | The Nielsen Company (Us), Llc | Content-modification system with responsive transmission of reference fingerprint data feature |
US11373440B2 (en) | 2019-05-10 | 2022-06-28 | Roku, Inc. | Content-modification system with fingerprint data match and mismatch detection feature |
US11234050B2 (en) | 2019-06-18 | 2022-01-25 | Roku, Inc. | Use of steganographically-encoded data as basis to control dynamic content modification as to at least one modifiable-content segment identified based on fingerprint analysis |
US11006191B2 (en) * | 2019-08-02 | 2021-05-11 | The Nielsen Company (Us), Llc | Use of watermarking to control abandonment of dynamic content modification |
CN111757178B (zh) * | 2020-07-14 | 2022-05-27 | 北京字节跳动网络技术有限公司 | 视频生成方法、装置、电子设备和计算机可读介质 |
US11632597B2 (en) | 2020-07-22 | 2023-04-18 | Roku, Inc. | Responding to emergency-alert audio tone by abandoning dynamic content modification |
US11722741B2 (en) | 2021-02-08 | 2023-08-08 | Verance Corporation | System and method for tracking content timeline in the presence of playback rate changes |
Family Cites Families (9)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
US20020188570A1 (en) * | 1999-03-24 | 2002-12-12 | Donna Coningsby | Partial protection of content |
US7266832B2 (en) * | 2001-06-14 | 2007-09-04 | Digeo, Inc. | Advertisement swapping using an aggregator for an interactive television system |
US7263202B2 (en) * | 2001-07-05 | 2007-08-28 | Digimarc Corporation | Watermarking to control video recording |
US20030139966A1 (en) * | 2002-01-23 | 2003-07-24 | Sirota Peter L. | Advertisement delivery for streaming program |
CN101317454B (zh) * | 2003-11-12 | 2011-11-16 | 索尼电子有限公司 | 通过pid映射基于宏块的内容替换 |
US8156520B2 (en) * | 2008-05-30 | 2012-04-10 | EchoStar Technologies, L.L.C. | Methods and apparatus for presenting substitute content in an audio/video stream using text data |
US20100005486A1 (en) * | 2008-07-02 | 2010-01-07 | Xerox Corporation | Apparatus and method for embedding commercials |
US9015741B2 (en) * | 2009-04-17 | 2015-04-21 | Gracenote, Inc. | Method and system for remotely controlling consumer electronic devices |
US8798442B2 (en) * | 2009-12-12 | 2014-08-05 | At&T Intellectual Property I, Lp | System, method and computer program product for updating advertising data for recorded video data |
-
2011
- 2011-06-21 NL NL2006978A patent/NL2006978C2/en active
-
2012
- 2012-06-20 EP EP12730696.7A patent/EP2724550A1/de not_active Ceased
- 2012-06-20 JP JP2014516939A patent/JP2014520480A/ja active Pending
- 2012-06-20 WO PCT/NL2012/050430 patent/WO2012177126A1/en active Application Filing
- 2012-06-20 US US14/127,432 patent/US20140196071A1/en not_active Abandoned
- 2012-06-20 CN CN201280040651.2A patent/CN103782605A/zh active Pending
Non-Patent Citations (2)
Title |
---|
None * |
See also references of WO2012177126A1 * |
Also Published As
Publication number | Publication date |
---|---|
WO2012177126A1 (en) | 2012-12-27 |
JP2014520480A (ja) | 2014-08-21 |
US20140196071A1 (en) | 2014-07-10 |
NL2006978C2 (en) | 2012-12-28 |
WO2012177126A4 (en) | 2013-03-07 |
CN103782605A (zh) | 2014-05-07 |
Similar Documents
Publication | Publication Date | Title |
---|---|---|
NL2006978C2 (en) | Rendering device with content substitution. | |
US12052446B2 (en) | Methods and apparatus for monitoring the insertion of local media into a program stream | |
US11070892B2 (en) | Methods and apparatus to present supplemental media on a second screen | |
US11317144B2 (en) | Detection of mute and compensation therefor during media replacement event | |
US8978060B2 (en) | Systems, methods, and media for presenting advertisements | |
US9215496B1 (en) | Determining the location of a point of interest in a media stream that includes caption data | |
JP2024069189A (ja) | スポーツイベントテレビジョン番組において群衆ノイズの発生を検出するためのオーディオ処理 | |
US20160124596A1 (en) | Media presentation modification using audio segment marking | |
EP2097865A2 (de) | Vorrichtung und verfahren für den zugang zu daten in zusammenhang mit primären mediendaten | |
KR101541048B1 (ko) | 컴퓨터-기반 미디어 프리젠테이션을 측정하기 위한 방법 및 장치 | |
CN113424552A (zh) | 将媒体中检测到的不同水印关联的装置和方法 | |
WO2019046536A1 (en) | REAL TIME MULTIMEDIA CONTENT WEAVING IN A LINEAR VIEWING EXPERIENCE | |
WO2014159416A2 (en) | Methods and apparatus to present supplemental media on a second screen |
Legal Events
Date | Code | Title | Description |
---|---|---|---|
PUAI | Public reference made under article 153(3) epc to a published international application that has entered the european phase |
Free format text: ORIGINAL CODE: 0009012 |
|
17P | Request for examination filed |
Effective date: 20140114 |
|
AK | Designated contracting states |
Kind code of ref document: A1 Designated state(s): AL AT BE BG CH CY CZ DE DK EE ES FI FR GB GR HR HU IE IS IT LI LT LU LV MC MK MT NL NO PL PT RO RS SE SI SK SM TR |
|
DAX | Request for extension of the european patent (deleted) | ||
17Q | First examination report despatched |
Effective date: 20150205 |
|
RAP1 | Party data changed (applicant data changed or rights of an application transferred) |
Owner name: TELETRAX B.V. |
|
REG | Reference to a national code |
Ref country code: DE Ref legal event code: R003 |
|
STAA | Information on the status of an ep patent application or granted ep patent |
Free format text: STATUS: THE APPLICATION HAS BEEN REFUSED |
|
18R | Application refused |
Effective date: 20170420 |