CN101002472A - 从视频或音频数据流选择内容 - Google Patents

从视频或音频数据流选择内容 Download PDF

Info

Publication number
CN101002472A
CN101002472A CNA2005800272518A CN200580027251A CN101002472A CN 101002472 A CN101002472 A CN 101002472A CN A2005800272518 A CNA2005800272518 A CN A2005800272518A CN 200580027251 A CN200580027251 A CN 200580027251A CN 101002472 A CN101002472 A CN 101002472A
Authority
CN
China
Prior art keywords
fingerprint
main
stream
main flow
unit
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Granted
Application number
CNA2005800272518A
Other languages
English (en)
Other versions
CN100592789C (zh
Inventor
I·A·纳戈斯基
J·A·D·尼斯瓦德巴
R·M·阿茨
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
Koninklijke Philips NV
Original Assignee
Koninklijke Philips Electronics NV
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Family has litigation
First worldwide family litigation filed litigation Critical https://patents.darts-ip.com/?family=35427511&utm_source=google_patent&utm_medium=platform_link&utm_campaign=public_patent_search&patent=CN101002472(A) "Global patent litigation dataset” by Darts-ip is licensed under a Creative Commons Attribution 4.0 International License.
Application filed by Koninklijke Philips Electronics NV filed Critical Koninklijke Philips Electronics NV
Publication of CN101002472A publication Critical patent/CN101002472A/zh
Application granted granted Critical
Publication of CN100592789C publication Critical patent/CN100592789C/zh
Expired - Fee Related legal-status Critical Current
Anticipated expiration legal-status Critical

Links

Images

Classifications

    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
    • H04N21/40—Client devices specifically adapted for the reception of or interaction with content, e.g. set-top-box [STB]; Operations thereof
    • H04N21/45—Management operations performed by the client for facilitating the reception of or the interaction with the content or administrating data related to the end-user or to the client device itself, e.g. learning user preferences for recommending movies, resolving scheduling conflicts
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
    • H04N21/80—Generation or processing of content or additional data by content creator independently of the distribution process; Content per se
    • H04N21/81—Monomedia components thereof
    • H04N21/8126—Monomedia components thereof involving additional data, e.g. news, sports, stocks, weather forecasts
    • H04N21/8133—Monomedia components thereof involving additional data, e.g. news, sports, stocks, weather forecasts specifically related to the content, e.g. biography of the actors in a movie, detailed information about an article seen in a video program
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N19/00—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals
    • H04N19/46—Embedding additional information in the video signal during the compression process
    • H04N19/467—Embedding additional information in the video signal during the compression process characterised by the embedded information being invisible, e.g. watermarking
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
    • H04N21/20—Servers specifically adapted for the distribution of content, e.g. VOD servers; Operations thereof
    • H04N21/23—Processing of content or additional data; Elementary server operations; Server middleware
    • H04N21/234—Processing of video elementary streams, e.g. splicing of video streams or manipulating encoded video stream scene graphs
    • H04N21/2343—Processing of video elementary streams, e.g. splicing of video streams or manipulating encoded video stream scene graphs involving reformatting operations of video signals for distribution or compliance with end-user requests or end-user device requirements
    • H04N21/234363—Processing of video elementary streams, e.g. splicing of video streams or manipulating encoded video stream scene graphs involving reformatting operations of video signals for distribution or compliance with end-user requests or end-user device requirements by altering the spatial resolution, e.g. for clients with a lower screen resolution
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
    • H04N21/20—Servers specifically adapted for the distribution of content, e.g. VOD servers; Operations thereof
    • H04N21/23—Processing of content or additional data; Elementary server operations; Server middleware
    • H04N21/234—Processing of video elementary streams, e.g. splicing of video streams or manipulating encoded video stream scene graphs
    • H04N21/2343—Processing of video elementary streams, e.g. splicing of video streams or manipulating encoded video stream scene graphs involving reformatting operations of video signals for distribution or compliance with end-user requests or end-user device requirements
    • H04N21/234381—Processing of video elementary streams, e.g. splicing of video streams or manipulating encoded video stream scene graphs involving reformatting operations of video signals for distribution or compliance with end-user requests or end-user device requirements by altering the temporal resolution, e.g. decreasing the frame rate by frame skipping
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
    • H04N21/20—Servers specifically adapted for the distribution of content, e.g. VOD servers; Operations thereof
    • H04N21/23—Processing of content or additional data; Elementary server operations; Server middleware
    • H04N21/235—Processing of additional data, e.g. scrambling of additional data or processing content descriptors
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
    • H04N21/20—Servers specifically adapted for the distribution of content, e.g. VOD servers; Operations thereof
    • H04N21/23—Processing of content or additional data; Elementary server operations; Server middleware
    • H04N21/236—Assembling of a multiplex stream, e.g. transport stream, by combining a video stream with other content or additional data, e.g. inserting a URL [Uniform Resource Locator] into a video stream, multiplexing software data into a video stream; Remultiplexing of multiplex streams; Insertion of stuffing bits into the multiplex stream, e.g. to obtain a constant bit-rate; Assembling of a packetised elementary stream
    • H04N21/2368—Multiplexing of audio and video streams
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
    • H04N21/20—Servers specifically adapted for the distribution of content, e.g. VOD servers; Operations thereof
    • H04N21/23—Processing of content or additional data; Elementary server operations; Server middleware
    • H04N21/238—Interfacing the downstream path of the transmission network, e.g. adapting the transmission rate of a video stream to network bandwidth; Processing of multiplex streams
    • H04N21/2389—Multiplex stream processing, e.g. multiplex stream encrypting
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
    • H04N21/20—Servers specifically adapted for the distribution of content, e.g. VOD servers; Operations thereof
    • H04N21/23—Processing of content or additional data; Elementary server operations; Server middleware
    • H04N21/238—Interfacing the downstream path of the transmission network, e.g. adapting the transmission rate of a video stream to network bandwidth; Processing of multiplex streams
    • H04N21/2389—Multiplex stream processing, e.g. multiplex stream encrypting
    • H04N21/23892—Multiplex stream processing, e.g. multiplex stream encrypting involving embedding information at multiplex stream level, e.g. embedding a watermark at packet level
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
    • H04N21/20—Servers specifically adapted for the distribution of content, e.g. VOD servers; Operations thereof
    • H04N21/25—Management operations performed by the server for facilitating the content distribution or administrating data related to end-users or client devices, e.g. end-user or client device authentication, learning user preferences for recommending movies
    • H04N21/254—Management at additional data server, e.g. shopping server, rights management server
    • H04N21/2541—Rights Management
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
    • H04N21/40—Client devices specifically adapted for the reception of or interaction with content, e.g. set-top-box [STB]; Operations thereof
    • H04N21/41—Structure of client; Structure of client peripherals
    • H04N21/4104—Peripherals receiving signals from specially adapted client devices
    • H04N21/4135—Peripherals receiving signals from specially adapted client devices external recorder
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
    • H04N21/40—Client devices specifically adapted for the reception of or interaction with content, e.g. set-top-box [STB]; Operations thereof
    • H04N21/43—Processing of content or additional data, e.g. demultiplexing additional data from a digital video stream; Elementary client operations, e.g. monitoring of home network or synchronising decoder's clock; Client middleware
    • H04N21/434—Disassembling of a multiplex stream, e.g. demultiplexing audio and video streams, extraction of additional data from a video stream; Remultiplexing of multiplex streams; Extraction or processing of SI; Disassembling of packetised elementary stream
    • H04N21/4341—Demultiplexing of audio and video streams
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
    • H04N21/40—Client devices specifically adapted for the reception of or interaction with content, e.g. set-top-box [STB]; Operations thereof
    • H04N21/43—Processing of content or additional data, e.g. demultiplexing additional data from a digital video stream; Elementary client operations, e.g. monitoring of home network or synchronising decoder's clock; Client middleware
    • H04N21/435—Processing of additional data, e.g. decrypting of additional data, reconstructing software from modules extracted from the transport stream
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
    • H04N21/40—Client devices specifically adapted for the reception of or interaction with content, e.g. set-top-box [STB]; Operations thereof
    • H04N21/43—Processing of content or additional data, e.g. demultiplexing additional data from a digital video stream; Elementary client operations, e.g. monitoring of home network or synchronising decoder's clock; Client middleware
    • H04N21/438—Interfacing the downstream path of the transmission network originating from a server, e.g. retrieving encoded video stream packets from an IP network
    • H04N21/4383—Accessing a communication channel
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
    • H04N21/40—Client devices specifically adapted for the reception of or interaction with content, e.g. set-top-box [STB]; Operations thereof
    • H04N21/43—Processing of content or additional data, e.g. demultiplexing additional data from a digital video stream; Elementary client operations, e.g. monitoring of home network or synchronising decoder's clock; Client middleware
    • H04N21/438—Interfacing the downstream path of the transmission network originating from a server, e.g. retrieving encoded video stream packets from an IP network
    • H04N21/4385—Multiplex stream processing, e.g. multiplex stream decrypting
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
    • H04N21/40—Client devices specifically adapted for the reception of or interaction with content, e.g. set-top-box [STB]; Operations thereof
    • H04N21/43—Processing of content or additional data, e.g. demultiplexing additional data from a digital video stream; Elementary client operations, e.g. monitoring of home network or synchronising decoder's clock; Client middleware
    • H04N21/44—Processing of video elementary streams, e.g. splicing a video clip retrieved from local storage with an incoming video stream or rendering scenes according to encoded video stream scene graphs
    • H04N21/44008—Processing of video elementary streams, e.g. splicing a video clip retrieved from local storage with an incoming video stream or rendering scenes according to encoded video stream scene graphs involving operations for analysing video streams, e.g. detecting features or characteristics in the video stream
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
    • H04N21/40—Client devices specifically adapted for the reception of or interaction with content, e.g. set-top-box [STB]; Operations thereof
    • H04N21/43—Processing of content or additional data, e.g. demultiplexing additional data from a digital video stream; Elementary client operations, e.g. monitoring of home network or synchronising decoder's clock; Client middleware
    • H04N21/44—Processing of video elementary streams, e.g. splicing a video clip retrieved from local storage with an incoming video stream or rendering scenes according to encoded video stream scene graphs
    • H04N21/44016—Processing of video elementary streams, e.g. splicing a video clip retrieved from local storage with an incoming video stream or rendering scenes according to encoded video stream scene graphs involving splicing one content stream with another content stream, e.g. for substituting a video clip
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
    • H04N21/40—Client devices specifically adapted for the reception of or interaction with content, e.g. set-top-box [STB]; Operations thereof
    • H04N21/45—Management operations performed by the client for facilitating the reception of or the interaction with the content or administrating data related to the end-user or to the client device itself, e.g. learning user preferences for recommending movies, resolving scheduling conflicts
    • H04N21/462—Content or additional data management, e.g. creating a master electronic program guide from data received from the Internet and a Head-end, controlling the complexity of a video stream by scaling the resolution or bit-rate based on the client capabilities
    • H04N21/4622—Retrieving content or additional data from different sources, e.g. from a broadcast channel and the Internet
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
    • H04N21/40—Client devices specifically adapted for the reception of or interaction with content, e.g. set-top-box [STB]; Operations thereof
    • H04N21/45—Management operations performed by the client for facilitating the reception of or the interaction with the content or administrating data related to the end-user or to the client device itself, e.g. learning user preferences for recommending movies, resolving scheduling conflicts
    • H04N21/466—Learning process for intelligent management, e.g. learning user preferences for recommending movies
    • H04N21/4667—Processing of monitored end-user data, e.g. trend analysis based on the log file of viewer selections
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
    • H04N21/80—Generation or processing of content or additional data by content creator independently of the distribution process; Content per se
    • H04N21/83—Generation or processing of protective or descriptive data associated with content; Content structuring
    • H04N21/84—Generation or processing of descriptive data, e.g. content descriptors
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
    • H04N21/80—Generation or processing of content or additional data by content creator independently of the distribution process; Content per se
    • H04N21/83—Generation or processing of protective or descriptive data associated with content; Content structuring
    • H04N21/845—Structuring of content, e.g. decomposing content into time segments
    • H04N21/8456—Structuring of content, e.g. decomposing content into time segments by decomposing the content in the time domain, e.g. in time segments
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
    • H04N21/80—Generation or processing of content or additional data by content creator independently of the distribution process; Content per se
    • H04N21/85—Assembly of content; Generation of multimedia applications
    • H04N21/854—Content authoring
    • H04N21/8549—Creating video summaries, e.g. movie trailer
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N5/00—Details of television systems
    • H04N5/44—Receiver circuitry for the reception of television signals according to analogue transmission standards
    • H04N5/50—Tuning indicators; Automatic tuning control
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N5/00—Details of television systems
    • H04N5/76—Television signal recording
    • H04N5/91—Television signal processing therefor

Landscapes

  • Engineering & Computer Science (AREA)
  • Multimedia (AREA)
  • Signal Processing (AREA)
  • Databases & Information Systems (AREA)
  • Computer Security & Cryptography (AREA)
  • Television Signal Processing For Recording (AREA)
  • Two-Way Televisions, Distribution Of Moving Picture Or The Like (AREA)
  • Management Or Editing Of Information On Record Carriers (AREA)
  • Signal Processing For Digital Recording And Reproducing (AREA)

Abstract

一个主流包含连续的视频和/或音频信息内容单元，其在第一数据速率下编码视频和/或音频信息。计算电路(144)从所述连续的内容单元计算主指纹。接收一个参考流，该参考流具有低于第一数据速率的第二数据速率。该参考流限定参考指纹序列。比较器单元(144)把所述主指纹与所述参考指纹进行比较。监测该主流，以便观察在各原始内容单元之间是否存在插入的内容单元，其中所述原始内容单元具有与连续的参考指纹相匹配的主指纹，而所插入的内容单元具有不与参考指纹相匹配的主指纹。跳过对于所插入的内容单元的呈现。在一个实施例中，当多于一个内容单元匹配时，只呈现其中的一个。在另一个实施例中，所述匹配过程被用于控制广告跳过，以便跳到或者跳离该主流。在另一个实施例中，所述匹配过程被用于控制把单独接收的编排信息(比如字幕)链接到主流中的各点。

Description

从视频或音频数据流选择内容
本发明涉及一种用于从数据流、特别是视频和/或音频数据流选择内容的方法和设备，所述数据流例如已经通过广播而被分发。更具体来说，根据一个方面，本发明涉及一种用于回放数据流、特别是视频和/或音频数据流的方法和设备，所述数据流已经在其被分发之后而被编辑。根据一个方面，本发明涉及一种用于频道切换(跳过广告(zapping))的方法和设备。
电视广播典型地包含连续的内容项。所述内容项的例子是电影、体育比赛记录、脱口秀等等。已经设计了视频记录设备以用来记录和回放来自这种广播的所选项目，其中典型地通过在定时器的控制下进行选择。定时器控制的记录的一个公知的问题在于，其不考虑项目的广播时的不可预知的延迟以及项目的不可预知的延长等等。此外，定时器控制的记录不可避免地还记录已被插入在所述流中的商业广告，以及重复紧接在商业广告之后的所选项目的简短的前序部分。
已经在现有技术中提出了对于基于定时器的记录和回放的多种改进。美国专利申请No 20010051037公开了如何可以使用对于电子节目指南的自动访问来使得记录器能够更为准确地选择记录的开始和结束时间。当利用关于内容项的广播延迟和时间延长的信息来更新电子节目指南时，被编程来记录该项目的记录器可以相应地适配开始和结束时间。电子节目指南是使用对应于广播流的索引表的一个例子，其具有指向该流中的内容改变的时间点的指针。
由美国专利申请No 20010051037提供的另一个解决方案是使用广播流自身中的编排标签，从中可以确定内容项的开始和结束时间。美国专利申请No.20020176702类似地使用广播流中的标识符，所述标识符还可以被用于消除对商业广告的记录。
这些解决方案的问题在于，广播商必须提供专用于对所述流的非正常访问的附加信息，其形式是索引表(例如实时更新的电子节目指南)或者编排标签。该附加信息中的错误或者如果无法提供适当的定时都会显著地影响记录。此外，广播商可能不太愿意提供该信息，因为该信息仅仅是开销，或者因为该信息降低了电视频道对于广告上的吸引力。当例如在盘上分发数据时也出现了相同的问题。
除了记录和回放之外，附加信息可以用于其他应用，比如自动地智能跳过广告或者编排视频信息。支持自动智能广告跳过的设备例如可以被设计成跳过正在广播商业广告的频道或者一旦在原始频道上恢复对原始视频信息项的广播时跳回到该原始频道。为此目的，需要相同类型的信息以用于选择性记录，并且如果该信息不准确的话则将遭受相同的问题。
视频信息的编排可以包括添加字幕、替换语言音频信息、章节标记、菜单、付费内容等等。为此目的，需要相同类型的信息以用于选择性记录，并且如果该信息不准确的话则将遭受相同的问题。
从PCT专利申请No 2004019527(转让给与本专利申请相同的受让人)已知利用数字指纹匹配来触发视频记录器(所述指纹在本公开中被称作“签名”)。PCT专利申请No 2004019527给出了指纹计算技术的例子。这里使用的“指纹”指的是从信号(或者信号部分)获得的信息，该信息表示视频和/或音频内容，从而该指纹显著受到当视频和/或音频的观众和/或听众感知内容时确定其感知印象的因素的影响。因此，所述指纹在很大程度上对于所感知的内容来说是独特的。在这方面，这里使用的指纹不同于视频和/或音频中的水印，因为水印独立于所感知的内容。
PCT专利申请No 2004019527的记录方法是基于观察到电视上的内容项常常以相同的开场图像开始，其被称为“引子(intro)”。计算所述引子的一个例子的指纹，计算输入视频流的各指纹并且将其与该引子的指纹相比较。当找到匹配时，记录器被启动。
PCT专利申请No 2004019527描述了使用指纹来搜索已记录素材中的引子，从而便于选择性回放。然而，这些已知的指纹方法只限于前面由已知引子的内容。因此，对于内容的选择只限于包含标准影像的节目的起始点。
本发明的其中一个目的是在优选地利用插入物从广播流中分发了视频和/或音频流之后实现对所述插入物的细粒度选择，而无需来自分发商的所述流中的地址表或者该流中的编排标签。
本发明的其中一个目的是实现对视频和/或音频信息项的基本上无缝的重建，其中所述视频和/或音频信息项在视频和/或音频流中与其他视频和/或音频数据混杂地分发。
本发明的其中一个目的是允许在多个同时广播的视频和/或音频流当中智能地跳过广告，而无需来自分发商的所述流中的地址表或者该流中的编排标签。
本发明的其中一个目的是支持对所广播的视频和/或音频流的编排。
在独立权利要求中阐述了根据本发明的设备和方法。根据本发明，通过提供附加的参考流，对主视频和/或音频流的指纹的细粒度匹配(如上定义)成为了可能，其中该参考流限定了一系列指纹以及这些指纹的序列顺序。该参考流可以以文件的形式分发。该参考流对应于主流的核心(例如电影)，而不对应于插入在主流中的不与主流的核心相对应的部分(例如商业广告)。也就是说，用于对应的呈现时间间隔的数据量在参考流中低于在主流中的情况。在一个实施例中，所述参考流是主流的低(时间或空间)分辨率版本，其中没有商业广告。在这种情况下，可以从所述参考流的视频和/或音频内容中计算参考指纹，并且可以从参考流的序列中导出所述参考指纹的序列。在另一个实施例中，所述参考流直接包含参考指纹。
提供上述类型的参考流使得有可能编辑主流。由于参考流可以具有比主流低很多的数据速率，因此可以“销售”所述参考流以便允许对主流的改进质量的访问，而无需在主流的高数据速率下重新分发流。优选地，根据其在主流和参考流中的相应位置对主流和参考流的指纹进行匹配。也就是说，如果从主流获得的对应于特定内容单元的主指纹基本上等于从参考流获得的特定参考指纹，并且对应于在时间上与该特定内容单元相邻的来自主流的另一个内容单元的主指纹也匹配，则所述主指纹被检测成是匹配的。
在一个实施例中，所述参考流还被用于检测对于主流中的内容的复制，例如紧接在所插入的商业广告之前或之后的内容。这样，可以确保只呈现所复制部分的一个拷贝。在原理上，可以简单地通过测试同一个参考指纹是否与主流的超过一个内容单元的指纹相匹配来检测复制。在一个优选实施例中，如果检测到一个流部分紧接在所插入的内容单元的相同部分之前以及之后(通过缺少匹配指纹而被检测到)，则去除对该流部分的复制。因此，避免了意外去除复制的风险。
另一个应用是所述参考流可以被用于支持智能广告跳过，例如通过跳过广播其指纹与参考指纹不匹配的信息的频道，或者通过一旦在主频道的视频和/或音频数据中找到匹配指纹就返回主频道从而终止广告跳过。
另一个应用是所述参考流可以被用于添加编排信息。所述编排信息(例如字幕信息、替换语言通道、菜单、章节标记、付费内容等等)可以与所述参考流相结合地被提供，从而可以把所述编排链接到该参考流中的由指纹匹配所选择的位置。这样，可以对于单独的用户构造高质量的流，而无需为这些单独用户保留用于传输该流的全部带宽(该带宽被提供在与其他不接收该编排信息的用户共享的广播频道中)。
下面将参照附图所示的非限制性例子更详细地描述本发明的这些和其他方面。
图1示出了视频和/或音频呈现系统；
图2示意性地示出了视频和/或音频数据的广播流；
图3示意性地示出了视频和/或音频数据的参考流；
图3a示意性地示出了时间点之间的关联；
图4示意性地示出了已编辑的视频和/或音频数据流；
图5示出了具有自动广告跳过的视频和/或音频呈现系统；以及
图6示出了支持编排的视频和/或音频呈现系统。
图1示出了一个视频和/或音频呈现系统，其包括广播传输设备10、参考传输设备12和接收器设备14。接收器设备14包括频道接收器140、存储装置142、参考比较器144、编辑单元146和呈现单元148。频道接收器140具有用于从广播传输设备10接收广播数据流的输入端，以及耦合到存储装置142的输出端。编辑单元146具有耦合到存储装置142的接口，以及耦合到呈现单元148的输出端。呈现单元148例如包括显示屏幕和/或扬声器，以用于呈现由编辑单元146提供的视频和/或音频信息。参考比较器144具有用于从参考传输设备12接收参考流的输入端、耦合到存储装置142的接口以及耦合到编辑单元146的控制输入端的输出端。
在操作中，广播传输设备10广播视频和/或音频数据流，参考传输设备12发送参考流。图2示出了作为时间T的函数的广播流20。该流包含诸如电影的视频信息项，其已被剪辑成部分22a-g，所述各部分在时间上与诸如商业广告的其他项目24a-f混杂地被广播。一般来说，流20被接收、解码以及呈现时，这将导致与对其他项目24a-f的视觉和/或听觉呈现混杂的对于部分22a-g的视觉和/或听觉呈现。
图3示出了参考流30。该参考流30包含对应于发送参考信号的部分32a-g。与广播流20相比，部分32a-g未与其他项目混杂。在一个实施例中，参考信号30包含一系列指纹数据项，其中的每一个对应于可以从广播流20的相应部分的视频和/或音频数据计算的指纹，例如从相应的视频帧、帧组或者音频时间间隔中的视频数据计算。在一个替换实施例中，参考流30包含低空间和/或时间分辨率下的表示来自广播流的音频和/或视频编码单元的各单元，而没有混杂的商业广告。在每个实施例中，参考流中的信息被构造成使得参考流30中的数据速率(从而是在呈现期间对于相同的时间间隔所需要发送的数据比特数)远远低于广播流20中的数据速率。这示意性地由图2的广播流20被绘制成比图2的参考流30更宽来表示。
在操作中，接收器设备4接收广播流20和参考流30。在原理上，可以使用相同的通信介质来接收这两个流(例如从卫星或地面无线广播或者从有线电视网络接收)。然而，优选地使用不同的介质，参考流30例如是通过因特网接收的，或者是在例如盘的数据载体上分发的。频道接收器140接收广播流，并且把来自该流的数据存储在存储装置142中，该存储装置可以包含磁硬盘、闪存等等。
在广播流的一部分已经被存储之后，编辑单元146开始从存储装置142中取回来自该流的数据，其解码所取回的数据以便到处视频和/或音频信号，并且将解码后的信号提供到呈现单元148。编辑单元146被安排成跳过广播流20的所选部分，从而呈现单元148不呈现这些部分的相应的视频和/或音频信号。参考比较器144控制对所跳过的部分的选择。参考比较器例如被实现为适当变成的可编程处理器，或者被实现为专用电路。
参考比较器144接收参考流30。在一个实施例中，参考流30基本上与广播流20被同时接收，但是可以替换地在更早或者更迟的时候接收参考流30。优选地，参考比较器144在存储装置142或者另一个存储器中存储整个参考流30或者存储它的一部分或者存储从参考流30计算的指纹，以用于随后使用。或者，参考比较器144可以接收参考流30以用于基本上即时使用，在这种情况下，不需要对整个参考流30的长期存储。
在编辑期间，参考比较器144从存储装置142取回广播流20的各部分，其计算对应于这些所取回的部分的指纹，并且将这些所计算的指纹与从参考流30获得的指纹相比较。指纹计算技术的例子可以在WO 2004019527中找到。当参考流30包含一系列指纹时，可以基本上直接将这些指纹与所计算的指纹进行比较，但是在参考流30包含广播流20的单元的低分辨率版本而不包含指纹的一个实施例中，可能需要在比较之前首先从该低分辨率版本中计算所述指纹。
作为比较的结果，参考比较器144检测出广播流20的哪一片段的指纹与从参考流30获得的特定指纹相匹配。在这种情况下，把由参考流30限定的时间点与广播流20的导致所述匹配指纹的该片段相关联。
图3a使用连线来表示由参考流30限定的时间点与广播流20中的时间点(典型地是广播流20中的限定从中计算出匹配指纹的片段的开始，或者例如是从中计算出匹配指纹的视频帧的开始)的所得到的关联。应当理解，为了简明起见图中只示出了几个关联。典型地，对于相隔不超过一秒(并且优选地是相隔不超过十分之一秒)的时间点检测所述关联。在一点处，图中示出由广播流20中的商业广告中断分隔开的两个时间点与由参考流30限定的一个时间点相关联。这在下面将描述的特殊情况下可能会发生。
已经被检测出按照这样的方式与广播流20相关联的时间点被用于控制由编辑单元146进行的编辑。典型地，将会发现在部分22a-g期间，广播流20的连续片段被与连续的时间点相关联。对于中断24a-f将不会找到匹配指纹，并且下一个时间点将仅与广播流20的在中断24a-f之后的下一个部分22a-g相关联。在一个实施例中，编辑单元146选择性地跳过广播流20的不与由参考流30限定的时间点相关联的各片段。在另一个实施例中，对于由没有对其执行指纹匹配的其他片段分隔开的所采样片段确定指纹。在该实施例中，在片段之间的为其找到了匹配片段的来自广播流20的所述其他片段没有被跳过。在片段之间的没有为其找到匹配片段的来自广播流20的其他片段被跳过。优选地，编辑单元146选择所跳过的部分的长度，从而将在由所述相关时间点限定的相互距离下呈现广播流20的剩余部分。
在许多广播流20(其中视频和/或音频数据项被商业广告中断)中，在所述商业广告之前的该项目的至少一部分在该商业广告之后被重复。这样做允许观众在商业广告之后、在呈现新的视频和/或音频信息之前再次了解上下剧情。在这种情况下，参考比较器144可能从广播流20中识别出其指纹与从参考流30获得的指纹相匹配的两个片段。优选地，还检测这些复制片段是否分别紧接在相同的所插入片段之前和之后。编辑单元146优选地被配置成响应于检测到这种复制而跳过这两个片段的其中之一，从而将在由所述相关联的时间点限定的相互距离下呈现广播流20的剩余部分。
在一个实施例中，编辑单元146包括来自广播流20的所有片段，直到其指纹与从参考流30获得的指纹不匹配的第一个片段(在商业广告中断24a-f的开始处)。在这种情况下，从参考流30获得的指纹包括顺序地第一后续指纹，该指纹与对于一个片段从广播流20计算的指纹不匹配，该片段与为之从参考流获得了匹配指纹的广播流20的前一个片段具有正常的时间距离。参考比较器144在广播流20中搜索一个后续片段(在商业广告中断24a-f之后)，其具有与所述顺序地第一后续指纹相匹配的指纹。这对应于在商业广告中断之后的第一个尚未被广播的信息。编辑单元146跳过广播流20，直到该后续片段。按照这种方式，去除了所述商业广告中断和该流的所复制的部分。
应当理解，其他解决方案也是可能的，比如跳过商业广告中断之前的广播流20的至少一部分，并且紧接在该商业广告中断之后从具有匹配指纹的第一片段恢复。可以使用其他解决方案，其跳过所述商业广告中断之前和之后的广播流的一部分，只要实现基本上连续的时间点流就可以。
图4示出了被提供到呈现单元148的输出流40的构成。由参考流30对于匹配指纹限定的时间点来控制来自广播流的所述项目的各部分22a-g的开始的相对定时，并且通过在完成在前部分之前开始相继部分22a-g之前来防止重复。
应当理解，该技术不限于去除商业广告中断周围的重复。也可以使用例如体育比赛期间的回放之类的其他重复。在这种情况下，搜索复制指纹匹配，并且编辑单元146从第一片段开始跳过广播流20，直到来自广播流20的第一个下一第一片段，其中所述第一片段的指纹与对应于来自广播流20的前一片段的来自参考流30的相同指纹相匹配，而所述第一个下一第一片段的指纹与不对应于来自广播流20的前一片段的来自参考流30的指纹相匹配。优选地，可以在相应的模式之间切换编辑单元146，其中分别启用及禁用上述类型的跳过。优选地，编辑单元146还被安排成在将被跳过的时间间隔的长度超出阈值长度的情况下防止跳过。
可以使用对于具有匹配指纹的片段的任何类型的搜索。在一个实施例中，参考比较器144选择来自广播流20的下一片段的初始位置，其中对应于该下一片段的下一指纹被匹配于来自参考流30的特定指纹，该初始位置与其指纹匹配来自参考流的前一指纹的前一片段具有一个偏移量。该偏移量被选择成等于由所述前一指纹和下一指纹之间的参考流限定的时间间隔。如果在该初始位置处没有找到匹配，则对于广播流20的相继片段执行新的比较，直到找到与来自参考流30的下一指纹相匹配的片段。这样做的优点在于，一旦已经找到广播流的与特定参考指纹相匹配的指纹，就将不搜索与该特定参考指纹相匹配的来自广播流20的其他指纹。从而降低了意外匹配的风险。
然而，如果检测到与所述特定参考指纹相匹配的来自广播流的主指纹的后面跟随有该广播流中的不匹配的主指纹，则优选地可以有一个例外。在这种情况下，搜索该特定参考指纹与来自广播流的各主指纹的后续复制匹配。按照这种方式，可以检测到在中断之前和之后的内容复制。
然而，应当理解，替换地可以通过把来自参考流30的指纹与来自广播流20的一个时间点范围内的多个指纹相比较来执行对于匹配指纹的搜索，或者反之通过将来自广播流20的指纹与来自参考流30的一个时间点范围内的多个指纹进行比较。当所述指纹足够独特时，这种做法很有效果。
在一个实施例中，在呈现期间执行所述指纹比较以及可选地执行所述指纹计算，同时从存储装置142读取广播流20。对于该实施例，参考流30可以在不同于广播流20的时间提供，例如仅仅在呈现期间提供。这样做的优点在于，可以通过在后面提供参考流30来选择性地启用经编辑的呈现，例如在付费之后，或者在经过一段时间之后(例如对于体育比赛的非现场观看)。
应当理解，其他实施例也是可能的。例如，参考比较器144可以被设置成预先在参考流30和广播流20中计算指纹以及选择匹配时间点。在一个实施例中，参考比较器144把关于匹配时间点的信息存储在索引表中，以便由编辑单元146在呈现期间使用。这些计算可以在记录广播流20时执行，或者在广播流20存在于存储装置142中时执行。
在另一个实施例中，所描述的基于指纹的编辑在接收和存储广播流20期间已经被执行。这样做减少了需要被保留在存储装置142中的数据量。或者，所述编辑可以在存储之后但是在呈现之前被执行，这是通过从存储装置142中选择性地删除所存储的广播流20的各部分。
虽然对于广播流20描述了上述实施例，其中该广播流已经由广播传输设备10例如通过地面广播介质或者通过有线电视或卫星广播进行了广播，但是应当理解，所描述的技术可以应用于通过其他介质分发的流，例如在DVD之类的光盘上分发的流。这样，可以通过提供参考流来提高所分发的流的价值，而无需消耗对应于全数据速率流的带宽。此外，本发明不限于其中必须存储流的应用。
图5示出了一个系统，其中本发明被应用于智能广告跳过。在该实施例中，使用具有遥控单元52的接收设备50。接收设备50包含第二频道接收器54和频道选择器56。与被称作第一频道接收器的频道接收器140相同，第二频道接收器54被耦合来接收广播数据。第二频道接收器54具有耦合到参考比较器144的输出端，该参考比较器具有耦合到频道选择器56的输出端。第一频道接收器140具有耦合到解码器58的输出端，该解码器具有耦合到呈现单元148的输出端。频道选择器56具有耦合到第一频道接收器140的控制输出端。第一和第二频道接收器140、54支持调谐到不同的频道(或者从传输流中选择不同的节目)。
在操作中，频道选择器56支持在遥控单元52的控制下的广告跳过(频道改变)。根据本发明的一个方面，根据指纹匹配的结果来控制广告跳过。在一个实施例中，频道选择器56被设置成控制第一频道接收器140来接收利用遥控单元52选择(例如通过按下频道向上或向下按钮)的连续频道，以便预测将被选择的下一个频道并且控制第二频道接收器54来接收所预测的下一个频道。
参考比较器144随后把从该预测频道中的广播流中计算的指纹与来自对应于该广播流的参考流的指纹相匹配，并且发信号向频道选择器56通知是否找到匹配。在接收到来自遥控单元52的选择该下一个频道的命令时，如果参考比较器144表示最近(在一个预定的在前时间间隔内)存在匹配指纹，则频道选择器56控制第一频道接收器切换到该频道。如果没有找到这种指纹，则频道选择器56控制第一频道接收器140响应于该命令切换到另一个频道。这样，所述广告跳过自动地跳过与参考流不匹配的频道。
在另一个实施例中，频道选择器56被设置成通过预测一个所预测的后续下一频道而对于在所预测的下一频道中不存在匹配指纹做出响应，并且使得第二频道接收器54接收所预测的后续下一频道，其中在所预测的下一频道之后将在广告跳过期间选择该预测的后续下一频道。随后，参考比较器144把对于该预测的后续下一频道从广播流中计算的指纹与来自对应于该广播流的参考流的指纹进行比较，并且发信号向频道选择器56通知是否找到匹配。
只要没有找到匹配指纹，就可以对于其他的所预测频道重复这一过程。这样，频道选择器56可以使得在广告跳过期间跳过多于一个频道，从而所呈现的频道跳到没有参考流可用或者有参考流可用并且最近广播流包含匹配指纹的下面的频道。因此，例如如果参考流描述所发送的项目而不描述这些项目中的商业广告，则频道选择器可以使得在广告跳过期间跳过正广播商业广告的频道。
其他的应用也是可能的。例如，在另一个实施例中，频道选择器56可以被用来允许在优选的频道上正播放商业广告的时间期间跳过广告，并且在该商业广告结束时切换回到该优选频道。为此目的，频道选择器56可以被安排成在对第一频道接收器140的频道选择进行广告跳过期间把第二频道接收器54设置到所选的频道，以及一旦在来自该优选频道的广播流中检测到匹配指纹时禁用广告跳过并且把频道接收器140切换回到该优选频道。在另一个实施例中，频道选择器56被安排成支持不同的广告跳过模式，其中以彼此不同的方式使用指纹信息。
图6示出了一个实施例，其中参考传输设备12还在参考流30中发送编排信息。这样的编排信息例如在DVD系统中已知，并且例如可以包括一种或多种语言的字幕信息、替换的音频声道、用于访问该流的菜单、章节标记或者不包括在广播中的付费视频信息。参考传输设备12在参考流中发送把所述编排信息链接到视频信息或者视频信息的指纹的信息。
在图6的实施例中，信息选择电路60接收参考流，其提取所述编排信息并且把该编排信息存储在存储装置142中。参考比较器144把对应于广播流的指纹与从该广播流中获得的指纹进行比较，其中参考传输设备12已经把从该广播流中获得的所述指纹链接到一个编排信息项。当其检测到匹配时，参考比较器144在存储装置142中存储把广播信息的相关部分链接到所述编排信息的信息。这样做例如是为了从来自广播流和参考流的数据组合构造包含在DVD盘中的那类信息(其允许语言或字幕选择、观看菜单和/或章节表、观看付费内容等等)。
在图6的实施例中，编辑单元146可以被安排成DVD回放控制器，以便把所存储的信息基本上当作是从DVD盘中取回的信息来进行处理，从而允许用户交互式访问该信息，以便选择语言或字幕等等。当然，可以使用不类似于DVD访问的其他类型的访问。
虽然利用具有不同组件的接收设备14的实施例说明了本发明，但是应当理解，在实践中，可以使用相同的电路来实现所述不同组件，或者使用适当编程的可编程计算机来实现诸如指纹计算、匹配和编辑之类的任何或全部功能。因此，本发明还包括具有指令的计算机程序产品，当由这种计算机执行所述指令时，所述指令使得该计算机实施本发明。

Claims (13)

1、一种用于从音频和/或视频数据流中选择内容的设备，该设备包括：
输入端(140)，其用于接收主流，该主流包括连续的视频和/或音频数据内容单元；
计算电路(144)，其用于从所述连续的内容单元计算主指纹；
比较器单元(144)，其用于把该主指纹与参考指纹进行比较；以及
控制电路(146)，其被安排成从该主流中选择其主指纹与该参考指纹相匹配的所有内容单元，或者从该主流中选择其主指纹与该参考指纹失配的所有内容单元。
2、根据权利要求1的设备，其中，如果所述主指纹与所述参考指纹失配则所述控制单元(146)从所述主流中选择内容单元，并且该控制单元(146)使得跳过对于所述内容单元的呈现。
3、根据权利要求2的设备，其中，所述比较器单元(144)被安排成不止一次检测所述主指纹是否与所述参考指纹相匹配，并且所述控制单元(146)被安排成响应于该检测使得所述相应的各内容单元当中的不超过一个被渲染。
4、根据权利要求1的设备，其包括存储装置(142)以用于在接收时存储所述主流，所述控制单元(146)被安排成选择其主指纹与所述参考指纹相匹配的内容单元以便选择性地从该存储装置(142)取回。
5、根据权利要求1的设备，其包括存储装置(142)以用于在接收时存储所述主流以及编排信息，所述比较器单元(144)被安排成使得链接信息被存储，所述链接信息表示所述主指纹在哪里与所述参考指纹中的链接点相匹配。
6、根据权利要求1的设备，其包括频道选择单元(56)，该频道选择单元被安排成在所述主指纹与所述参考指纹失配时切换到呈现另一个流，并且在所述主指纹与所述参考指纹匹配时切换回到呈现所述主流。
7、根据权利要求1的设备，其中，用于接收所述主流的输入端(140)和用于接收所述参考指纹的输入端(141)被安排成从彼此不同的分发介质接收所述主流和参考指纹。
8、根据权利要求1的设备，其中，用于接收所述主流的输入端(140)被安排成通过广播频道接收所述主流。
9、根据权利要求8的设备，其包括存储装置(142)以用于在接收时记录所述主流，其主指纹与所述参考指纹失配的内容项被丢弃以保留在该存储装置(142)中。
10、根据权利要求1的设备，其中，所述计算电路(144)被安排成从所述内容单元的低分辨率版本计算所述参考指纹。
11、一种从音频和/或视频数据流中选择内容的方法，该方法包括：
接收主流，该主流包括连续的视频和/或音频信息内容单元(22a-g)；
从所述连续的内容单元(22a-g)计算主指纹；
把该主指纹与参考指纹进行比较；以及
从该主流中选择其主指纹与该参考指纹相匹配的所有内容单元，或者从该主流中选择其主指纹与该参考指纹失配的所有内容单元。
12、根据权利要求11的方法，其中，如果所述主指纹与所述参考指纹失配则从所述主流中选择内容单元，并且该方法还包括使得跳过对所述内容单元的呈现的步骤。
13、一种包括指令程序的计算机程序产品，当该指令程序由可编程机器执行以用于从音频和/或视频数据流中选择内容时，该指令程序使得该机器执行以下操作：
接收主流，该主流包括连续的视频和/或音频信息内容单元；
从所述连续的内容单元计算主指纹；
把该主指纹与参考指纹进行比较；以及
从该主流中选择其主指纹与该参考指纹相匹配的所有内容单元，或者从该主流中选择其主指纹与该参考指纹失配的所有内容单元。
CN200580027251A 2004-08-12 2005-08-09 从视频或音频数据流选择内容 Expired - Fee Related CN100592789C (zh)

Applications Claiming Priority (2)

Application Number Priority Date Filing Date Title
EP04103902.5 2004-08-12
EP04103902 2004-08-12

Publications (2)

Publication Number Publication Date
CN101002472A true CN101002472A (zh) 2007-07-18
CN100592789C CN100592789C (zh) 2010-02-24

Family

ID=35427511

Family Applications (1)

Application Number Title Priority Date Filing Date
CN200580027251A Expired - Fee Related CN100592789C (zh) 2004-08-12 2005-08-09 从视频或音频数据流选择内容

Country Status (6)

Country Link
US (11) US8406607B2 (zh)
EP (1) EP1779659B1 (zh)
JP (1) JP4842944B2 (zh)
KR (1) KR20070046846A (zh)
CN (1) CN100592789C (zh)
WO (1) WO2006018790A1 (zh)

Cited By (13)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
WO2009026803A1 (en) * 2007-08-27 2009-03-05 Yuvad Technologies Co., Ltd. A method for identifying motion video content
WO2009140823A1 (en) * 2008-05-22 2009-11-26 Yuvad Technologies Co., Ltd. A method for identifying motion video/audio content
WO2009140824A1 (en) * 2008-05-22 2009-11-26 Yuvad Technologies Co., Ltd. A system for identifying motion video/audio content
US8370382B2 (en) 2008-05-21 2013-02-05 Ji Zhang Method for facilitating the search of video content
US8488835B2 (en) 2008-05-21 2013-07-16 Yuvad Technologies Co., Ltd. System for extracting a fingerprint data from video/audio signals
US8548192B2 (en) 2008-05-22 2013-10-01 Yuvad Technologies Co., Ltd. Method for extracting a fingerprint data from video/audio signals
US8611701B2 (en) 2008-05-21 2013-12-17 Yuvad Technologies Co., Ltd. System for facilitating the search of video content
CN104093084A (zh) * 2014-06-11 2014-10-08 北京金山网络科技有限公司 一种播放视频的方法及装置
CN105208401A (zh) * 2014-06-24 2015-12-30 广州市动景计算机科技有限公司 一种识别广告视频的方法和装置
CN108702545A (zh) * 2016-02-29 2018-10-23 格雷斯诺特公司 用于检测和响应媒体频道变化的方法和系统
CN110516111A (zh) * 2016-02-29 2019-11-29 格雷斯诺特公司 基于音频指纹的视频多匹配检测和对媒体频道识别消歧
CN110830843A (zh) * 2015-06-12 2020-02-21 尼尔森（美国）有限公司 通过自动内容辨识指纹匹配来检测频道改变
US11243668B2 (en) 2014-03-19 2022-02-08 Tencent Technology (Shenzhen) Company Limited User interactive method and apparatus for controlling presentation of multimedia data on terminals

Families Citing this family (85)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US8205237B2 (en) 2000-09-14 2012-06-19 Cox Ingemar J Identifying works, using a sub-linear time search, such as an approximate nearest neighbor search, for initiating a work-based action, such as an action on the internet
US7519274B2 (en) 2003-12-08 2009-04-14 Divx, Inc. File format for multiple track digital data
US8472792B2 (en) 2003-12-08 2013-06-25 Divx, Llc Multimedia distribution system
WO2006018790A1 (en) 2004-08-12 2006-02-23 Koninklijke Philips Electronics N.V. Selection of content from a stream of video or audio data
KR101135877B1 (ko) * 2004-12-09 2012-04-19 코닌클리케 필립스 일렉트로닉스 엔.브이. 프로그램 재생을 위한 방법 및 장치
JP2007207328A (ja) * 2006-01-31 2007-08-16 Toshiba Corp 情報記憶媒体、プログラム、情報再生方法、情報再生装置、データ転送方法、及びデータ処理方法
US7515710B2 (en) 2006-03-14 2009-04-07 Divx, Inc. Federated digital rights management scheme including trusted systems
EP2039151A1 (en) * 2006-07-06 2009-03-25 Thomson Licensing Method and system for trick mode suppression control
EP2168061A1 (en) * 2007-06-06 2010-03-31 Dolby Laboratories Licensing Corporation Improving audio/video fingerprint search accuracy using multiple search combining
US20090089326A1 (en) * 2007-09-28 2009-04-02 Yahoo!, Inc. Method and apparatus for providing multimedia content optimization
KR20100106327A (ko) 2007-11-16 2010-10-01 디브이엑스, 인크. 멀티미디어 파일을 위한 계층적 및 감소된 인덱스 구조
US8997161B2 (en) 2008-01-02 2015-03-31 Sonic Ip, Inc. Application enhancement tracks
CN102084358A (zh) * 2008-02-05 2011-06-01 杜比实验室特许公司 将信息与媒体内容关联
US8428301B2 (en) 2008-08-22 2013-04-23 Dolby Laboratories Licensing Corporation Content identification and quality monitoring
US10334324B2 (en) 2008-11-26 2019-06-25 Free Stream Media Corp. Relevant advertisement generation based on a user operating a client device communicatively coupled with a networked media device
US10631068B2 (en) 2008-11-26 2020-04-21 Free Stream Media Corp. Content exposure attribution based on renderings of related content across multiple devices
US9961388B2 (en) 2008-11-26 2018-05-01 David Harrison Exposure of public internet protocol addresses in an advertising exchange server to improve relevancy of advertisements
US8180891B1 (en) 2008-11-26 2012-05-15 Free Stream Media Corp. Discovery, access control, and communication with networked services from within a security sandbox
US10977693B2 (en) 2008-11-26 2021-04-13 Free Stream Media Corp. Association of content identifier of audio-visual data with additional data through capture infrastructure
US9986279B2 (en) 2008-11-26 2018-05-29 Free Stream Media Corp. Discovery, access control, and communication with networked services
US10419541B2 (en) 2008-11-26 2019-09-17 Free Stream Media Corp. Remotely control devices over a network without authentication or registration
US10567823B2 (en) 2008-11-26 2020-02-18 Free Stream Media Corp. Relevant advertisement generation based on a user operating a client device communicatively coupled with a networked media device
US9519772B2 (en) 2008-11-26 2016-12-13 Free Stream Media Corp. Relevancy improvement through targeting of information based on data gathered from a networked device associated with a security sandbox of a client device
US10880340B2 (en) 2008-11-26 2020-12-29 Free Stream Media Corp. Relevancy improvement through targeting of information based on data gathered from a networked device associated with a security sandbox of a client device
US9154942B2 (en) 2008-11-26 2015-10-06 Free Stream Media Corp. Zero configuration communication between a browser and a networked media device
WO2010080911A1 (en) 2009-01-07 2010-07-15 Divx, Inc. Singular, collective and automated creation of a media guide for online content
US9015741B2 (en) 2009-04-17 2015-04-21 Gracenote, Inc. Method and system for remotely controlling consumer electronic devices
US8774954B2 (en) * 2009-09-04 2014-07-08 Apple Inc. Processing data supplementary to audio received in a radio buffer
WO2011068668A1 (en) 2009-12-04 2011-06-09 Divx, Llc Elementary bitstream cryptographic material transport systems and methods
US8670648B2 (en) 2010-01-29 2014-03-11 Xos Technologies, Inc. Video processing methods and systems
US20120294586A1 (en) * 2010-11-18 2012-11-22 David John Weaver Controlling time-sensitive content in a time-shifted environment
US8914534B2 (en) 2011-01-05 2014-12-16 Sonic Ip, Inc. Systems and methods for adaptive bitrate streaming of media stored in matroska container files using hypertext transfer protocol
NL2006291C2 (en) * 2011-02-24 2012-08-27 Civolution B V Broadcasting an information signal having special content for triggering an appropriate action in user device.
US8818171B2 (en) 2011-08-30 2014-08-26 Kourosh Soroushian Systems and methods for encoding alternative streams of video for playback on playback devices having predetermined display aspect ratios and network connection maximum data rates
US9955195B2 (en) 2011-08-30 2018-04-24 Divx, Llc Systems and methods for encoding and streaming video encoded using a plurality of maximum bitrate levels
US9467708B2 (en) 2011-08-30 2016-10-11 Sonic Ip, Inc. Selection of resolutions for seamless resolution switching of multimedia content
US8909922B2 (en) 2011-09-01 2014-12-09 Sonic Ip, Inc. Systems and methods for playing back alternative streams of protected content protected using common cryptographic information
US8964977B2 (en) 2011-09-01 2015-02-24 Sonic Ip, Inc. Systems and methods for saving encoded media streamed using adaptive bitrate streaming
KR101412198B1 (ko) * 2011-09-09 2014-07-03 (주)재플 재핑 광고 서비스를 위한 방법 및 시스템
US20130179199A1 (en) 2012-01-06 2013-07-11 Rovi Corp. Systems and methods for granting access to digital content using electronic tickets and ticket tokens
US9197685B2 (en) 2012-06-28 2015-11-24 Sonic Ip, Inc. Systems and methods for fast video startup using trick play streams
US9143812B2 (en) 2012-06-29 2015-09-22 Sonic Ip, Inc. Adaptive streaming of multimedia
US10452715B2 (en) 2012-06-30 2019-10-22 Divx, Llc Systems and methods for compressing geotagged video
EP2875417B1 (en) 2012-07-18 2020-01-01 Verimatrix, Inc. Systems and methods for rapid content switching to provide a linear tv experience using streaming content distribution
US8750675B2 (en) 2012-09-21 2014-06-10 International Business Machines Corporation Accessing and storing original broadcast content
US8997254B2 (en) 2012-09-28 2015-03-31 Sonic Ip, Inc. Systems and methods for fast startup streaming of encrypted multimedia content
US8914836B2 (en) 2012-09-28 2014-12-16 Sonic Ip, Inc. Systems, methods, and computer program products for load adaptive streaming
US9264475B2 (en) 2012-12-31 2016-02-16 Sonic Ip, Inc. Use of objective quality measures of streamed content to reduce streaming bandwidth
US9313510B2 (en) 2012-12-31 2016-04-12 Sonic Ip, Inc. Use of objective quality measures of streamed content to reduce streaming bandwidth
US9191457B2 (en) 2012-12-31 2015-11-17 Sonic Ip, Inc. Systems, methods, and media for controlling delivery of content
US9906785B2 (en) 2013-03-15 2018-02-27 Sonic Ip, Inc. Systems, methods, and media for transcoding video data according to encoding parameters indicated by received metadata
US10397292B2 (en) 2013-03-15 2019-08-27 Divx, Llc Systems, methods, and media for delivery of content
US9344517B2 (en) 2013-03-28 2016-05-17 Sonic Ip, Inc. Downloading and adaptive streaming of multimedia content to a device with cache assist
US9094737B2 (en) 2013-05-30 2015-07-28 Sonic Ip, Inc. Network video streaming with trick play based on separate trick play files
US9247317B2 (en) 2013-05-30 2016-01-26 Sonic Ip, Inc. Content streaming with client device trick play index
US9967305B2 (en) 2013-06-28 2018-05-08 Divx, Llc Systems, methods, and media for streaming media content
US9343112B2 (en) 2013-10-31 2016-05-17 Sonic Ip, Inc. Systems and methods for supplementing content from a server
US9431002B2 (en) 2014-03-04 2016-08-30 Tribune Digital Ventures, Llc Real time popularity based audible content aquisition
US9866878B2 (en) 2014-04-05 2018-01-09 Sonic Ip, Inc. Systems and methods for encoding and playing back video at different frame rates using enhancement layers
US9800576B2 (en) * 2014-10-14 2017-10-24 Audible Magic Corporation Authentication for over the top broadcast streaming using automated content recognition
US9628830B1 (en) 2014-12-22 2017-04-18 Sorenson Media, Inc. Automatic content recognition (ACR) fingerprinting and video encoding
KR102019493B1 (ko) * 2015-02-09 2019-09-06 삼성전자주식회사 디스플레이 장치 및 그 정보 제공 방법
US9418296B1 (en) * 2015-03-17 2016-08-16 Netflix, Inc. Detecting segments of a video program
US9621935B2 (en) * 2015-04-01 2017-04-11 Tribune Broadcasting Company, Llc Using bitrate data to output an alert indicating a functional state of back-up media-broadcast system
US9582244B2 (en) * 2015-04-01 2017-02-28 Tribune Broadcasting Company, Llc Using mute/non-mute transitions to output an alert indicating a functional state of a back-up audio-broadcast system
US9420277B1 (en) 2015-04-01 2016-08-16 Tribune Broadcasting Company, Llc Using scene-change transitions to output an alert indicating a functional state of a back-up video-broadcast system
US9674475B2 (en) 2015-04-01 2017-06-06 Tribune Broadcasting Company, Llc Using closed-captioning data to output an alert indicating a functional state of a back-up video-broadcast system
US9420348B1 (en) * 2015-04-01 2016-08-16 Tribune Broadcasting Company, Llc Using aspect-ratio transitions to output an alert indicating a functional state of a back up video-broadcast system
US9531488B2 (en) 2015-04-01 2016-12-27 Tribune Broadcasting Company, Llc Using single-channel/multi-channel transitions to output an alert indicating a functional state of a back-up audio-broadcast system
US9959343B2 (en) 2016-01-04 2018-05-01 Gracenote, Inc. Generating and distributing a replacement playlist
US10063918B2 (en) 2016-02-29 2018-08-28 Gracenote, Inc. Media channel identification with multi-match detection and disambiguation based on single-match
US10075292B2 (en) 2016-03-30 2018-09-11 Divx, Llc Systems and methods for quick start-up of playback
US10148989B2 (en) 2016-06-15 2018-12-04 Divx, Llc Systems and methods for encoding video content
US20170371963A1 (en) 2016-06-27 2017-12-28 Facebook, Inc. Systems and methods for identifying matching content
US10565980B1 (en) 2016-12-21 2020-02-18 Gracenote Digital Ventures, Llc Audio streaming of text-based articles from newsfeeds
US10419508B1 (en) 2016-12-21 2019-09-17 Gracenote Digital Ventures, Llc Saving media for in-automobile playout
US10019225B1 (en) 2016-12-21 2018-07-10 Gracenote Digital Ventures, Llc Audio streaming based on in-automobile detection
US10498795B2 (en) 2017-02-17 2019-12-03 Divx, Llc Systems and methods for adaptive switching between multiple content delivery networks during adaptive bitrate streaming
US11234060B2 (en) 2017-09-01 2022-01-25 Roku, Inc. Weave streaming content into a linear viewing experience
US11418858B2 (en) 2017-09-01 2022-08-16 Roku, Inc. Interactive content when the secondary content is server stitched
US10123062B1 (en) * 2017-10-06 2018-11-06 Rovi Guides, Inc. Systems and methods for excluding consumed content from a content presentation
US10623800B2 (en) 2018-07-16 2020-04-14 Gracenote, Inc. Dynamic control of fingerprinting rate to facilitate time-accurate revision of media content
US20210032836A1 (en) 2019-07-29 2021-02-04 Great Plains Manufacturing, Inc. Control system for compact utility loader
US11750878B2 (en) 2020-05-29 2023-09-05 The Nielsen Company (Us), Llc Methods and apparatus to identify alternate language versions of media based on signature matching
US11558660B2 (en) 2020-05-29 2023-01-17 The Nielsen Company (Us), Llc Methods and apparatus to reduce false crediting of exposure to video-on-demand media assets

Family Cites Families (33)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US4677466A (en) 1985-07-29 1987-06-30 A. C. Nielsen Company Broadcast program identification method and apparatus
US4739398A (en) 1986-05-02 1988-04-19 Control Data Corporation Method, apparatus and system for recognizing broadcast segments
US4749157A (en) 1986-08-18 1988-06-07 Hughes Aircraft Company Spacecraft accelerometer auto-alignment
FR2608771B1 (fr) 1986-12-18 1989-04-28 Onera (Off Nat Aerospatiale) Dispositif d'etalonnage d'accelerometres ultrasensibles
WO1996027983A1 (en) * 1995-03-07 1996-09-12 Interval Research Corporation System and method for selective recording of information
US7346472B1 (en) 2000-09-07 2008-03-18 Blue Spike, Inc. Method and device for monitoring and analyzing signals
US20030093790A1 (en) * 2000-03-28 2003-05-15 Logan James D. Audio and video program recording, editing and playback systems using metadata
IL119504A (en) * 1996-10-28 2000-09-28 Elop Electrooptics Ind Ltd Audio-visual content verification method and system
US6771316B1 (en) * 1996-11-01 2004-08-03 Jerry Iggulden Method and apparatus for selectively altering a televised video signal in real-time
CA2196930C (en) 1997-02-06 2005-06-21 Nael Hirzalla Video sequence recognition
EP0944256A1 (en) 1998-03-19 1999-09-22 Hitachi Europe Limited Copy protection apparatus and method
IL124595A (en) 1998-05-21 2009-09-01 Yossef Tsuria Anti-piracy system
WO1999066722A1 (en) * 1998-06-17 1999-12-23 Hitachi, Ltd. Broadcasting method and broadcast receiver
IL148018A0 (en) * 1999-08-09 2002-09-12 British Sky Broadcasting Ltd Improvements in receivers for television signals
KR100317303B1 (ko) 2000-01-10 2001-12-22 구자홍 방송 프로그램 녹화 및 재생시 ａ／ｖ와 데이터간 동기화장치
JP4519389B2 (ja) 2000-03-08 2010-08-04 ゼネラル インスツルメント コーポレーション パーソナル多機能レコーダ、並びにそれを実装及び使用する方法
US6820025B2 (en) 2000-10-30 2004-11-16 The United States Of America As Represented By The Secretary Of The Navy Method and apparatus for motion tracking of an articulated rigid body
JP2002152617A (ja) * 2000-11-13 2002-05-24 Fuji Television Network Inc Ｃｍ挿入位置検出方法、及びホームサーバ
US6658423B1 (en) * 2001-01-24 2003-12-02 Google, Inc. Detecting duplicate and near-duplicate files
US7327931B2 (en) 2001-05-22 2008-02-05 Texas Instruments Incorporated Alternate method of showing commercials using personal video recorders
US6609535B2 (en) 2001-07-24 2003-08-26 Henry A. Opperman Reed valve and method of making same
US20030028796A1 (en) * 2001-07-31 2003-02-06 Gracenote, Inc. Multiple step identification of recordings
JP3821362B2 (ja) * 2001-08-20 2006-09-13 日本ビクター株式会社 インデックス情報生成装置、記録再生装置、及びインデックス情報生成方法
EP1309195B1 (en) 2001-10-29 2007-11-14 Humax Co., Ltd. Method for recording a digital broadcast program and time-based playback of a recorded broadcast program and apparatus therefor
US20030126276A1 (en) * 2002-01-02 2003-07-03 Kime Gregory C. Automated content integrity validation for streaming data
JP2003219307A (ja) * 2002-01-18 2003-07-31 Sony Corp 放送受信装置及び自動選局方法
US6766523B2 (en) 2002-05-31 2004-07-20 Microsoft Corporation System and method for identifying and segmenting repeating media objects embedded in a stream
JP2005536794A (ja) * 2002-08-26 2005-12-02 コーニンクレッカ　フィリップス　エレクトロニクス　エヌ　ヴィ コンテンツ識別の方法、装置、及びソフトウエア
US20040240562A1 (en) * 2003-05-28 2004-12-02 Microsoft Corporation Process and system for identifying a position in video using content-based video timelines
WO2005006758A1 (en) * 2003-07-11 2005-01-20 Koninklijke Philips Electronics N.V. Method and device for generating and detecting a fingerprint functioning as a trigger marker in a multimedia signal
WO2006018790A1 (en) 2004-08-12 2006-02-23 Koninklijke Philips Electronics N.V. Selection of content from a stream of video or audio data
US8200067B2 (en) 2006-03-28 2012-06-12 Avid Technology, Inc. Processing of scalable compressed video data formats for nonlinear video editing systems
US8726400B1 (en) * 2012-03-30 2014-05-13 Google Inc. Ex post facto review of claims made against proprietary content in a live data stream

Cited By (26)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
WO2009026803A1 (en) * 2007-08-27 2009-03-05 Yuvad Technologies Co., Ltd. A method for identifying motion video content
US8437555B2 (en) 2007-08-27 2013-05-07 Yuvad Technologies, Inc. Method for identifying motion video content
US8452043B2 (en) 2007-08-27 2013-05-28 Yuvad Technologies Co., Ltd. System for identifying motion video content
US8370382B2 (en) 2008-05-21 2013-02-05 Ji Zhang Method for facilitating the search of video content
US8488835B2 (en) 2008-05-21 2013-07-16 Yuvad Technologies Co., Ltd. System for extracting a fingerprint data from video/audio signals
US8611701B2 (en) 2008-05-21 2013-12-17 Yuvad Technologies Co., Ltd. System for facilitating the search of video content
WO2009140823A1 (en) * 2008-05-22 2009-11-26 Yuvad Technologies Co., Ltd. A method for identifying motion video/audio content
WO2009140824A1 (en) * 2008-05-22 2009-11-26 Yuvad Technologies Co., Ltd. A system for identifying motion video/audio content
US8548192B2 (en) 2008-05-22 2013-10-01 Yuvad Technologies Co., Ltd. Method for extracting a fingerprint data from video/audio signals
US8577077B2 (en) 2008-05-22 2013-11-05 Yuvad Technologies Co., Ltd. System for identifying motion video/audio content
US11243668B2 (en) 2014-03-19 2022-02-08 Tencent Technology (Shenzhen) Company Limited User interactive method and apparatus for controlling presentation of multimedia data on terminals
CN104093084B (zh) * 2014-06-11 2018-03-30 北京猎豹网络科技有限公司 一种播放视频的方法及装置
CN104093084A (zh) * 2014-06-11 2014-10-08 北京金山网络科技有限公司 一种播放视频的方法及装置
CN105208401A (zh) * 2014-06-24 2015-12-30 广州市动景计算机科技有限公司 一种识别广告视频的方法和装置
CN105208401B (zh) * 2014-06-24 2019-08-09 广州市动景计算机科技有限公司 一种识别广告视频的方法和装置
CN110830843A (zh) * 2015-06-12 2020-02-21 尼尔森（美国）有限公司 通过自动内容辨识指纹匹配来检测频道改变
CN110830843B (zh) * 2015-06-12 2022-01-04 六科股份有限公司 用于识别媒体的系统和方法
CN108713321B (zh) * 2016-02-29 2019-06-11 格雷斯诺特公司 利用多匹配检测和基于广播时间的消歧的媒体频道识别
CN110516111A (zh) * 2016-02-29 2019-11-29 格雷斯诺特公司 基于音频指纹的视频多匹配检测和对媒体频道识别消歧
CN110891186A (zh) * 2016-02-29 2020-03-17 格雷斯诺特公司 媒体呈现设备
CN111954026A (zh) * 2016-02-29 2020-11-17 格雷斯诺特公司 利用基于参考流比较的多匹配检测的媒体频道识别和动作
CN108702545B (zh) * 2016-02-29 2020-12-25 格雷斯诺特公司 用于检测和响应媒体频道变化的方法和系统
CN108713321A (zh) * 2016-02-29 2018-10-26 格雷斯诺特公司 利用视频多匹配检测和基于广播时间的消歧的媒体频道识别
CN108702545A (zh) * 2016-02-29 2018-10-23 格雷斯诺特公司 用于检测和响应媒体频道变化的方法和系统
US11617009B2 (en) 2016-02-29 2023-03-28 Roku, Inc. Media channel identification and action with multi-match detection and disambiguation based on matching with differential reference-fingerprint feature
CN111954026B (zh) * 2016-02-29 2024-03-01 六科股份有限公司 利用基于参考流比较的多匹配检测的媒体频道识别和动作

Also Published As

Publication number Publication date
US20200145731A1 (en) 2020-05-07
US20090226148A1 (en) 2009-09-10
EP1779659B1 (en) 2020-10-07
US9414008B2 (en) 2016-08-09
US9986306B2 (en) 2018-05-29
US20200145732A1 (en) 2020-05-07
US8406607B2 (en) 2013-03-26
EP1779659A1 (en) 2007-05-02
US20180316986A1 (en) 2018-11-01
US9794644B2 (en) 2017-10-17
US20180014088A1 (en) 2018-01-11
US9736549B2 (en) 2017-08-15
CN100592789C (zh) 2010-02-24
KR20070046846A (ko) 2007-05-03
US20130302011A1 (en) 2013-11-14
US20160323533A1 (en) 2016-11-03
JP4842944B2 (ja) 2011-12-21
US11617018B2 (en) 2023-03-28
US20220385993A1 (en) 2022-12-01
US9143718B2 (en) 2015-09-22
JP2008510345A (ja) 2008-04-03
US20150304597A1 (en) 2015-10-22
WO2006018790A1 (en) 2006-02-23
US11368764B2 (en) 2022-06-21
US20170026716A1 (en) 2017-01-26
US10555052B2 (en) 2020-02-04
US10945049B2 (en) 2021-03-09
US20210195301A1 (en) 2021-06-24
US10924816B2 (en) 2021-02-16

Similar Documents

Publication Publication Date Title
CN100592789C (zh) 从视频或音频数据流选择内容
US10313714B2 (en) Audiovisual content presentation dependent on metadata
EP1227674A1 (en) Television program broadcasting method, television receiver, and medium
US20060107301A1 (en) Video recorder unit and method of operation therefor
EP2773108B1 (en) Reception device, reception method, program, and information processing system
JP5076892B2 (ja) 同一シーン検出装置およびプログラムを格納した記憶媒体
CN101069425A (zh) 定制广告
CN101127848A (zh) 广播节目预约设备、广播节目预约方法及其节目
CN101438582A (zh) 用于记录以及延时再现节目的装置和方法
JP2005204233A (ja) デジタル放送受信装置、デジタル放送送信装置、受信方法、プログラム、記録媒体および録画再生装置
JP2007048379A (ja) プログラムの再生方法
JP2006311278A (ja) 受信装置
JP2005354148A (ja) 記録装置
JP2008118197A (ja) 裏番組を自動録画可能な録画システム
KR19980011109U (ko) 브이씨알(vcr)의 방송정보 안내장치

Legal Events

Date Code Title Description
C06 Publication
PB01 Publication
C10 Entry into substantive examination
SE01 Entry into force of request for substantive examination
C14 Grant of patent or utility model
GR01 Patent grant
C17 Cessation of patent right
CF01 Termination of patent right due to non-payment of annual fee

Granted publication date: 20100224

Termination date: 20130809