CN1663277A - Robust method for achieving audio/video synchronization in MPEG decoders in personal video recording applications - Google Patents
Robust method for achieving audio/video synchronization in MPEG decoders in personal video recording applications Download PDFInfo
- Publication number
- CN1663277A CN1663277A CN038149400A CN03814940A CN1663277A CN 1663277 A CN1663277 A CN 1663277A CN 038149400 A CN038149400 A CN 038149400A CN 03814940 A CN03814940 A CN 03814940A CN 1663277 A CN1663277 A CN 1663277A
- Authority
- CN
- China
- Prior art keywords
- video
- stream
- frequency
- audio
- time
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Granted
Links
Images
Classifications
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N7/00—Television systems
- H04N7/24—Systems for the transmission of television signals using pulse code modulation
- H04N7/52—Systems for transmission of a pulse code modulated video signal with one or more other pulse code modulated signals, e.g. an audio signal or a synchronizing signal
- H04N7/54—Systems for transmission of a pulse code modulated video signal with one or more other pulse code modulated signals, e.g. an audio signal or a synchronizing signal the signals being synchronous
- H04N7/56—Synchronising systems therefor
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
- H04N21/40—Client devices specifically adapted for the reception of or interaction with content, e.g. set-top-box [STB]; Operations thereof
- H04N21/41—Structure of client; Structure of client peripherals
- H04N21/414—Specialised client platforms, e.g. receiver in car or embedded in a mobile appliance
- H04N21/4147—PVR [Personal Video Recorder]
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
- H04N21/40—Client devices specifically adapted for the reception of or interaction with content, e.g. set-top-box [STB]; Operations thereof
- H04N21/41—Structure of client; Structure of client peripherals
- H04N21/426—Internal components of the client ; Characteristics thereof
- H04N21/42661—Internal components of the client ; Characteristics thereof for reading from or writing on a magnetic storage medium, e.g. hard disk drive
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
- H04N21/40—Client devices specifically adapted for the reception of or interaction with content, e.g. set-top-box [STB]; Operations thereof
- H04N21/43—Processing of content or additional data, e.g. demultiplexing additional data from a digital video stream; Elementary client operations, e.g. monitoring of home network or synchronising decoder's clock; Client middleware
- H04N21/4302—Content synchronisation processes, e.g. decoder synchronisation
- H04N21/4305—Synchronising client clock from received content stream, e.g. locking decoder clock with encoder clock, extraction of the PCR packets
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
- H04N21/40—Client devices specifically adapted for the reception of or interaction with content, e.g. set-top-box [STB]; Operations thereof
- H04N21/43—Processing of content or additional data, e.g. demultiplexing additional data from a digital video stream; Elementary client operations, e.g. monitoring of home network or synchronising decoder's clock; Client middleware
- H04N21/4302—Content synchronisation processes, e.g. decoder synchronisation
- H04N21/4307—Synchronising the rendering of multiple content streams or additional data on devices, e.g. synchronisation of audio on a mobile phone with the video output on the TV screen
- H04N21/43072—Synchronising the rendering of multiple content streams or additional data on devices, e.g. synchronisation of audio on a mobile phone with the video output on the TV screen of multiple content streams on the same device
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
- H04N21/40—Client devices specifically adapted for the reception of or interaction with content, e.g. set-top-box [STB]; Operations thereof
- H04N21/43—Processing of content or additional data, e.g. demultiplexing additional data from a digital video stream; Elementary client operations, e.g. monitoring of home network or synchronising decoder's clock; Client middleware
- H04N21/432—Content retrieval operation from a local storage medium, e.g. hard-disk
- H04N21/4325—Content retrieval operation from a local storage medium, e.g. hard-disk by playing back content from the storage medium
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
- H04N21/40—Client devices specifically adapted for the reception of or interaction with content, e.g. set-top-box [STB]; Operations thereof
- H04N21/43—Processing of content or additional data, e.g. demultiplexing additional data from a digital video stream; Elementary client operations, e.g. monitoring of home network or synchronising decoder's clock; Client middleware
- H04N21/434—Disassembling of a multiplex stream, e.g. demultiplexing audio and video streams, extraction of additional data from a video stream; Remultiplexing of multiplex streams; Extraction or processing of SI; Disassembling of packetised elementary stream
- H04N21/4343—Extraction or processing of packetized elementary streams [PES]
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
- H04N21/40—Client devices specifically adapted for the reception of or interaction with content, e.g. set-top-box [STB]; Operations thereof
- H04N21/43—Processing of content or additional data, e.g. demultiplexing additional data from a digital video stream; Elementary client operations, e.g. monitoring of home network or synchronising decoder's clock; Client middleware
- H04N21/438—Interfacing the downstream path of the transmission network originating from a server, e.g. retrieving encoded video stream packets from an IP network
- H04N21/4385—Multiplex stream processing, e.g. multiplex stream decrypting
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
- H04N21/40—Client devices specifically adapted for the reception of or interaction with content, e.g. set-top-box [STB]; Operations thereof
- H04N21/43—Processing of content or additional data, e.g. demultiplexing additional data from a digital video stream; Elementary client operations, e.g. monitoring of home network or synchronising decoder's clock; Client middleware
- H04N21/438—Interfacing the downstream path of the transmission network originating from a server, e.g. retrieving encoded video stream packets from an IP network
- H04N21/4385—Multiplex stream processing, e.g. multiplex stream decrypting
- H04N21/43853—Multiplex stream processing, e.g. multiplex stream decrypting involving multiplex stream decryption
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
- H04N21/40—Client devices specifically adapted for the reception of or interaction with content, e.g. set-top-box [STB]; Operations thereof
- H04N21/43—Processing of content or additional data, e.g. demultiplexing additional data from a digital video stream; Elementary client operations, e.g. monitoring of home network or synchronising decoder's clock; Client middleware
- H04N21/44—Processing of video elementary streams, e.g. splicing a video clip retrieved from local storage with an incoming video stream or rendering scenes according to encoded video stream scene graphs
- H04N21/4405—Processing of video elementary streams, e.g. splicing a video clip retrieved from local storage with an incoming video stream or rendering scenes according to encoded video stream scene graphs involving video stream decryption
Landscapes
- Engineering & Computer Science (AREA)
- Multimedia (AREA)
- Signal Processing (AREA)
- Theoretical Computer Science (AREA)
- Databases & Information Systems (AREA)
- Television Signal Processing For Recording (AREA)
- Two-Way Televisions, Distribution Of Moving Picture Or The Like (AREA)
- Compression Or Coding Systems Of Tv Signals (AREA)
- Indexing, Searching, Synchronizing, And The Amount Of Synchronization Travel Of Record Carriers (AREA)
- Signal Processing For Digital Recording And Reproducing (AREA)
Abstract
Description
本发明涉及广播流的记录和回放领域;尤其涉及用于在视频记录环境中使来自广播流的视频和音频的解码与表示相同步的设备和方法。The present invention relates to the field of recording and playback of broadcast streams; in particular, an apparatus and method for synchronizing the decoding and presentation of video and audio from broadcast streams in a video recording environment.
这个应用涉及共同未决申请的共同发明人和主题,所述共同未决申请的标题为″Robust Method For Recovering A Program Time BaseIn MPEG-2 Transport Streams And Achieving Audio/VideoSynchronization″(用于恢复MPEG-2中的程序时基和用于实现音频/视频同步的鲁棒方法),S/N 09/967,877,其在此被完全并入以供参考。This application relates to the co-inventors and subject matter of a co-pending application entitled "Robust Method For Recovering A Program Time BaseIn MPEG-2 Transport Streams And Achieving Audio/Video Synchronization" (for recovering MPEG-2 Procedural Timebase and a Robust Method for Implementing Audio/Video Synchronization), S/N 09/967,877, which is hereby fully incorporated by reference.
活动图像专家组阶段2(MPEG-2)标准是一种在各种各样的音频/视频分配系统中采用的数字音频/视频(A/V)压缩标准,该分发系统包括例如数字卫星系统(DSS)广播。MPEG-2传送标准,ISO 13818-1,需要广播装置在多路复用的音频与视频分组流内以周期时隙发射程序时钟参考(PCR)时间标记。这个程序时钟参考时间标记被称为DSS程序流中的系统时钟参考(SCR),其带有与产生广播流的MPEG-2编码器内的一个或多个系统时间时钟(STC)的严格关系,因此它可以被用来在解码设备中复制编码器的系统时间时钟。另外,每个被多路复用到MPEG-2广播流中的音频与视频分组都包括解码时间标记(DTS)和表示时间标记(PTS),其相对于程序时钟参考识别时间,分组必须在这两个标记处由解码设备分别解码和表示以用于显示。The Moving Picture Experts Group Phase 2 (MPEG-2) standard is a digital audio/video (A/V) compression standard used in a variety of audio/video distribution systems, including, for example, digital satellite systems ( DSS) broadcast. The MPEG-2 transport standard, ISO 13818-1, requires broadcasters to transmit Program Clock Reference (PCR) time stamps in periodic slots within a multiplexed stream of audio and video packets. This program clock reference time stamp is called the system clock reference (SCR) in the DSS program stream, which carries a strict relationship to one or more system time clocks (STC) within the MPEG-2 encoder producing the broadcast stream, Therefore it can be used to replicate the encoder's system time clock in the decoding device. In addition, each audio and video packet multiplexed into an MPEG-2 broadcast stream includes a decoding time stamp (DTS) and a presentation time stamp (PTS), which identify the time relative to the program clock reference at which the packet must The two markers are respectively decoded and represented by the decoding device for display.
个人视频记录(PVR)的执行过程包括在存储介质上存储广播程序然后播放它们。如果程序完全被存储为MPEG-2流并且通过以原始广播比特速率注入以便回放,则定时信息被保持以允许被延迟的程序使用与实况广播相同的音频/视频同步机构。MPEG-2流的全部存储需要过多数量的存储器,然而,如果MPEG-2流通过丢弃程序被改变或压缩或者如果程序通过丢弃子信道被改变或压缩,则减少了存储器需求但是丢失PCR到达的关键性定时。仅仅存储音频基本流(AES)和视频基本流(VES)也减少了存储器需求却又造成了PCR到达时间的损失。在回放过程中,PCR到达时间的丢失造成了严重的音频/视频同步问题,表现为音频/视频表示中的噪声、中断或暂停现象。The implementation of Personal Video Recording (PVR) involves storing broadcast programs on a storage medium and then playing them. If the program is stored entirely as an MPEG-2 stream and injected for playback at the original broadcast bit rate, timing information is maintained to allow the delayed program to use the same audio/video synchronization mechanism as the live broadcast. The full storage of the MPEG-2 stream requires an excessive amount of memory, however, if the MPEG-2 stream is altered or compressed by dropping the procedure or if the program is altered or compressed by dropping sub-channels, the memory requirement is reduced but the PCRs arrive at critical timing. Storing only the audio elementary stream (AES) and video elementary stream (VES) also reduces memory requirements at the expense of PCR arrival time. During playback, the loss of PCR arrival times causes serious audio/video synchronization problems, manifested as noise, interruptions, or pauses in the audio/video representation.
本发明的第一方面是一种接收机,用于接收MPEG加密的传送流和输出音频与视频信号,包括:适合于接收被加密的传送流的解密器,以解密被加密的传送流和输出被解密的传送流;解多路复用器,适合于接收被解密的传送流,适合于将被解密的传送流转换为音频基本流和视频基本流,并适合于改变音频基本流和视频基本流的每个分组的每个报头的表示时间标记和解码时间标记字段中的值,以匹配接收机记录时钟的时间,并适合于输出音频基本流和视频基本流;存储子系统,适合于接收和存储音频基本流和视频基本流,并适合于改变音频基本流和视频基本流的每个分组的每个报头的表示时间标记和解码时间标记字段中的值,以补偿音频基本流和视频基本流被存储在存储子系统中的时间量;音频解码器,适合于接收和解码音频基本流并适合于输出音频信号;和视频解码器,适合于接收和解码视频基本流并适合于输出视频信号。A first aspect of the present invention is a receiver for receiving an MPEG encrypted transport stream and outputting audio and video signals, comprising: a decryptor adapted to receive the encrypted transport stream, to decrypt the encrypted transport stream and output A decrypted transport stream; a demultiplexer adapted to receive the decrypted transport stream, to convert the decrypted transport stream into an audio elementary stream and a video elementary stream, and to change the audio elementary stream and the video elementary stream The value in the Representation Timestamp and Decoding Timestamp fields of each header of each packet of the stream to match the time of the receiver's recording clock and suitable for outputting audio elementary streams and video elementary streams; the storage subsystem, suitable for receiving and stores audio elementary streams and video elementary streams, and is adapted to vary the values in the presentation time stamp and decoding time stamp fields of each header of each packet of the audio elementary streams and video elementary streams to compensate for the the amount of time the stream is stored in the storage subsystem; an audio decoder adapted to receive and decode an audio elementary stream and adapted to output an audio signal; and a video decoder adapted to receive and decode a video elementary stream and adapted to output a video signal .
本发明的第二方面是一种接收机,用于接收MPEG加密的传送流并输出音频与视频信号,包括:适合于接收被加密的传送流的解密器,解密被加密的传送流和输出被解密的传送流;选择器,适合于接收被解密的传送流,适合于选择与一个或多个程序相关的分组,并适合于建立只包括与一个或多个程序相关的分组的部分传送,适合于基于接收机记录时钟向部分传送流中的每个分组添加时间标记,以及适合于输出部分传送流;存储子系统,适合于接收和存储部分传送流;解多路复用器,适合于接收部分传送流,适合于将部分传送流转换为音频基本流和视频基本流,适合于改变音频基本流和视频基本流的每个分组的每个报头的表示时间标记和解码时间标记字段中的值,以补偿部分传送流被存储在存储子系统中的时间量;音频解码器,适合于接收和解码音频基本流并输出音频信号;和视频解码器,适合于接收和解码视频基本流并输出视频信号。A second aspect of the present invention is a receiver for receiving an MPEG encrypted transport stream and outputting audio and video signals, comprising: a decryptor adapted to receive the encrypted transport stream, decrypt the encrypted transport stream and output the encrypted Decrypted transport stream; selector, adapted to receive a decrypted transport stream, adapted to select packets associated with one or more procedures, and adapted to create a partial transport including only packets associated with one or more procedures, suitable for suitable for adding time stamps to each packet in a partial transport stream based on the receiver recording clock, and suitable for outputting the partial transport stream; a storage subsystem, suitable for receiving and storing the partial transport stream; a demultiplexer, suitable for receiving Partial transport streams, suitable for converting partial transport streams into audio elementary streams and video elementary streams, suitable for changing the values in the presentation time stamp and decoding time stamp fields of each header of each packet of audio elementary streams and video elementary streams , to compensate for the amount of time a portion of the transport stream is stored in the storage subsystem; an audio decoder, adapted to receive and decode an audio elementary stream and output an audio signal; and a video decoder, adapted to receive and decode a video elementary stream and output a video Signal.
本发明的第三方面是一种方法,用于使MPEG解码器中的音频与视频同步,该方法包括:解密传送流;解多路复用传送流;在传送流中从与程序相关的第一分组的报头中提取第一程序时钟参考字段的值;将传送流解多路复用为音频基本流和视频基本流;将当前时间与被解密传送流中分组报头中的第一程序时钟参考字段值之间的差值添加到与将被存储的程序相关的音频和视频基本流中每个分组的每个报头的每个表示时间标记字段和每个解码时间标记字段中,其中被解密传送流中的分组与将被存储的程序相关;存储音频和视频基本流;将音频和视频基本流被存储的时间与从存储器中读出音频和视频基本流的播放时间之间的差值添加到音频和视频基本流中每个分组的每个报头的每个表示时间标记字段和每个解码时间标记字段;解码音频和视频基本流。A third aspect of the present invention is a method for synchronizing audio and video in an MPEG decoder, the method comprising: decrypting a transport stream; demultiplexing the transport stream; Extract the value of the first program clock reference field in the header of a packet; demultiplex the transport stream into an audio elementary stream and a video elementary stream; compare the current time with the first program clock reference in the packet header of the decrypted transport stream The difference between the field values is added to each Presentation Time Stamp field and each Decoding Time Stamp field of each header of each packet in the audio and video elementary streams associated with the program to be stored, where the decrypted transmission The packets in the stream are associated with the program to be stored; the audio and video elementary streams are stored; the difference between the time when the audio and video elementary streams are stored and the playback time when the audio and video elementary streams are read from memory is added to Each presentation time stamp field and each decoding time stamp field of each header of each packet in the audio and video elementary streams; decoding the audio and video elementary streams.
本发明的第四方面是一种方法,用于使MPEG解码器中的音频与视频同步,包括:解密传送流;选择与一个或多个程序相关的分组并且建立只包括与该一个或多个程序相关的分组的部分传送流;将基于当前记录时间的时间标记添加到部分传送流中每个分组的每个报头;存储部分传送流;读取部分传送流;将部分传送流解多路复用为音频基本流和视频基本流;将被解密传送流中分组报头中的第一程序时钟参考字段值与当前时间之间的差值添加到音频和视频基本流中每个分组的每个报头的每个表示时间标记字段和每个解码时间标记,其中被解密传送流中的分组与将被存储的程序相关;解码音频和视频基本流。A fourth aspect of the present invention is a method for synchronizing audio and video in an MPEG decoder comprising: decrypting a transport stream; selecting packets associated with one or more programs and establishing Partial Transport Stream of program-dependent packets; adds a timestamp based on the current recording time to each header of each packet in the partial transport stream; stores the partial transport stream; reads the partial transport stream; demultiplexes the partial transport stream For audio elementary streams and video elementary streams; add the difference between the value of the first program clock reference field in the header of the packet in the decrypted transport stream and the current time to each header of each packet in the audio and video elementary streams Each represents a time stamp field and each decodes a time stamp where packets in the decrypted transport stream are associated with programs to be stored; decodes audio and video elementary streams.
本发明的特征在所附的权利要求中提出。然而,参考说明性实施例的以下详细说明并结合附图,将很好地理解本发明本身,其中:The characteristics of the invention are set out in the appended claims. However, the invention itself will be best understood by reference to the following detailed description of illustrative embodiments, taken in conjunction with the accompanying drawings, in which:
图1是根据本发明第一实施例的接收机的示意图;FIG. 1 is a schematic diagram of a receiver according to a first embodiment of the present invention;
图2是根据本发明第二实施例的接收机的示意图;FIG. 2 is a schematic diagram of a receiver according to a second embodiment of the present invention;
图3是说明记录期间根据本发明修改的接收机回放和记录STC和PTS的关系曲线;和Figure 3 is a graph illustrating the relationship between playback and recording STC and PTS of a receiver modified in accordance with the present invention during recording; and
图4是说明在特技到普通播放期间接收机回放和记录STC、原始PTS和根据本发明修改的PTS的关系曲线。Fig. 4 is a graph illustrating the relationship between receiver playback and recording of STC, original PTS and modified PTS according to the present invention during trick-to-normal play.
对于本发明的目的,应当理解,除非另作说明,否则术语传送流(TS)指的是MPEG TS,术语程序流(PS)指的是MPEG PS,术语分组的基本流(PES)指的是MPEG PES。术语MPEG表示MPEG-1、MPEG-2、MPEG-4、MPEG-7和其它具有相同或类似的MPEG-2流、分组和字段结构的MPEG标准格式。术语MPEG还表示DDS流,其中的流、分组和字段结构与MPEG-2的流、分组和字段结构相同或类似,但是具有不同的名称。For the purposes of the present invention, it is understood that, unless otherwise specified, the term transport stream (TS) refers to the MPEG TS, the term program stream (PS) refers to the MPEG PS, and the term packetized elementary stream (PES) refers to the MPEG PES. The term MPEG denotes MPEG-1, MPEG-2, MPEG-4, MPEG-7 and other MPEG standard formats having the same or similar MPEG-2 stream, packet and field structures. The term MPEG also denotes a DDS stream, in which the stream, packet and field structure is the same or similar to that of MPEG-2, but has a different name.
图1是根据本发明第一实施例的接收机的示意图;在图1中,接收机100包括解密器105、解多路复用器110、存储子系统115、音频解码器与表示器120、视频解码器与表示器125、时钟振荡器电路130、记录STC 135、播放STC 140和频率调整电路145。存储子系统115包括写入控制器150、存储介质155和读取控制器160。FIG. 1 is a schematic diagram of a receiver according to a first embodiment of the present invention; in FIG. 1 , the receiver 100 includes a descrambler 105, a demultiplexer 110, a storage subsystem 115, an audio decoder and presenter 120, Video decoder and display 125, clock oscillator circuit 130, recording STC 135, playback STC 140 and frequency adjustment circuit 145. Storage subsystem 115 includes write controller 150 , storage medium 155 and read controller 160 .
在操作中,被加密的传送流(TS)165由解密器105接收并且解密器105输出被解密的传送流170,其由解多路复用器110以广播被加密的传送流165的速率接收。PLL电路130产生固定频率信号175,其被发送到记录STC 135以及频率调整器145。由记录STC 135产生的记录时钟信号180被解多路复用器110和写入控制器150接收。解多路复用器110提取被解密的传送流的第一报头中第一PCR字段的值并且计算编码器系统时间时钟频率(时钟用于在程序流的SCR字段中建立原始值和在传送流的PCR字段中建立原始值)与记录STC 135的频率之间的X偏移。这个操作可以表示为X轴偏移=第一PCR-记录STC。In operation, an encrypted transport stream (TS) 165 is received by decryptor 105 and decryptor 105 outputs a decrypted transport stream 170, which is received by demultiplexer 110 at the rate at which encrypted transport stream 165 is broadcast . PLL circuit 130 generates fixed frequency signal 175 which is sent to recording STC 135 and frequency adjuster 145. The recording clock signal 180 generated by the recording STC 135 is received by the demultiplexer 110 and the write controller 150. The demultiplexer 110 extracts the value of the first PCR field in the first header of the decrypted transport stream and calculates the encoder system time clock frequency (the clock used to establish the original value in the SCR field of the program stream and in the transport stream The X offset between the original value established in the PCR field of ) and the frequency of the recorded STC 135. This operation can be expressed as X-axis offset=first PCR-record STC.
解多路复用110把被解密的传送流170转换成音频基本流(AES)185和视频基本流(VES)190。AES 185和VES 190是PES格式。被解密的传送流170还可以被分解成除了音频与视频之外的其它流,例如图文电视。这些其它流将被同等地视为AES 185和VES 190。解多路复用器110把X偏移添加到一个或多个原始PTS字段值PTS,以在AES 185和VES 190的PTS字段中建立新的值PTS1并写入PTS1。解多路复用器110还把X偏移添加到一个或多个原始DTS字段值DTS,以在AES 185和VES 190的一个或多个DTS字段中建立新的值DTS1并写入DTS1。这两个操作可以表示为PTS1=PTS+X偏移和DTS1=DTS+X偏移。AES 185和VES 190以及记录STC频率信号195被发送给存储子系统150的写入控制器150。当计算X偏移时,记录STC频率信号195携带记录STC 135的频率值。Demultiplexing 110 converts the decrypted transport stream 170 into an audio elementary stream (AES) 185 and a video elementary stream (VES) 190 . AES 185 and VES 190 are PES formats. The decrypted transport stream 170 can also be decomposed into other streams besides audio and video, such as teletext. These other streams will be treated equally as AES 185 and VES 190. Demultiplexer 110 adds an X offset to one or more original PTS field values PTS to create a new value PTS1 in the PTS field of AES 185 and VES 190 and writes PTS1. Demultiplexer 110 also adds an X offset to one or more original DTS field values DTS to create a new value DTS1 in one or more DTS fields of AES 185 and VES 190 and writes DTS1. These two operations can be expressed as PTS1 = PTS + X offset and DTS1 = DTS + X offset. AES 185 and VES 190 and recording STC frequency signal 195 are sent to write controller 150 of storage subsystem 150. Record STC frequency signal 195 carries the frequency value of record STC 135 when calculating the X offset.
写入控制器150交织所有涉及与单一分段相同时间的基本流信息(AES 185、VES 190、频率信号195)并且将该分段存储在存储介质155上。Write controller 150 interleaves all elementary stream information (AES 185, VES 190, frequency signal 195) related to the same time as a single segment and stores the segment on storage medium 155.
接收机100可以用两种模式播放程序,实况播放模式或者延迟播放或时移记录(TSR)模式。在实况播放模式中不存储程序。在实况播放模式中,如虚线部分所示,接收机100将AES 185“热线连接(hotwire)”到音频解码器与表示器120,并且将VES 190“热线连接”到视频解码器与表示器125。视频解码器与表示器125充当“主机”,并且基于记录STC 135的时间以及AES 185和VES 190的PTS字段(包括值PST1)和DTS字段(包括值DTS1),从解多路复用器110拉取分段。The receiver 100 can play programs in two modes, a live playback mode or a delayed playback or time-shifted recording (TSR) mode. Programs are not stored in live playback mode. In live playback mode, the receiver 100 "hotwires" the AES 185 to the audio decoder and presenter 120, and the VES 190 to the video decoder and presenter 125, as indicated by the dotted lines . The Video Decoder and Presenter 125 acts as a "host" and, based on the time of recording the STC 135 and the PTS field (including the value PST1 ) and DTS field (including the value DTS1 ) of the AES 185 and VES 190, receives data from the demultiplexer 110 Pull segments.
在延迟播放模式中存储程序,并且在存储子系统115的控制之下回放该程序。对于延迟回放模式而言,存储于系统115的读取控制器160将所存储的频率信号195读取并发送到频率调整器145,频率调整器145调整固定频率信号175来匹配所存储的频率信号195并且输出被调整的固定频率信号196。经过调整的固定频率信号196由播放STC 140接收,播放STC 140将播放时钟信号197发送到音频解码器与表示器120、视频解码器与表示器125以及读取控制器160。从而,当解多路复用该程序时,播放STC 140的运行频率与记录STC 135的运行频率相同。The program is stored in delayed play mode and played back under the control of the storage subsystem 115 . For the delayed playback mode, the read controller 160 stored in the system 115 reads and sends the stored frequency signal 195 to the frequency adjuster 145, which adjusts the fixed frequency signal 175 to match the stored frequency signal 195 and output the adjusted fixed frequency signal 196. Adjusted fixed frequency signal 196 is received by playback STC 140 which sends playback clock signal 197 to audio decoder and display 120, video decoder and display 125, and readout controller 160. Thus, when the program is demultiplexed, the playback STC 140 operates at the same frequency as the recording STC 135.
对于延迟回放模式而言,读取控制器160计算存储偏移(S偏移),即根据播放STC 140的暂停时间(TP)和根据播放STC的继续时间(TR)的差值。这些操作可以表示为S偏移=TR-TP。读取控制器160把S偏移添加到一个或多个当前PTS字段值PTS1,以在AES 185和VES 190的该PTS字段中建立新的值PTS2并写入PTS2。读取控制器160还把S偏移添加到一个或多个当前DTS字段值DTS1,以在AES 185和VES 190的该DTS字段中建立新的值DTS2并写入DTS2。这两个操作可以表示为PTS2=PTS1+S偏移和DTS2=DTS1+S偏移。视频解码器与表示器125充当“主机”并且从存储子系统115中以存储子系统表示的速率来拉取分段。For the delayed playback mode, the read controller 160 calculates the storage offset (S offset), which is the difference between the pause time (TP) according to the play STC 140 and the resume time (TR) according to the play STC. These operations can be expressed as S offset = TR - TP. Read controller 160 adds the S offset to one or more current PTS field values PTS1 to create a new value PTS2 in that PTS field for AES 185 and VES 190 and writes PTS2. Read controller 160 also adds an S offset to one or more current DTS field values DTS1 to create a new value DTS2 in that DTS field for AES 185 and VES 190 and writes DTS2. These two operations can be expressed as PTS2 = PTS1 + S offset and DTS2 = DTS1 + S offset. Video decoder and presenter 125 acts as a "host" and pulls segments from storage subsystem 115 at the rate represented by the storage subsystem.
图2是根据本发明第二实施例的接收机的示意图;在图2中,接收机200包括解密器205、基于分组标识符(PID)的传送分组选择器210(此后称为选择器210)、存储子系统215、解多路复用器217、音频解码器与表示器220、视频解码器与表示器225、时钟振荡器电路230、自激时钟235、播放STC 240和频率调整电路245。存储子系统215包括写入控制器250、存储介质255和读取控制器260。读取控制器260包括可选注入器(injector)262。注入器262可以是硬件或软件的注入器。FIG. 2 is a schematic diagram of a receiver according to a second embodiment of the present invention; in FIG. 2, the
在操作中,加密的传送流265被解密器205接收,并且解密器205输出被解密的传送流270,被解密的传送流270被选择器210以广播被加密的传送流265的速率接收。PLL电路230产生固定频率信号275,其被发送给时钟235以及频率调整器245。由时钟235产生的时钟信号280被选择器210和写入控制器250接收。选择器210基于所选择的一个或多个程序从被解密的传送流270中提取分组。基于被解密的传送流中每个分组报头的PID字段中对应于所选程序的值进行选择。选择器210在每个所选分组的开头添加四个字节的时间标记以产生部分传送流282,部分传送流282被存储器子系统215的写入控制器250接收。写入控制器250把部分传送流放置到存储介质255中。In operation, encrypted
接收机200可以用两种模式播放程序,实况播放模式或者延迟播放或TSR模式。在实况播放状态中,如虚线所示,不存储程序并且接收机200将选择器210 “热线连接”到解多路复用器217并且把S偏移(在下描述)设置到零。The
在延迟播放模式中,将程序存储在存储器子系统215中。对于延迟播放模式而言,解多路复用器217执行现在描述的几个操作。所述操作的次序不一定是执行这些操作时的次序。In delayed play mode, the program is stored in
从存储器子系统215向解多路复用器217发送部分传送流282有两种选项。在第一种或”推入”选项中,注入器262读取四个字节的时间标记并且在恰当的时间将每个分组“注入”到解多路复用器217中。在推入选项中,当接收到分组时,解多路复用器217从每个分组中除去四个字节的时间标记。在第二种或”拉取”选项中,不使用注入器262(或不存在),并且当解多路复用器217接收时,其读取并从每个分组中除去四个字节的时间标记。视频解码器与表示器225基于VES的消耗来”拉取”视频。当视频解码器与表示器225的缓冲区(未示出)中的VES数据量低于阈值时,视频解码器与表示器从解多路复用器217”拉取”更多的数据。There are two options for sending the
解多路复用器217计算存储偏移(S偏移),即部分传送流282的第一报头中第一PCR字段的值与当前播放STC 240时间之间的差。这个操作可以表示为S偏移=第一PCR-播放STC。The demultiplexer 217 calculates the storage offset (S offset), ie the difference between the value of the first PCR field in the first header of the
解多路复用器217把被解密的部分传送流282转换成AES流和VES流。AES和VES流是PES格式。被解密的部分传送流282还可以被分解成除了音频与视频之外的其它流,例如图文电视。The demultiplexer 217 converts the decrypted
对于AES和VES中的每个PES而言,解多路复用器217将S偏移添加到当前的一个或多个PTS字段值PTS,以建立新数值PTS3并且把PTS3写入AES和VES的一个或多个PTS字段。对于AES和VES中的每个PES而言,解多路复用器217将S偏移添加到当前的一个或多个DTS字段值DTS,以建立新的DTS值DTS3并且把DTS3写入AES和VES的一个或多个PTS字段。这两个操作可以表示为PTS3=PTS+S偏移和DTS3=DTS+S偏移。For each PES in AES and VES, the demultiplexer 217 adds the S offset to the current one or more PTS field values PTS to create a new value PTS3 and writes PTS3 to the PTS of AES and VES. One or more PTS fields. For each PES in AES and VES, the demultiplexer 217 adds the S offset to the current one or more DTS field values DTS to create a new DTS value DTS3 and writes DTS3 into the AES and VES One or more PTS fields of the VES. These two operations can be expressed as PTS3 = PTS + S offset and DTS3 = DTS + S offset.
解多路复用器217使用具有部分传送流282的PCR和到达传送分组的四个字节时间标记来计算并经由频率调整器245设置播放STC 240的频率,该频率调整器245将固定频率信号275调整到调整后的固定频率信号296。调整后的固定频率信号296被播放STC 240接收,播放STC 240将播放时钟信号297发送到解多路复用器217、音频解码器与表示器220、视频解码器与表示器225。这些操作在上述相关申请”RobustMethod For Recovering A Program Time Base In MPEG-2 TransportStreams And Achieving Audio/Video Synchronization”S/N09/967,877中被完全公开。从而,播放STC 240的运行频率与建立程序流时的程序时钟相同。The demultiplexer 217 uses the PCRs with the
视频解码器与表示器225充当“主机”并且从存储解多路复用器217中以解多路复用器表示的速率拉取分段。The video decoder and
当本发明的用户使接收机100或接收机200进入特技播放模式(即快进、快退、慢进、慢退或暂停)时,存储在存储介质155或存储介质255上的视频以用户选择的速率表示,并且不存在音频或者音频不需要与视频同步。在这种情况下,对于本发明的两个实施例而言,存储偏移被设置为零并且STC 140或播放STC 240可以以最后设置的频率运行。When the user of the present invention puts receiver 100 or
在特技播放模式之后,当本发明的用户把接收机100或者接收机200恢复到普通播放模式(实时播放和延时播放是普通模式)时,结果的情况可以被认为是时基中的间断性。在这种情况下,对于两个实施例而言,基于新的偏移调整每个PES分组的PTS字段中当前的PTS值。新的偏移是PTS字段值和播放STC 140或播放STC 240当前值的函数。对于本发明的第一实施例可以表示为PTS4=PTS1+新偏移,对于本发明的第二实施例可以表示为PTS5=PTS+新偏移。新偏移的确定在上述相关申请”Robust Method For Recovering A Program Time Base InMPEG-2 Transport Streams And Achieving Audio/VideoSynchronization”S/N 09/967,877中被完全公开。After trick play mode, when the user of the present invention restores receiver 100 or
图3是说明记录期间根据本发明修改的接收机回放和记录STC和PTS的关系的曲线;在图3中,垂直轴是音频解码器与表示器120和视频解码器与表示器125(参见图1),或音频解码器与表示器220和视频解码器与表示器225(参见图2)看到的时间,水平轴是实际时间。如图3中所示,播放STC和记录STC曲线300的值以固定速率线性增加。PTS曲线305表示在AES和VES内为了避免所表示的程序中视频或音频的间断性所需的PTS值增量。PTS曲线305的斜率必须在斜率方面是相同的,尽管它可能在解码器时间上从播放STC和记录STC曲线300有一定偏移。PTS曲线310表示所记录的AES和VES的PTS值(或在第二实施例的情况下,从所存储的部分传送流中获得的AES和VES的PTS值)。在PTS曲线310的第一部分315中,PTS曲线310与PTS曲线305重叠并且准确地定时所表示的音频和视频。部分315是实况播放。在PTS曲线310的第二部分320中,程序被暂停并且按照好象已经出现间断性来对待。只要程序被暂停,部分320中的PTS值就不增加,当按照PTS曲线310的第三部分325继续播放时,在PTS曲线305和PTS曲线310之间存在偏移330。PTS曲线305和310的斜率是相同的,但是它们在解码器时间上是偏移的。偏移330应归于暂停(存储)过程中占用的时间,并且如上所述本发明通过调整PTS值来补偿存储时间,从而校正偏移330。DTS值的曲线将类似于它们相应的PTS值。Figure 3 is a graph illustrating the relationship between receiver playback and recording STC and PTS modified according to the present invention during recording; 1), or the time as seen by the audio decoder and
图4是说明在特技到普通播放期间接收机回放和记录STC、原始PTS和根据本发明修改的PTS的关系的曲线。在图4中,垂直轴是音频解码器与表示器120和视频解码器与表示器125(参见图1),或音频解码器与表示器220和视频解码器与表示器225(参见图2)看到的时间,水平轴是实际时间。如图4中所示,播放STC和记录STC曲线400的值以固定速率线性增加。PTS曲线405表示在AES和VES内为了避免所表示的程序中视频或音频的间断性所需的PTS值的增量。PTS曲线405的斜率必须在斜率方面是相同的,尽管它可能在解码器时间上从播放STC和记录STC曲线400有一定偏移。PTS曲线410表示所记录的AES和VES的PTS值(或在第二实施例的情况下,从所存储的部分传送流中获得的AES和VES的PTS值)。在PTS曲线410的第一部分415中,PTS曲线410与PTS曲线405重叠并且准确地定时所表示的音频和视频。部分415是实况播放。在PTS曲线410的第二部分420中,程序被暂停并且按照好象已经出现间断性来对待。只要程序被暂停,部分420中的PTS值就不增加。当按照PTS曲线410的第三部分425继续播放时,在PTS曲线405和PTS曲线410之间存在偏移430。PTS曲线405和410的斜率是相同的,但是它们在解码器时间上是偏移的。偏移430应归于暂停(存储)过程中占用的时间,并且如上所述本发明通过调整PTS值来补偿存储时间,从而校正偏移430。在PTS曲线410的第四部分435中,执行特技播放,在本实施例中特技播放为快进,并且被作为间断性来对待。在PTS曲线410的第四部分435中,由于特技播放失真定时的特性不需要保持定时。然而,在如PTS曲线410的第五部分445所示的退出特技播放模式之后,在PTS曲线405和PTS曲线410之间存在偏移440。PTS曲线405和410的斜率是相同的,但是它们在解码器时间上是偏移的。偏移440应归于由特技播放所引起时延失真,并且同样如上所述本发明也通过调整PTS值来补偿存储时间,从而校正偏移440。DTS值的曲线将类似于它们相应的PTS值。Fig. 4 is a graph illustrating the relationship between receiver playback and recording STC, original PTS and PTS modified according to the present invention during trick-to-normal play. In FIG. 4, the vertical axis is audio decoder and presenter 120 and video decoder and presenter 125 (see FIG. 1), or audio decoder and
通过以上说明的本发明实施例可以理解本发明。应当理解,本发明不受限于本文中描述的特殊实施例,所属领域技术人员显然可以在不背离本发明的前提下能够对其作出不同的修改、重新配置和替换。因此意谓着下列的权利要求覆盖了属于本发明真正的精神和范围的所有修改和改变。The present invention can be understood by the embodiments of the present invention described above. It should be understood that the present invention is not limited to the specific embodiments described herein, and those skilled in the art can obviously make various modifications, reconfigurations and substitutions thereto without departing from the present invention. It is therefore intended that the following claims cover all such modifications and changes as fall within the true spirit and scope of the invention.
Claims (20)
Applications Claiming Priority (2)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| US10/183,798 | 2002-06-27 | ||
| US10/183,798 US7315622B2 (en) | 2002-06-27 | 2002-06-27 | Robust method for achieving audio/video synchronization in MPEG decoders in personal video recording applications |
Publications (2)
| Publication Number | Publication Date |
|---|---|
| CN1663277A true CN1663277A (en) | 2005-08-31 |
| CN100431353C CN100431353C (en) | 2008-11-05 |
Family
ID=29779208
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CNB038149400A Expired - Fee Related CN100431353C (en) | 2002-06-27 | 2003-06-05 | A Robust Method for Audio/Video Synchronization in MPEG Decoders in Personal Video Recording Applications |
Country Status (9)
| Country | Link |
|---|---|
| US (1) | US7315622B2 (en) |
| EP (1) | EP1520423B1 (en) |
| JP (1) | JP4570462B2 (en) |
| KR (1) | KR100984638B1 (en) |
| CN (1) | CN100431353C (en) |
| AT (1) | ATE361634T1 (en) |
| AU (1) | AU2003236989A1 (en) |
| DE (1) | DE60313613T2 (en) |
| WO (1) | WO2004004330A2 (en) |
Cited By (8)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN100438634C (en) * | 2006-07-14 | 2008-11-26 | 杭州国芯科技有限公司 | Video-audio synchronization method |
| CN101924905A (en) * | 2010-09-01 | 2010-12-22 | 新邮通信设备有限公司 | Method and system for encrypting and decrypting in video telephone communication |
| CN102118243A (en) * | 2009-12-30 | 2011-07-06 | Nxp股份有限公司 | A low-jitter end-to-end latency control scheme for isochronous communications based on transmitter timestamp information |
| CN102307321A (en) * | 2011-08-31 | 2012-01-04 | 深圳创维数字技术股份有限公司 | Digital television reception terminal, front end server and data synchronization method |
| CN101632265B (en) * | 2007-02-22 | 2012-05-02 | 迅腾公司 | Determination of Space Loss and Time Loss in Packet-Based Video Broadcasting Systems |
| CN102857830A (en) * | 2011-06-29 | 2013-01-02 | 哈曼国际工业有限公司 | Network media adapter |
| CN101933332B (en) * | 2008-01-18 | 2013-03-20 | 萨基姆通信公司 | Video data decoder and method for decoding video data and synchronizing subtitle display and decoding video data |
| CN108292964A (en) * | 2015-11-27 | 2018-07-17 | 索尼公司 | Receiving device and method and communication system |
Families Citing this family (92)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| FR2842690B1 (en) * | 2002-07-17 | 2004-10-08 | Thomson Licensing Sa | METHOD AND DEVICE FOR TRANSMITTING VIDEO DATA FOR THE IMPLEMENTATION OF SPECIAL MODES |
| US7336784B2 (en) * | 2002-12-20 | 2008-02-26 | Brite Smart Corporation | Multimedia decoder method and system with authentication and enhanced digital rights management (DRM) where each received signal is unique and where the missing signal is cached inside the storage memory of each receiver |
| US20130136189A9 (en) * | 2003-01-13 | 2013-05-30 | Jiang Fu | Method and system for converting a dss stream to an encrypted mpeg stream |
| JP4346966B2 (en) * | 2003-06-13 | 2009-10-21 | キヤノン株式会社 | Imaging device |
| US11294618B2 (en) | 2003-07-28 | 2022-04-05 | Sonos, Inc. | Media player system |
| US11106425B2 (en) | 2003-07-28 | 2021-08-31 | Sonos, Inc. | Synchronizing operations among a plurality of independently clocked digital data processing devices |
| US8290603B1 (en) | 2004-06-05 | 2012-10-16 | Sonos, Inc. | User interfaces for controlling and manipulating groupings in a multi-zone media system |
| US8086752B2 (en) | 2006-11-22 | 2011-12-27 | Sonos, Inc. | Systems and methods for synchronizing operations among a plurality of independently clocked digital data processing devices that independently source digital data |
| US11106424B2 (en) | 2003-07-28 | 2021-08-31 | Sonos, Inc. | Synchronizing operations among a plurality of independently clocked digital data processing devices |
| US9207905B2 (en) | 2003-07-28 | 2015-12-08 | Sonos, Inc. | Method and apparatus for providing synchrony group status information |
| US8020023B2 (en) | 2003-07-28 | 2011-09-13 | Sonos, Inc. | Systems and methods for synchronizing operations among a plurality of independently clocked digital data processing devices without a voltage controlled crystal oscillator |
| US11650784B2 (en) | 2003-07-28 | 2023-05-16 | Sonos, Inc. | Adjusting volume levels |
| US8234395B2 (en) | 2003-07-28 | 2012-07-31 | Sonos, Inc. | System and method for synchronizing operations among a plurality of independently clocked digital data processing devices |
| CN100574451C (en) * | 2003-10-06 | 2009-12-23 | 松下电器产业株式会社 | Digital signal synchronization using PCR program clock reference |
| US9977561B2 (en) | 2004-04-01 | 2018-05-22 | Sonos, Inc. | Systems, methods, apparatus, and articles of manufacture to provide guest access |
| US9374607B2 (en) | 2012-06-26 | 2016-06-21 | Sonos, Inc. | Media playback system with guest access |
| US8024055B1 (en) | 2004-05-15 | 2011-09-20 | Sonos, Inc. | Method and system for controlling amplifiers |
| US8868698B2 (en) | 2004-06-05 | 2014-10-21 | Sonos, Inc. | Establishing a secure wireless network with minimum human intervention |
| US8326951B1 (en) | 2004-06-05 | 2012-12-04 | Sonos, Inc. | Establishing a secure wireless network with minimum human intervention |
| US20050281342A1 (en) * | 2004-06-22 | 2005-12-22 | Broadcom Corporation | Slow motion and high speed for digital video |
| WO2006025584A1 (en) * | 2004-09-02 | 2006-03-09 | Sony Corporation | Content receiver, video-audio output timing control method, and content providing system |
| JP4039417B2 (en) * | 2004-10-15 | 2008-01-30 | 株式会社日立製作所 | Recording / playback device |
| KR100636965B1 (en) * | 2004-10-19 | 2006-10-19 | (주)토필드 | Recording control device and recording control method |
| US7480315B2 (en) * | 2004-12-31 | 2009-01-20 | Microsoft Corporation | Method and apparatus for synchronizing clocks |
| JP4650112B2 (en) * | 2005-06-09 | 2011-03-16 | 株式会社日立製作所 | RECORDING / OUTPUT DEVICE, RECORDING / OUTPUT METHOD, AND RECORDING DEVICE |
| JP4991129B2 (en) * | 2005-07-19 | 2012-08-01 | Necディスプレイソリューションズ株式会社 | Video / audio playback apparatus and video / audio playback method |
| CN100409681C (en) * | 2005-08-19 | 2008-08-06 | 上海晨兴电子科技有限公司 | Image-sound synchronous recording and playing method |
| US7643513B2 (en) * | 2005-11-30 | 2010-01-05 | Broadcom Corporation | Method and system for audio and video transport |
| TWI314017B (en) * | 2006-07-12 | 2009-08-21 | Quanta Comp Inc | System and method for synchronizing video frames and audio frames |
| US12167216B2 (en) | 2006-09-12 | 2024-12-10 | Sonos, Inc. | Playback device pairing |
| US9202509B2 (en) | 2006-09-12 | 2015-12-01 | Sonos, Inc. | Controlling and grouping in a multi-zone media system |
| US8483853B1 (en) | 2006-09-12 | 2013-07-09 | Sonos, Inc. | Controlling and manipulating groupings in a multi-zone media system |
| US8788080B1 (en) | 2006-09-12 | 2014-07-22 | Sonos, Inc. | Multi-channel pairing in a media system |
| US20080085124A1 (en) * | 2006-10-10 | 2008-04-10 | Lsi Logic Corporation | Clock generation with minimum number of crystals in a multimedia system |
| JP4948147B2 (en) | 2006-12-15 | 2012-06-06 | 富士通株式会社 | Method and apparatus for editing composite content file |
| JP4589355B2 (en) * | 2007-03-30 | 2010-12-01 | 株式会社東芝 | Stream playback device |
| JP2009021885A (en) * | 2007-07-12 | 2009-01-29 | Panasonic Corp | Digital television broadcast recording / reproducing apparatus and reproducing method thereof |
| US7668094B2 (en) * | 2007-08-06 | 2010-02-23 | Ittiam Systems (P) Ltd. | Time-offset regulated method and system for synchronization and rate control of media data |
| JP5094478B2 (en) * | 2008-03-06 | 2012-12-12 | 株式会社日立製作所 | Receiver |
| US11265652B2 (en) | 2011-01-25 | 2022-03-01 | Sonos, Inc. | Playback device pairing |
| US11429343B2 (en) | 2011-01-25 | 2022-08-30 | Sonos, Inc. | Stereo playback configuration and control |
| US8938312B2 (en) | 2011-04-18 | 2015-01-20 | Sonos, Inc. | Smart line-in processing |
| US9042556B2 (en) | 2011-07-19 | 2015-05-26 | Sonos, Inc | Shaping sound responsive to speaker orientation |
| US9344292B2 (en) | 2011-12-30 | 2016-05-17 | Sonos, Inc. | Systems and methods for player setup room names |
| US9729115B2 (en) | 2012-04-27 | 2017-08-08 | Sonos, Inc. | Intelligently increasing the sound level of player |
| US9008330B2 (en) | 2012-09-28 | 2015-04-14 | Sonos, Inc. | Crossover frequency adjustments for audio speakers |
| US9510055B2 (en) | 2013-01-23 | 2016-11-29 | Sonos, Inc. | System and method for a media experience social interface |
| KR20140099146A (en) * | 2013-02-01 | 2014-08-11 | 한국전자통신연구원 | Method and apparatus of determining base pcr of multiple image for broadcationg service based on multiple image |
| US9485533B2 (en) | 2013-03-13 | 2016-11-01 | Nagrastar Llc | Systems and methods for assembling and extracting command and control data |
| USD758372S1 (en) * | 2013-03-13 | 2016-06-07 | Nagrastar Llc | Smart card interface |
| USD729808S1 (en) | 2013-03-13 | 2015-05-19 | Nagrastar Llc | Smart card interface |
| US9647997B2 (en) | 2013-03-13 | 2017-05-09 | Nagrastar, Llc | USB interface for performing transport I/O |
| US9888283B2 (en) | 2013-03-13 | 2018-02-06 | Nagrastar Llc | Systems and methods for performing transport I/O |
| USD759022S1 (en) | 2013-03-13 | 2016-06-14 | Nagrastar Llc | Smart card interface |
| US9307508B2 (en) | 2013-04-29 | 2016-04-05 | Google Technology Holdings LLC | Systems and methods for syncronizing multiple electronic devices |
| US20150095679A1 (en) | 2013-09-30 | 2015-04-02 | Sonos, Inc. | Transitioning A Networked Playback Device Between Operating Modes |
| US9720576B2 (en) | 2013-09-30 | 2017-08-01 | Sonos, Inc. | Controlling and displaying zones in a multi-zone system |
| US9244516B2 (en) | 2013-09-30 | 2016-01-26 | Sonos, Inc. | Media playback system using standby mode in a mesh network |
| US9288596B2 (en) | 2013-09-30 | 2016-03-15 | Sonos, Inc. | Coordinator device for paired or consolidated players |
| US9654545B2 (en) | 2013-09-30 | 2017-05-16 | Sonos, Inc. | Group coordinator device selection |
| US9300647B2 (en) | 2014-01-15 | 2016-03-29 | Sonos, Inc. | Software application and zones |
| US9313591B2 (en) | 2014-01-27 | 2016-04-12 | Sonos, Inc. | Audio synchronization among playback devices using offset information |
| US20150220498A1 (en) | 2014-02-05 | 2015-08-06 | Sonos, Inc. | Remote Creation of a Playback Queue for a Future Event |
| US9226073B2 (en) | 2014-02-06 | 2015-12-29 | Sonos, Inc. | Audio output balancing during synchronized playback |
| US9226087B2 (en) | 2014-02-06 | 2015-12-29 | Sonos, Inc. | Audio output balancing during synchronized playback |
| US9679054B2 (en) | 2014-03-05 | 2017-06-13 | Sonos, Inc. | Webpage media playback |
| US10587693B2 (en) | 2014-04-01 | 2020-03-10 | Sonos, Inc. | Mirrored queues |
| US20150324552A1 (en) | 2014-05-12 | 2015-11-12 | Sonos, Inc. | Share Restriction for Media Items |
| US20150356084A1 (en) | 2014-06-05 | 2015-12-10 | Sonos, Inc. | Social Queue |
| US9874997B2 (en) | 2014-08-08 | 2018-01-23 | Sonos, Inc. | Social playback queues |
| CN105446926B (en) * | 2014-09-09 | 2020-09-22 | 纳瑞塔有限责任公司 | USB interface for performing transport I/O |
| EP3114625A1 (en) | 2014-09-24 | 2017-01-11 | Sonos, Inc. | Social media connection recommendations based on playback information |
| US9860286B2 (en) | 2014-09-24 | 2018-01-02 | Sonos, Inc. | Associating a captured image with a media item |
| US9667679B2 (en) | 2014-09-24 | 2017-05-30 | Sonos, Inc. | Indicating an association between a social-media account and a media playback system |
| US9723038B2 (en) | 2014-09-24 | 2017-08-01 | Sonos, Inc. | Social media connection recommendations based on playback information |
| US9959087B2 (en) | 2014-09-24 | 2018-05-01 | Sonos, Inc. | Media item context from social media |
| US9690540B2 (en) | 2014-09-24 | 2017-06-27 | Sonos, Inc. | Social media queue |
| US10645130B2 (en) | 2014-09-24 | 2020-05-05 | Sonos, Inc. | Playback updates |
| EP3114852A1 (en) | 2014-09-24 | 2017-01-11 | Sonos Inc. | Social media queue |
| USD780763S1 (en) | 2015-03-20 | 2017-03-07 | Nagrastar Llc | Smart card interface |
| USD864968S1 (en) | 2015-04-30 | 2019-10-29 | Echostar Technologies L.L.C. | Smart card interface |
| US10248376B2 (en) | 2015-06-11 | 2019-04-02 | Sonos, Inc. | Multiple groupings in a playback system |
| EP3160147A1 (en) | 2015-10-19 | 2017-04-26 | Thomson Licensing | Method for fast channel change, corresponding arrangement and device |
| US10303422B1 (en) | 2016-01-05 | 2019-05-28 | Sonos, Inc. | Multiple-device setup |
| US9886234B2 (en) | 2016-01-28 | 2018-02-06 | Sonos, Inc. | Systems and methods of distributing audio to one or more playback devices |
| US10652625B1 (en) | 2016-06-27 | 2020-05-12 | Amazon Technologies, Inc. | Synchronization of multiple encoders for streaming content |
| US10812558B1 (en) | 2016-06-27 | 2020-10-20 | Amazon Technologies, Inc. | Controller to synchronize encoding of streaming content |
| US10652292B1 (en) * | 2016-06-28 | 2020-05-12 | Amazon Technologies, Inc. | Synchronization of multiple encoders for streaming content |
| US10712997B2 (en) | 2016-10-17 | 2020-07-14 | Sonos, Inc. | Room association based on name |
| JP7213771B2 (en) | 2019-07-22 | 2023-01-27 | 株式会社ディーアンドエムホールディングス | Wireless Audio Systems, Wireless Speakers, and How to Join Wireless Speaker Groups |
| CA3193393A1 (en) | 2020-09-25 | 2022-03-31 | Jennifer Mcdevitt | Intelligent setup for playback devices |
| CN116233472B (en) * | 2023-05-08 | 2023-07-18 | 湖南马栏山视频先进技术研究院有限公司 | A method for synchronizing audio and video and a cloud processing system |
Family Cites Families (15)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN2171184Y (en) * | 1993-05-20 | 1994-07-06 | 宋世鹏 | Interpretive code receiver for receiving T.V. signal with code |
| US5652627A (en) | 1994-09-27 | 1997-07-29 | Lucent Technologies Inc. | System and method for reducing jitter in a packet-based transmission network |
| US5793927A (en) * | 1995-06-07 | 1998-08-11 | Hitachi America, Ltd. | Methods for monitoring and modifying a trick play data stream to insure MPEG compliance |
| NZ500194A (en) * | 1997-03-21 | 2000-12-22 | Canal Plus Sa | Broadcasting randomized subscriber entitlement management messages for digital television |
| GB2328099B (en) * | 1997-08-08 | 2002-07-03 | British Broadcasting Corp | Processing coded video |
| JP3185863B2 (en) * | 1997-09-22 | 2001-07-11 | 日本電気株式会社 | Data multiplexing method and apparatus |
| JP3666625B2 (en) * | 1998-03-20 | 2005-06-29 | パイオニア株式会社 | Data recording method and data recording apparatus |
| JP2001036723A (en) * | 1999-07-16 | 2001-02-09 | Sony Corp | Copyright protection method, information signal transmission system, information signal output device, information signal receiving device, and information signal recording medium |
| JP2001045448A (en) * | 1999-07-30 | 2001-02-16 | Nec Corp | Video data synchronization system for digital tv broadcast |
| JP4256546B2 (en) * | 1999-08-24 | 2009-04-22 | パナソニック株式会社 | Stream demultiplexer |
| JP4129664B2 (en) * | 1999-10-05 | 2008-08-06 | ソニー株式会社 | Data processing apparatus and data processing method |
| JP2001177814A (en) * | 1999-12-21 | 2001-06-29 | Mitsubishi Electric Corp | Conditional access system |
| JP2001291342A (en) * | 2000-04-06 | 2001-10-19 | Matsushita Electric Ind Co Ltd | Digital information recording / reproducing device |
| JP2002125169A (en) * | 2000-10-18 | 2002-04-26 | Pioneer Electronic Corp | Program guide device and program guide method |
| JP2002171526A (en) * | 2000-11-30 | 2002-06-14 | Canon Inc | Data processing device, data processing system, data processing method, and storage medium |
-
2002
- 2002-06-27 US US10/183,798 patent/US7315622B2/en not_active Expired - Fee Related
-
2003
- 2003-06-05 EP EP03735899A patent/EP1520423B1/en not_active Expired - Lifetime
- 2003-06-05 WO PCT/IB2003/002660 patent/WO2004004330A2/en not_active Ceased
- 2003-06-05 AT AT03735899T patent/ATE361634T1/en not_active IP Right Cessation
- 2003-06-05 CN CNB038149400A patent/CN100431353C/en not_active Expired - Fee Related
- 2003-06-05 JP JP2004517094A patent/JP4570462B2/en not_active Expired - Fee Related
- 2003-06-05 DE DE60313613T patent/DE60313613T2/en not_active Expired - Lifetime
- 2003-06-05 AU AU2003236989A patent/AU2003236989A1/en not_active Abandoned
- 2003-06-05 KR KR1020047021065A patent/KR100984638B1/en not_active Expired - Fee Related
Cited By (9)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN100438634C (en) * | 2006-07-14 | 2008-11-26 | 杭州国芯科技有限公司 | Video-audio synchronization method |
| CN101632265B (en) * | 2007-02-22 | 2012-05-02 | 迅腾公司 | Determination of Space Loss and Time Loss in Packet-Based Video Broadcasting Systems |
| CN101933332B (en) * | 2008-01-18 | 2013-03-20 | 萨基姆通信公司 | Video data decoder and method for decoding video data and synchronizing subtitle display and decoding video data |
| CN102118243A (en) * | 2009-12-30 | 2011-07-06 | Nxp股份有限公司 | A low-jitter end-to-end latency control scheme for isochronous communications based on transmitter timestamp information |
| CN102118243B (en) * | 2009-12-30 | 2014-04-09 | Nxp股份有限公司 | Low-jitter end-to-end latency control scheme for isochronous communications based on transmitter timestamp information |
| CN101924905A (en) * | 2010-09-01 | 2010-12-22 | 新邮通信设备有限公司 | Method and system for encrypting and decrypting in video telephone communication |
| CN102857830A (en) * | 2011-06-29 | 2013-01-02 | 哈曼国际工业有限公司 | Network media adapter |
| CN102307321A (en) * | 2011-08-31 | 2012-01-04 | 深圳创维数字技术股份有限公司 | Digital television reception terminal, front end server and data synchronization method |
| CN108292964A (en) * | 2015-11-27 | 2018-07-17 | 索尼公司 | Receiving device and method and communication system |
Also Published As
| Publication number | Publication date |
|---|---|
| DE60313613D1 (en) | 2007-06-14 |
| WO2004004330A2 (en) | 2004-01-08 |
| KR100984638B1 (en) | 2010-10-05 |
| KR20050023332A (en) | 2005-03-09 |
| US20040001591A1 (en) | 2004-01-01 |
| AU2003236989A1 (en) | 2004-01-19 |
| AU2003236989A8 (en) | 2004-01-19 |
| ATE361634T1 (en) | 2007-05-15 |
| DE60313613T2 (en) | 2007-09-06 |
| US7315622B2 (en) | 2008-01-01 |
| EP1520423A2 (en) | 2005-04-06 |
| JP4570462B2 (en) | 2010-10-27 |
| JP2005531245A (en) | 2005-10-13 |
| EP1520423B1 (en) | 2007-05-02 |
| CN100431353C (en) | 2008-11-05 |
| WO2004004330A3 (en) | 2004-03-11 |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| CN100431353C (en) | A Robust Method for Audio/Video Synchronization in MPEG Decoders in Personal Video Recording Applications | |
| US6741290B1 (en) | Processing coded video | |
| US7412149B2 (en) | Trick mode generation in video streaming | |
| US8111971B2 (en) | Systems and methods of reducing media stream delay through independent decoder clocks | |
| US6359910B1 (en) | Clock conversion apparatus and method | |
| CN102640511A (en) | Method and system for playing video information, and video information content | |
| JPH1188314A (en) | Method and device for timing correction | |
| JPH08340541A (en) | Digital data transmission method, transmission device, recording method, recording device, reproducing method, reproducing device, recording / reproducing method, and recording / reproducing device | |
| KR101014664B1 (en) | Playback method and apparatus for ensuring continuous playback between a plurality of data streams | |
| JP2008539639A (en) | Apparatus and method for processing an encrypted data stream in a cryptographic system | |
| CN100563349C (en) | Apparatus and methods for reproducing | |
| US20060274827A1 (en) | Apparatus and method for synchronized playback | |
| CA2490879C (en) | Reproducing apparatus and method, and recording medium | |
| CN101656860B (en) | Recording apparatus and recording method | |
| JPH11205789A (en) | Transmission rate converter of mpeg2 transport stream | |
| JP4288804B2 (en) | Data decoding apparatus and data decoding method | |
| JPH099215A (en) | Data multiplexing method, data transmission method, multiplex data decoding method, multiplex data decoding device | |
| JP5016335B2 (en) | Playback apparatus and playback method | |
| JP3705231B2 (en) | Transport stream splicer | |
| KR100513795B1 (en) | Transmitting/receiving apparatus and its method for providing synchronized event service using system time clock in digital data broadcasting system | |
| JP3671969B2 (en) | Data multiplexing method and multiple data decoding method | |
| JP2007150845A (en) | Data reproducing apparatus, data reproducing method and program thereof | |
| HK1084489A1 (en) | Reproducing apparatus and method, and recording medium |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| C06 | Publication | ||
| PB01 | Publication | ||
| C10 | Entry into substantive examination | ||
| SE01 | Entry into force of request for substantive examination | ||
| ASS | Succession or assignment of patent right |
Owner name: NXP CO., LTD. Free format text: FORMER OWNER: KONINKLIJKE PHILIPS ELECTRONICS N.V. Effective date: 20080516 |
|
| C41 | Transfer of patent application or patent right or utility model | ||
| TA01 | Transfer of patent application right |
Effective date of registration: 20080516 Address after: Holland Ian Deho Finn Applicant after: Koninkl Philips Electronics NV Address before: Holland Ian Deho Finn Applicant before: Koninklijke Philips Electronics N.V. |
|
| C14 | Grant of patent or utility model | ||
| GR01 | Patent grant | ||
| ASS | Succession or assignment of patent right |
Owner name: TRIDENT MICROSYSTEMS (FAR EAST)CO., LTD. Free format text: FORMER OWNER: KONINKL PHILIPS ELECTRONICS NV Effective date: 20100819 |
|
| C41 | Transfer of patent application or patent right or utility model | ||
| COR | Change of bibliographic data |
Free format text: CORRECT: ADDRESS; FROM: EINDHOVEN, NETHERLANDS TO: CAYMAN ISLANDS, GRAND CAYMAN ISLAND |
|
| TR01 | Transfer of patent right |
Effective date of registration: 20100819 Address after: Grand Cayman, Cayman Islands Patentee after: Trident Microsystems (Far East) Ltd. Address before: Holland Ian Deho Finn Patentee before: Koninkl Philips Electronics NV |
|
| ASS | Succession or assignment of patent right |
Owner name: ENTROPY COMMUNICATION CO., LTD. Free format text: FORMER OWNER: TRIDENT MICROSYSTEMS (FAR EAST) LTD. Effective date: 20130218 |
|
| C41 | Transfer of patent application or patent right or utility model | ||
| TR01 | Transfer of patent right |
Effective date of registration: 20130218 Address after: American California Patentee after: Entropic Communications, Inc. Address before: Grand Cayman, Cayman Islands Patentee before: Trident Microsystems (Far East) Ltd. |
|
| C17 | Cessation of patent right | ||
| CF01 | Termination of patent right due to non-payment of annual fee |
Granted publication date: 20081105 Termination date: 20140605 |