WO1994014277A1 - Synchronisation de signaux numeriques video et audio - Google Patents

Synchronisation de signaux numeriques video et audio Download PDF

Info

Publication number
WO1994014277A1
WO1994014277A1 PCT/US1993/012214 US9312214W WO9414277A1 WO 1994014277 A1 WO1994014277 A1 WO 1994014277A1 US 9312214 W US9312214 W US 9312214W WO 9414277 A1 WO9414277 A1 WO 9414277A1
Authority
WO
WIPO (PCT)
Prior art keywords
video
audio
data
packets
signals
Prior art date
Application number
PCT/US1993/012214
Other languages
English (en)
Inventor
Joseph Gaucher, Jr.
Fred Allen
Todd Squires
Original Assignee
Viacom International Inc.
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Viacom International Inc. filed Critical Viacom International Inc.
Priority to AU59522/94A priority Critical patent/AU5952294A/en
Publication of WO1994014277A1 publication Critical patent/WO1994014277A1/fr

Links

Classifications

    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N5/00—Details of television systems
    • H04N5/76—Television signal recording
    • H04N5/91—Television signal processing therefor
    • H04N5/92—Transformation of the television signal for recording, e.g. modulation, frequency changing; Inverse transformation for playback
    • H04N5/926—Transformation of the television signal for recording, e.g. modulation, frequency changing; Inverse transformation for playback by pulse code modulation
    • H04N5/9265—Transformation of the television signal for recording, e.g. modulation, frequency changing; Inverse transformation for playback by pulse code modulation with processing of the sound signal
    • H04N5/9267—Transformation of the television signal for recording, e.g. modulation, frequency changing; Inverse transformation for playback by pulse code modulation with processing of the sound signal using time division multiplex of the PCM audio and PCM video signals
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
    • H04N21/40—Client devices specifically adapted for the reception of or interaction with content, e.g. set-top-box [STB]; Operations thereof
    • H04N21/43—Processing of content or additional data, e.g. demultiplexing additional data from a digital video stream; Elementary client operations, e.g. monitoring of home network or synchronising decoder's clock; Client middleware
    • H04N21/4302—Content synchronisation processes, e.g. decoder synchronisation
    • H04N21/4307—Synchronising the rendering of multiple content streams or additional data on devices, e.g. synchronisation of audio on a mobile phone with the video output on the TV screen
    • H04N21/43072—Synchronising the rendering of multiple content streams or additional data on devices, e.g. synchronisation of audio on a mobile phone with the video output on the TV screen of multiple content streams on the same device
    • G—PHYSICS
    • G11—INFORMATION STORAGE
    • G11B—INFORMATION STORAGE BASED ON RELATIVE MOVEMENT BETWEEN RECORD CARRIER AND TRANSDUCER
    • G11B27/00—Editing; Indexing; Addressing; Timing or synchronising; Monitoring; Measuring tape travel
    • G11B27/10—Indexing; Addressing; Timing or synchronising; Measuring tape travel
    • G—PHYSICS
    • G11—INFORMATION STORAGE
    • G11B—INFORMATION STORAGE BASED ON RELATIVE MOVEMENT BETWEEN RECORD CARRIER AND TRANSDUCER
    • G11B27/00—Editing; Indexing; Addressing; Timing or synchronising; Monitoring; Measuring tape travel
    • G11B27/10—Indexing; Addressing; Timing or synchronising; Measuring tape travel
    • G11B27/102—Programmed access in sequence to addressed parts of tracks of operating record carriers
    • G11B27/105—Programmed access in sequence to addressed parts of tracks of operating record carriers of operating discs
    • G—PHYSICS
    • G11—INFORMATION STORAGE
    • G11B—INFORMATION STORAGE BASED ON RELATIVE MOVEMENT BETWEEN RECORD CARRIER AND TRANSDUCER
    • G11B27/00—Editing; Indexing; Addressing; Timing or synchronising; Monitoring; Measuring tape travel
    • G11B27/10—Indexing; Addressing; Timing or synchronising; Measuring tape travel
    • G11B27/19—Indexing; Addressing; Timing or synchronising; Measuring tape travel by using information detectable on the record carrier
    • G11B27/28—Indexing; Addressing; Timing or synchronising; Measuring tape travel by using information detectable on the record carrier by using information signals recorded by the same method as the main recording
    • G11B27/30—Indexing; Addressing; Timing or synchronising; Measuring tape travel by using information detectable on the record carrier by using information signals recorded by the same method as the main recording on the same track as the main recording
    • G11B27/3027—Indexing; Addressing; Timing or synchronising; Measuring tape travel by using information detectable on the record carrier by using information signals recorded by the same method as the main recording on the same track as the main recording used signal is digitally coded
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
    • H04N21/40—Client devices specifically adapted for the reception of or interaction with content, e.g. set-top-box [STB]; Operations thereof
    • H04N21/41—Structure of client; Structure of client peripherals
    • H04N21/426—Internal components of the client ; Characteristics thereof
    • H04N21/42646—Internal components of the client ; Characteristics thereof for reading from or writing on a non-volatile solid state storage medium, e.g. DVD, CD-ROM
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
    • H04N21/40—Client devices specifically adapted for the reception of or interaction with content, e.g. set-top-box [STB]; Operations thereof
    • H04N21/43—Processing of content or additional data, e.g. demultiplexing additional data from a digital video stream; Elementary client operations, e.g. monitoring of home network or synchronising decoder's clock; Client middleware
    • H04N21/432—Content retrieval operation from a local storage medium, e.g. hard-disk
    • H04N21/4325—Content retrieval operation from a local storage medium, e.g. hard-disk by playing back content from the storage medium
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
    • H04N21/40—Client devices specifically adapted for the reception of or interaction with content, e.g. set-top-box [STB]; Operations thereof
    • H04N21/43—Processing of content or additional data, e.g. demultiplexing additional data from a digital video stream; Elementary client operations, e.g. monitoring of home network or synchronising decoder's clock; Client middleware
    • H04N21/433—Content storage operation, e.g. storage operation in response to a pause request, caching operations
    • H04N21/4334—Recording operations
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
    • H04N21/40—Client devices specifically adapted for the reception of or interaction with content, e.g. set-top-box [STB]; Operations thereof
    • H04N21/43—Processing of content or additional data, e.g. demultiplexing additional data from a digital video stream; Elementary client operations, e.g. monitoring of home network or synchronising decoder's clock; Client middleware
    • H04N21/434—Disassembling of a multiplex stream, e.g. demultiplexing audio and video streams, extraction of additional data from a video stream; Remultiplexing of multiplex streams; Extraction or processing of SI; Disassembling of packetised elementary stream
    • H04N21/4341—Demultiplexing of audio and video streams
    • G—PHYSICS
    • G11—INFORMATION STORAGE
    • G11B—INFORMATION STORAGE BASED ON RELATIVE MOVEMENT BETWEEN RECORD CARRIER AND TRANSDUCER
    • G11B2220/00—Record carriers by type
    • G11B2220/20—Disc-shaped record carriers
    • G11B2220/25—Disc-shaped record carriers characterised in that the disc is based on a specific recording technology
    • G11B2220/2537—Optical discs
    • G11B2220/2545—CDs
    • G—PHYSICS
    • G11—INFORMATION STORAGE
    • G11B—INFORMATION STORAGE BASED ON RELATIVE MOVEMENT BETWEEN RECORD CARRIER AND TRANSDUCER
    • G11B27/00—Editing; Indexing; Addressing; Timing or synchronising; Monitoring; Measuring tape travel
    • G11B27/02—Editing, e.g. varying the order of information signals recorded on, or reproduced from, record carriers
    • G11B27/031—Electronic editing of digitised analogue information signals, e.g. audio or video signals
    • G11B27/034—Electronic editing of digitised analogue information signals, e.g. audio or video signals on discs

Definitions

  • the present invention relates to a method for displaying digital video signals, and more particularly to a method for synchronizing the display of digital video signals with the playback of their corresponding digital audio signals.
  • CD-ROM compact disc-read only memory
  • Prior art methods have attempted to synchronize the audio with the video on a hardware platform- specific basis. By analyzing the capabilities of a specific hardware system, prior art methods attempted to predict the relative speed of the display of video and the relative speed of the playback of corresponding audio. For example, if an audio device of a particular video game machine is capable of playing audio data at a rate of 20 Khz after a 200 millisecond buffering delay and the video processor of the video game machine is capable of displaying video data at a rate of 40 Khz after a 10 millisecond propagation delay, prior art methods would recognize that twice as much video as audio would need to be retrieved from the compact disc and that the corresponding audio must be retrieved 190 milliseconds before the video. Using the above information, prior art methods would sequentially store the audio and video on a compact disc in this manner so that as the audio and video were retrieved by the video game machine, the corresponding audio and video would be played back and displayed at approximately the same time.
  • a general object of the present invention is to provide a method for reliably and predictably synchronizing the display of digital video signals with the playback of their corresponding digital audio signals.
  • Another general object of the present invention is to provide a method for synchronizing video and audio which is independent of any hardware specific platform.
  • the present invention embodied in an improved method for synchronizing video and audio.
  • This method is different from prior methods in that the video and audio data retrieved from the compact disc is interrogated and analyzed to ensure their synchronous display and playback.
  • the audio and video data is stored on the compact disc in an interleaved fashion, thereby providing the video display device with simultaneous access to video signals and corresponding audio signals.
  • Synchronization is achieved by first storing packets of the digital video signals and packets of digital audio signals corresponding to the packets of video signals in blocks of data on the compact disc (or other suitable recording medium) . Attribute information regarding, among other things, the relative quantity of the packets of video signals and the packets of audio signals is also stored in each block of data. To display the digital video signals, the video display device (or other microprocessor driven device) retrieves the blocks of data from the compact disc and interrogates the attribute information to recover information regarding which packets of the video signals correspond to which packets of the audio signals. Then, the video display device controls the display of the video signals and the synchronous playback of the audio signals corresponding to the video signals.
  • An advantage of the present invention includes the ability to control the synchronous display of the video signals with their corresponding audio signals on a real-time basis as the video is being displayed. Unlike other techniques, the present invention allows the video display device to recognize which video signals correspond to which audio signals. As a result, the video display device can respond to and correct any synchronization errors, thereby reducing or eliminating any unwanted drift of the audio.
  • FIG. 1 is a schematic diagram showing apparatus utilized to digitize audio and video signals and— store the digital audio and video signals on a compact disc in accordance with one aspect of a preferred embodiment of the present invention.
  • FIG. 2 is a representation of the storage format used to store the digital audio and video signals on the surface of the compact disc.
  • FIG. 3 is a block diagram of a typical video display device which may be utilized to display the digital video signals while synchronously playing back their corresponding digital audio signals in accordance with one aspect of a preferred embodiment of the present invention.
  • FIG. 1 there is shown a schematic diagram showing apparatus utilized to digitize audio and video signals and store the digital audio and video signals on a compact disc in accordance with one aspect of a preferred embodiment of the present invention.
  • a video camera 10 records analog video signals which are digitized by an analog to digital converter 18.
  • a microphone 14 records analog audio signals which are digitized by an analog to digital converter 22.
  • the digitized audio and video signals are received by a computer workstation 26 which saves the digital audio and video signals along with their attribute information in blocks of data in a digital file 28 on a hard disk drive 30 of the workstation 26.
  • the data stored in the digital file 28 is then transferred onto a compact disc.
  • the size of the blocks of data is 2048 bytes. Since, the throughput rate for a typical compact disc drive 100 (shown in FIG. 3) is approximately 150K bytes/second, each block contains the data necessary to display the video and play the audio for approximately l/75th (2048/150,000) of one second. Accordingly, in the preferred embodiment shown, the video and audio is guaranteed to be synchronized to within at least l/75th of one second. Any errors in synchronization within such a margin of error are undiscernible to the human observer. Referring to FIG. 2 there is shown a representation of the storage format used to store the digital audio and video signals on the surface of the compact disc 34.
  • Blocks of data 38 and 46 are shown having headers 40 and 48, audio data packets 42 and 50, and video data packets 44 and 52, respectfully.
  • the headers 40 and 48 store the attribute information which contains, among other things, information regarding length of the audio and video data packets. Typically, the lengths of the video packets are variable depending upon the amount of compression of the video data.
  • the attribute information also contains the offset to the next block of data and the offset to the previous block of data on the compact disc.
  • the attribute information may contain additional specific information regarding the data contained in the blocks, e.g. whether the data is compressed or not.
  • FIG. 3 there is shown a schematic diagram of a typical video display device 100 which may be utilized to display the digital video signals while synchronously playing their corresponding digital audio signals.
  • the video display device 100 may be a personal computer having a microprocessor 104 and other compatible peripherals comprising a compact disc drive 108, a video graphics card 112, an audio card 116, and a display monitor 120. Communication between the microprocessor 104 and the peripherals is achieved through the communication bus 124.
  • the video display device 100 operates 5 and is used as follows.
  • the compact disc 34 containing the blocks of audio, video and attribute data, is inserted into the compact disc drive 108.
  • the compact disc drive 108 retrieves the blocks of data 0 from the compact disc 34 and sends the data to the microprocessor 104 via the communication bus 124.
  • the microprocessor 104 stores the data in a random access memory (RAM) 128 and interrogates the attribute information to determine which packets of video data 5 corresponds to which packets of audio data.
  • the RAM 128 is comprised of three (3) buffers of 8OK bytes of memory each.
  • the microprocessor 104 initially fills each of the three buffers with the blocks of data from the compact disc o 34.
  • the microprocessor 104 may also decompress the data, if necessary.
  • the microprocessor 104 sends the audio data to the 5 audio card 116.
  • the audio data is also buffered in the audio buffer 132 of the audio card 116. Therefore, the microprocessor 104 delays a predetermined amount of time to allow the audio data to propagate through the audio buffer 132. Then, the 0 microprocessor 104 sends the video data to the video graphics card 112.
  • an interrupt routine controls the flow of data to the audio card 116 and the video graphics card 112 to ensure synchronization. If any 5 of the three buffers of the RAM 128 is depleted, the microprocessor 104 retrieves additional blocks of data from the compact disc drive 108 and loads the buffer of the RAM 128 with additional data.
  • the audio card 116 converts the audio data from digital data to an analog audio signal and then sends the audio signal to the external speaker 134 for playback.
  • the video graphics card 112 converts the video data from digital data to an analog video signal and sends the video signal to the display monitor 120.
  • the microprocessor 104 ensures the synchronous display of the video data with the playback of corresponding audio data.
  • the microprocessor 104 can simply clear the audio buffer 132 and resync itself by interrogating the attribute information of a new block of data in the buffers of the RAM 128 to determine which packets of video data corresponds to which packets of audio data.

Abstract

L'invention se rapporte à un procédé de synchronisation d'affichage de signaux vidéo numériques avec des signaux audio numériques correspondants. En fonctionnement, la présente invention enregistre des données vidéo et audio dans une structure d'entrelacement (Fig. 2). A l'aide des informations d'attributs, la présente invention détermine quelles sont les données audio qui correspondent aux données vidéo (104). La technique (Fig. 3) assure la synchronisation fiable et prévisible de l'affichage des signaux vidéo numériques avec la reproduction de leurs signaux audio numériques correspondants.
PCT/US1993/012214 1992-12-15 1993-12-15 Synchronisation de signaux numeriques video et audio WO1994014277A1 (fr)

Priority Applications (1)

Application Number Priority Date Filing Date Title
AU59522/94A AU5952294A (en) 1992-12-15 1993-12-15 Synchronizing the digital video and audio signals

Applications Claiming Priority (2)

Application Number Priority Date Filing Date Title
US99070592A 1992-12-15 1992-12-15
US990,705 1992-12-15

Publications (1)

Publication Number Publication Date
WO1994014277A1 true WO1994014277A1 (fr) 1994-06-23

Family

ID=25536452

Family Applications (1)

Application Number Title Priority Date Filing Date
PCT/US1993/012214 WO1994014277A1 (fr) 1992-12-15 1993-12-15 Synchronisation de signaux numeriques video et audio

Country Status (2)

Country Link
AU (1) AU5952294A (fr)
WO (1) WO1994014277A1 (fr)

Cited By (3)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
EP0727074A1 (fr) * 1993-10-29 1996-08-21 Time Warner Entertainment Co., L.P. Structure de blocs de donnees destinee a un support de logiciel et lecteur associe
EP0848383A2 (fr) * 1996-12-13 1998-06-17 Sony Corporation Enregistrement d'information et reproduction
EP1310957A2 (fr) * 1996-04-08 2003-05-14 Pioneer Electronic Corporation Milieu d'enregistrement d'informations, appareil d'enregistrement de ceci et appareil de reproduction de ceci

Citations (3)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US4692816A (en) * 1983-07-08 1987-09-08 Victor Company Of Japan Ltd. Digital data transmitting system for transmitting digital data a number of times depending on an information content of the digital data
US5128775A (en) * 1990-04-04 1992-07-07 Pioneer Electronic Corporation Method for playing analog and digital video signals in a predetermined order from a composite disk
US5166804A (en) * 1987-07-04 1992-11-24 Canon Kabushiki Kaisha Reproduction apparatus designating audio and/or video signals to be reproduced

Patent Citations (3)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US4692816A (en) * 1983-07-08 1987-09-08 Victor Company Of Japan Ltd. Digital data transmitting system for transmitting digital data a number of times depending on an information content of the digital data
US5166804A (en) * 1987-07-04 1992-11-24 Canon Kabushiki Kaisha Reproduction apparatus designating audio and/or video signals to be reproduced
US5128775A (en) * 1990-04-04 1992-07-07 Pioneer Electronic Corporation Method for playing analog and digital video signals in a predetermined order from a composite disk

Cited By (7)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
EP0727074A1 (fr) * 1993-10-29 1996-08-21 Time Warner Entertainment Co., L.P. Structure de blocs de donnees destinee a un support de logiciel et lecteur associe
EP0727074A4 (fr) * 1993-10-29 1998-10-07 Time Warner Entertainm Co Lp Structure de blocs de donnees destinee a un support de logiciel et lecteur associe
EP1310957A2 (fr) * 1996-04-08 2003-05-14 Pioneer Electronic Corporation Milieu d'enregistrement d'informations, appareil d'enregistrement de ceci et appareil de reproduction de ceci
EP1310957A3 (fr) * 1996-04-08 2004-09-01 Pioneer Electronic Corporation Milieu d'enregistrement d'informations, appareil d'enregistrement de ceci et appareil de reproduction de ceci
EP0848383A2 (fr) * 1996-12-13 1998-06-17 Sony Corporation Enregistrement d'information et reproduction
EP0848383A3 (fr) * 1996-12-13 2001-03-21 Sony Corporation Enregistrement d'information et reproduction
US6347185B1 (en) 1996-12-13 2002-02-12 Sony Corporation Apparatus and method for recording audio/video signal and detected feature information thereof

Also Published As

Publication number Publication date
AU5952294A (en) 1994-07-04

Similar Documents

Publication Publication Date Title
US5767863A (en) Video processing technique using multi-buffer video memory
US6512552B1 (en) Subpicture stream change control
US5664044A (en) Synchronized, variable-speed playback of digitally recorded audio and video
US5617502A (en) System and method synchronizing audio and video digital data signals during playback
JP3326669B2 (ja) データ再生装置
US5555463A (en) Television receiver with deferred transmission of moving image sequences
US5828904A (en) System for data retrieval by scheduling retrieval if number of units scheduled equals or less than predetermined number and retrieving before or at time elapsed
US6363207B1 (en) Method and apparatus for a virtual system time clock for digital audio/video processor
EP0847191B1 (fr) Synchronisation d'un flux de données audiovisuelles qui est synchronisé avec une horloge avec la base de temps d'un dispositif d'affichage vidéo qui est synchronisé ave une horloge différente
EP0534883A1 (fr) Méthode et appareil pour synchroniser la lecture d'un dispositif à support séquentiel, à l'aide d'un dispositif commandé par une horloge séparée
JP2003510626A (ja) 字幕情報表示機能を有する字幕ｍｐ３プレーヤー、字幕ｍｐ３情報構造及び字幕ｍｐ３情報再生方法
JPH08511915A (ja) 適応型画像伸張
US6111592A (en) DMA data transfer apparatus, motion picture decoding apparatus using the same, and DMA data transfer method
US5708846A (en) System for retrieving initial data sequence corresponding to next data sequence while locating next data sequence when branch point is reached during current data sequence
US6044431A (en) Data buffer using dummy data
US5766018A (en) Disc playback system, karaoke system and disc playback method
US6240469B1 (en) System for transferring motion picture data between peripheral device interfaces by second peripheral interface issuing data transaction based on information set by processor to designate first peripheral interface
US6587635B1 (en) Subpicture master control
JPH09186966A (ja) ビデオ再生方法及び再生システム
WO1994014277A1 (fr) Synchronisation de signaux numeriques video et audio
JP2001111968A (ja) フレームレート変換装置
JP3986147B2 (ja) 音響信号処理装置及びオーディオ高速再生方法
JP3973568B2 (ja) データ処理装置、データ再生装置、データ処理方法及びデータ再生方法
JP4656679B2 (ja) ディスク装置
JPH08115279A (ja) マルチメディアｖｏｄシステムにおけるディスクアクセス方法

Legal Events

Date Code Title Description
AK Designated states

Kind code of ref document: A1

Designated state(s): AU BB BG BR BY CA CZ FI HU JP KR KZ LK LV MG MN MW NO NZ PL RO RU SD SK UA UZ

AL Designated countries for regional patents

Kind code of ref document: A1

Designated state(s): AT BE CH DE DK ES FR GB GR IE IT LU MC NL PT SE BF BJ CF CG CI CM GA GN ML MR NE SN TD TG

DFPE Request for preliminary examination filed prior to expiration of 19th month from priority date (pct application filed before 20040101)
121 Ep: the epo has been informed by wipo that ep was designated in this application
122 Ep: pct application non-entry in european phase
NENP Non-entry into the national phase

Ref country code: CA