WO2007128957A1 - Procédé et appareil de traitement de données codées numériquement dans un flux afin de récupérer des parties de données situées à l'extérieur - Google Patents

Procédé et appareil de traitement de données codées numériquement dans un flux afin de récupérer des parties de données situées à l'extérieur Download PDF

Info

Publication number
WO2007128957A1
WO2007128957A1 PCT/GB2007/001181 GB2007001181W WO2007128957A1 WO 2007128957 A1 WO2007128957 A1 WO 2007128957A1 GB 2007001181 W GB2007001181 W GB 2007001181W WO 2007128957 A1 WO2007128957 A1 WO 2007128957A1
Authority
WO
WIPO (PCT)
Prior art keywords
data
stream
demultiplexer
sub
portions
Prior art date
Application number
PCT/GB2007/001181
Other languages
English (en)
Inventor
Matthew Alan Bowers
Original Assignee
Tektronix International Sales Gmbh
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Priority claimed from GBGB0607216.9A external-priority patent/GB0607216D0/en
Application filed by Tektronix International Sales Gmbh filed Critical Tektronix International Sales Gmbh
Publication of WO2007128957A1 publication Critical patent/WO2007128957A1/fr

Links

Classifications

    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
    • H04N21/40—Client devices specifically adapted for the reception of or interaction with content, e.g. set-top-box [STB]; Operations thereof
    • H04N21/43—Processing of content or additional data, e.g. demultiplexing additional data from a digital video stream; Elementary client operations, e.g. monitoring of home network or synchronising decoder's clock; Client middleware
    • H04N21/435—Processing of additional data, e.g. decrypting of additional data, reconstructing software from modules extracted from the transport stream
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
    • H04N21/20—Servers specifically adapted for the distribution of content, e.g. VOD servers; Operations thereof
    • H04N21/23—Processing of content or additional data; Elementary server operations; Server middleware
    • H04N21/235—Processing of additional data, e.g. scrambling of additional data or processing content descriptors
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
    • H04N21/40—Client devices specifically adapted for the reception of or interaction with content, e.g. set-top-box [STB]; Operations thereof
    • H04N21/41—Structure of client; Structure of client peripherals
    • H04N21/426—Internal components of the client ; Characteristics thereof
    • H04N21/42607—Internal components of the client ; Characteristics thereof for processing the incoming bitstream
    • H04N21/42615—Internal components of the client ; Characteristics thereof for processing the incoming bitstream involving specific demultiplexing arrangements
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
    • H04N21/40—Client devices specifically adapted for the reception of or interaction with content, e.g. set-top-box [STB]; Operations thereof
    • H04N21/43—Processing of content or additional data, e.g. demultiplexing additional data from a digital video stream; Elementary client operations, e.g. monitoring of home network or synchronising decoder's clock; Client middleware
    • H04N21/434—Disassembling of a multiplex stream, e.g. demultiplexing audio and video streams, extraction of additional data from a video stream; Remultiplexing of multiplex streams; Extraction or processing of SI; Disassembling of packetised elementary stream
    • H04N21/4348—Demultiplexing of additional data and video streams
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
    • H04N21/40—Client devices specifically adapted for the reception of or interaction with content, e.g. set-top-box [STB]; Operations thereof
    • H04N21/47—End-user applications
    • H04N21/472—End-user interface for requesting content, additional data or services; End-user interface for interacting with content, e.g. for content reservation or setting reminders, for requesting event notification, for manipulating displayed content
    • H04N21/4722—End-user interface for requesting content, additional data or services; End-user interface for interacting with content, e.g. for content reservation or setting reminders, for requesting event notification, for manipulating displayed content for requesting additional data associated with the content
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
    • H04N21/80—Generation or processing of content or additional data by content creator independently of the distribution process; Content per se
    • H04N21/83—Generation or processing of protective or descriptive data associated with content; Content structuring
    • H04N21/845—Structuring of content, e.g. decomposing content into time segments
    • H04N21/8455—Structuring of content, e.g. decomposing content into time segments involving pointers to the content, e.g. pointers to the I-frames of the video stream
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
    • H04N21/80—Generation or processing of content or additional data by content creator independently of the distribution process; Content per se
    • H04N21/83—Generation or processing of protective or descriptive data associated with content; Content structuring
    • H04N21/845—Structuring of content, e.g. decomposing content into time segments
    • H04N21/8456—Structuring of content, e.g. decomposing content into time segments by decomposing the content in the time domain, e.g. in time segments
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
    • H04N21/80—Generation or processing of content or additional data by content creator independently of the distribution process; Content per se
    • H04N21/85—Assembly of content; Generation of multimedia applications
    • H04N21/858—Linking data to content, e.g. by linking an URL to a video object, by creating a hotspot
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N7/00—Television systems
    • H04N7/24—Systems for the transmission of television signals using pulse code modulation
    • H04N7/52—Systems for transmission of a pulse code modulated video signal with one or more other pulse code modulated signals, e.g. an audio signal or a synchronizing signal

Definitions

  • the digital data In the field of digital data transmission the digital data is generally encoded into one of many available data file formats. Examples of such file formats include JPEG, MPEG and Microsoft wav files, amongst others.
  • the encoding process Apart from providing a file format in a standard form that can be readily decoded by third parties, the encoding process generally also serves to compress the digital data so as to reduce the sheer volume of raw data to be transmitted or stored.
  • the encoding process encodes the digital data into discrete packets. A sequence of such data packets arranged sequentially in the appropriate order comprises a data stream. The desired end result is to provide the correctly assembled data stream to an appropriate data decoder to allow the digital data to be decoded into its original state, for example audio data.
  • the digital data in the form of a single data stream represents a very simple data arrangement. More commonly the digital data will represent a number of separate data streams. For example, where the digital data represents audio/visual data, such as a film, the video (images) and audio data may be provided in separate data streams. Depending on how the video and audio data was recorded originally and/or encoded, the video and audio streams may be further sub-divided. For example, multiple audio streams may be provided, with each audio stream representing a separate speaker channel in accordance with a surround sound standard.
  • multiple original data streams are present they are generally multiplexed together prior to storage or transmission to form a 'parent stream', with the individual streams then only existing as 'virtual' sub-streams composed of a list of references to items of data in the parent stream.
  • a simple data decoder is arranged to process a single data stream at a time and to simply process the individual data packets in the order in which they are provided.
  • the decoder is arranged to simply process that single data file.
  • a "wrapper demux" is provided, the function of which is to process the parent stream and assemble the separate individual data streams to be processed by appropriate individual decoders.
  • the encoded digital data is not provided in a continuous data stream of sequential data packets but may include one or more references to completely separate data objects.
  • the data stream that is input to the individual decoders will generally include one or more references to an external data object, the reference specifying the location of the data object.
  • the data decoder is arranged to correctly interpret the specified file location and is arranged to have the necessary direct access to that location.
  • This can be disadvantageous since it introduces a further level of complexity into the data decoders and furthermore results in a proliferation of multiple file support around many system components, i.e. individual decoders. Such a proliferation is not particularly desirable since it further complicates the decoding system and introduces an increased possibility of system conflicts.
  • the adaptations required to allow individual decoders to make the required external file reference accesses can be significant in terms of both technical and financial resources.
  • a method of processing a digitally encoded data stream by means of a data processing system including an I/O processor, a demultiplexer and a decoder, the data stream comprising a plurality of data portions at least one of which includes a reference to at least one further data portion located externally from the data stream, the method comprising: in response to a request from the data decoder to the demultiplexer for a data portion, determining if the requested data portion includes a reference to one of the further data portions located externally from the data stream; and if the determination is positive, causing the I/O processor to retrieve the further data portion and input the further data portion to the demultiplexer and subsequently causing the demultiplexer to output the further data to the data decoder.
  • the inclusion of a reference to a further data portion may be determined by the demultiplexer. Additionally, if the determination is positive a control signal may be sent to the I/O processor by the demultiplexer, the control signal causing the I/O processor to retrieve the further data portion.
  • each of the plurality of data portions may be associated with one of a plurality of data sub-streams and the method further comprises generating a record of data portions associated with each sub-stream by means of the demultiplexer.
  • the step of generating the list of data portions associated with each data sub- stream may comprise reading, by means of the demultiplexer, a data stream index included in a data portion located at the beginning of the data stream.
  • the step of generating the list of data portions associated with each data sub-stream may comprise reading, by means of the demultiplexer, the first N data portions of the data stream, where N is an integer, wherein each data portion includes an identification of the data sub-stream to which it is associated.
  • a data processing system for processing a digitally encoded data stream, the data stream comprising a plurality of data portions at least one of which includes a reference to at least one further data portion located externally from the data stream, the system comprising an I/O processor arranged to receive the data stream and output a specified data portion, at least one decoder for decoding the data portions arranged to issue a request for a data portion to be decoded, and a demultiplexer in communication with the I/O processor and decoder and arranged in response to receiving the request from the decoder to determine if the requested data portion includes a reference to one of the further data portions located externally from the data stream to determine if the requested data portion includes a reference to one of the further data portions located externally from the data stream and if the determination is positive to output a request to the VO processor for the further data portion, the I/O processor being further arranged to access data portions located otherwise than in the data stream.
  • each of the plurality of data portions may be associated with one of a plurality of sub-streams and the demultiplexer is arranged to generate a record of data portions associated with each data sub-stream.
  • at least one of the data portions in the data stream may include a sub-stream index specifying the association between each data portion and each data sub-stream and the demultiplexer is arranged to process the sub-stream index to generate said record.
  • each data portion may include a sub-stream identifier and the demultiplexer is arranged to read the sub-stream identifier for the first N data portions, where N is an integer, to generate said record.
  • Figure 1 schematically illustrates a portion of a digital data decoding system according to an embodiment of the present invention.
  • Figure 2 schematically illustrates the method steps of retrieving a requested data byte according to embodiments of the present invention.
  • Figure 1 schematically illustrates the system and process for decoding encoded digital data according to a preferred embodiment of the present invention.
  • the initial input file comprises a wrapper file 1.
  • the wrapper file can be thought of as a container in which the multiple digital data streams are "wrapped".
  • the wrapper file may also further encode the digital data of the data streams in a manner most appropriate for either their transmission or storage.
  • the wrapper file is provided as an input to an I/O 'object' 3 that comprises a first data processing entity.
  • the I/O processor 3 is arranged to provide individual 'sections' of the parent data stream to a Demux (demultiplexer) 5 in response to an appropriate request from the Demux.
  • Each 'section' may be one or more bytes of data or a data header, for example, depending on the encoding scheme used.
  • Each 'section' includes a start address (relative to the beginning of the parent data stream) and a length. For example, a 'section' may be identified as starting at byte 100 of the parent stream and having a length of a further 4 bytes. Contained within the parent data stream is information on the number of sub- streams contained in the parent stream.
  • the location of this information within the parent stream will vary depending on the encoding used.
  • the MPEG-4 format includes an initial header followed by data packets, the initial header containing the information on the number of sub-streams amongst other information.
  • the MPEG-2 Transport Stream provides data packets each having their own individual header providing the information on which sub-stream the data packet belongs to.
  • the Demux 5 is arranged to read sufficient of the parent data stream to determine the number of sub-streams present. In the case where an initial 'global 1 header is provided the Demux only needs to read and parse this header to determine the number of sub-streams and to create each sub-stream as a list of references to data sections in the parent stream. In the case of each data packet including its own header, the Demux 5 is arranged to read a predetermined number of the sections of the parent data stream to determine the number of sub-streams present. Since in the latter case not all the sections of the parent stream are read by the Demux 5, it is not possible to generate a corresponding complete list of references.
  • the Demux reads a further number of the data sections to extend the list of references. Having assembled the list of references to the parent stream for each sub-stream the Demux 5 is able to process each request for data received from any one of the decoders 9 coupled to the Demux 5.
  • each decoder 9 requests, or 'calls', the next byte of data to be decoded for the particular sub-stream being processed by that decoder.
  • the decoder does not call for the next byte by location but simply requests the 'next' byte.
  • the Demux 5 determines the location of the requested 'next byte 1 within the parent data stream and requests that byte from the I/O processor 3, which is arranged to physically access the required data. The requested data is then passed back downstream from the I/O processor 3 to the relevant decoder 9 via the Demux 5.
  • the Demux 5 is arranged to recognise the presence of an external file reference such that when the 'next byte' requested by a decoder 9 is located in an external file the Demux 5 passes a special request upstream to the I/O processor 3 instructing the I/O processor to access the specified external file. The requested data is then retrieved from the external file by the I/O processor and subsequently passed back downstream to the Demux 5, which passes it further downstream to the relevant decoder 9.
  • the 'next byte' is retrieved from the parent stream as described above and as represented by action box 22. If the 'next byte 1 is externally located then it is retrieved from the specified external file, by the I/O processor, as also previously described and as represented by action box 24 in Figure 2. The retrieved data byte is subsequently passed back to the Demux (action box 26) and then to the relevant decoder (action box 28).

Abstract

La présente invention concerne un procédé de traitement d'un flux de données codées numériquement au moyen d'un système de traitement de données comprenant un processeur E/S, un démultiplexeur et un décodeur, le flux de données comprenant une pluralité de parties de données dont au moins une comprend une référence à au moins une partie de données supplémentaire située à l'extérieur du flux de données. Le procédé consiste, en réponse à une demande du décodeur de données au démultiplexeur pour une partie de données, à déterminer si la partie de données demandée comprend ou non une référence à l'une des parties de données supplémentaires situées à l'extérieur du flux de données, et si la détermination est positive, à récupérer à l'aide du processeur E/S la partie de données supplémentaire et à entrer ladite partie de données supplémentaire dans le démultiplexeur et enfin à émettre à l'aide du démultiplexeur les données supplémentaires vers le décodeur de données.
PCT/GB2007/001181 2006-04-10 2007-03-30 Procédé et appareil de traitement de données codées numériquement dans un flux afin de récupérer des parties de données situées à l'extérieur WO2007128957A1 (fr)

Applications Claiming Priority (4)

Application Number Priority Date Filing Date Title
GB0607216.9 2006-04-10
GBGB0607216.9A GB0607216D0 (en) 2006-04-10 2006-04-10 Method and apparatus for handling media with external references
GB0610020A GB2437101A (en) 2006-04-10 2006-05-19 Method and apparatus for processing digitally encoded data streams
GB0610020.0 2006-05-19

Publications (1)

Publication Number Publication Date
WO2007128957A1 true WO2007128957A1 (fr) 2007-11-15

Family

ID=38279058

Family Applications (1)

Application Number Title Priority Date Filing Date
PCT/GB2007/001181 WO2007128957A1 (fr) 2006-04-10 2007-03-30 Procédé et appareil de traitement de données codées numériquement dans un flux afin de récupérer des parties de données situées à l'extérieur

Country Status (1)

Country Link
WO (1) WO2007128957A1 (fr)

Citations (5)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US5818935A (en) * 1997-03-10 1998-10-06 Maa; Chia-Yiu Internet enhanced video system
WO2000064172A1 (fr) * 1999-04-20 2000-10-26 Microsoft Corporation Procede d'autorisation ou d'inhibition de types choisis de declencheurs de diffusion
US20010052133A1 (en) * 2000-04-12 2001-12-13 Lg Electronics Inc. Apparatus and method for providing and obtaining product information through a broadcast signal
US20020108122A1 (en) * 2001-02-02 2002-08-08 Rachad Alao Digital television application protocol for interactive television
EP1521472A2 (fr) * 2003-09-25 2005-04-06 Sharp Kabushiki Kaisha Système et procédé d'indicateur d'URI pour la transmission des données MPEG-4 dans un flux de transport MPEG-2

Patent Citations (5)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US5818935A (en) * 1997-03-10 1998-10-06 Maa; Chia-Yiu Internet enhanced video system
WO2000064172A1 (fr) * 1999-04-20 2000-10-26 Microsoft Corporation Procede d'autorisation ou d'inhibition de types choisis de declencheurs de diffusion
US20010052133A1 (en) * 2000-04-12 2001-12-13 Lg Electronics Inc. Apparatus and method for providing and obtaining product information through a broadcast signal
US20020108122A1 (en) * 2001-02-02 2002-08-08 Rachad Alao Digital television application protocol for interactive television
EP1521472A2 (fr) * 2003-09-25 2005-04-06 Sharp Kabushiki Kaisha Système et procédé d'indicateur d'URI pour la transmission des données MPEG-4 dans un flux de transport MPEG-2

Non-Patent Citations (2)

* Cited by examiner, † Cited by third party
Title
VANG S ET AL: "The Emergence of Middleware in Home Telecommunication Equipment", IEEE COMMUNICATIONS MAGAZINE, IEEE SERVICE CENTER,NEW YORK, NY, US, 1 June 2001 (2001-06-01), pages 106 - 110, XP011091738, ISSN: 0163-6804 *
YONGSUK KIM ET AL: "Interactive broadcast terminal system using MPEG-2 and MPEG-4", CIRCUITS AND SYSTEMS, 2000. PROCEEDINGS. ISCAS 2000 GENEVA. THE 2000 IEEE INTERNATIONAL SYMPOSIUM ON MAY 28-31, 2000, PISCATAWAY, NJ, USA,IEEE, vol. 3, 28 May 2000 (2000-05-28), pages 682 - 685, XP010502623, ISBN: 0-7803-5482-6 *

Similar Documents

Publication Publication Date Title
KR101868280B1 (ko) 정보 처리 장치, 정보 처리 방법 및 컴퓨터 판독 가능한 기록 매체
US7769477B2 (en) Audio file format conversion
US20200234726A1 (en) Audio decoder, apparatus for generating encoded audio output data and methods permitting initializing a decoder
KR101885852B1 (ko) 컨텐트 전송 및 수신 방법 및 장치
KR102252484B1 (ko) 복합 네트워크에서 멀티미디어 데이터를 송수신하기 위한 장치 및 그 방법
JP2015527788A (ja) マルチメディアシステムにおける適応的メディア構造送信方法及び装置
JP2008136204A (ja) ＦｌｅｘＭｕｘストリームをストリーム形成、受信及び処理する装置及び方法
US20080154941A1 (en) Method of and apparatus for encoding/decoding multimedia data with preview function
TW201626803A (zh) 可拼接與被拼接之音源資料流以及拼接器及其方法、以及音源編碼與解碼裝置及方法
WO2002086894A1 (fr) Fonctions de lecture speciale pour mp3
GB2593897A (en) Method, device, and computer program for improving random picture access in video streaming
JP2021510047A (ja) メディアファイルの同期再生方法、装置及び記憶媒体
CN105611395A (zh) 一种mp4格式视频在线播放的方法及系统
CN113709510A (zh) 高速率数据实时传输方法及装置、设备、存储介质
KR100608059B1 (ko) Ｍｏｔ 데이터 복호 방법 및 장치
CN103430558A (zh) 用于优化视频流的方法
US9264720B2 (en) Apparatus and method for multimedia service
KR101295377B1 (ko) 파일 포맷을 구성하는 방법과 상기 파일 포맷을 가지는파일을 포함한 방송 신호를 처리하는 장치 및 방법
EP2812813B1 (fr) Procédés et systèmes pour fournir des données de fichiers pour un fichier multimédia
WO2007128957A1 (fr) Procédé et appareil de traitement de données codées numériquement dans un flux afin de récupérer des parties de données situées à l'extérieur
GB2437101A (en) Method and apparatus for processing digitally encoded data streams
US20110276662A1 (en) Method of constructing multimedia streaming file format, and method and apparatus for servicing multimedia streaming using the multimedia streaming file format
EP1568231B1 (fr) Procede d'enregistrement de donnees, procede pour la localisation d'ensembles de donnees, structure de donnees et support d'enregistrement
US20030083864A1 (en) File creating method and data reproduction method
US6701065B1 (en) Methods and apparatus for buffering information prior to decoding

Legal Events

Date Code Title Description
121 Ep: the epo has been informed by wipo that ep was designated in this application

Ref document number: 07732235

Country of ref document: EP

Kind code of ref document: A1

NENP Non-entry into the national phase

Ref country code: DE

122 Ep: pct application non-entry in european phase

Ref document number: 07732235

Country of ref document: EP

Kind code of ref document: A1