CN100525447C - Audio-video frequency media data organization realizing method of supporting precision positioning - Google Patents

Audio-video frequency media data organization realizing method of supporting precision positioning Download PDF

Info

Publication number
CN100525447C
CN100525447C CN 200510127655 CN200510127655A CN100525447C CN 100525447 C CN100525447 C CN 100525447C CN 200510127655 CN200510127655 CN 200510127655 CN 200510127655 A CN200510127655 A CN 200510127655A CN 100525447 C CN100525447 C CN 100525447C
Authority
CN
China
Prior art keywords
avs
program stream
frame
file
index
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Expired - Fee Related
Application number
CN 200510127655
Other languages
Chinese (zh)
Other versions
CN1980390A (en
Inventor
高文
陈熙霖
侯金亭
魏勇刚
呼大明
杨长水
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
National Source Coding Center Digital Audio And Video Frequency Technology (beijing) Co Ltd
Original Assignee
National Source Coding Center Digital Audio And Video Frequency Technology (beijing) Co Ltd
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by National Source Coding Center Digital Audio And Video Frequency Technology (beijing) Co Ltd filed Critical National Source Coding Center Digital Audio And Video Frequency Technology (beijing) Co Ltd
Priority to CN 200510127655 priority Critical patent/CN100525447C/en
Publication of CN1980390A publication Critical patent/CN1980390A/en
Application granted granted Critical
Publication of CN100525447C publication Critical patent/CN100525447C/en
Expired - Fee Related legal-status Critical Current
Anticipated expiration legal-status Critical

Links

Abstract

The method includes (1) traversing entire stream file of AVS program, building indexing information for all I frames, adding the indexing information to the end of the stream file of AVS program, and loading the indexing information before playing back AVS program stream; (2) based on operations such as fast locating, scene jumping, and quick dragging operations carried out by user to determine position and time of playing point; (3) using same proportion search method to find out PS packet containing I frame nearest to the playing point so as to find out initial position and timestamp of PS packet in AVS program stream file; (4) based on time and position of I frame of playing point, system locates relevant position of the AVS program stream automatically and carries out playing back operation. Advantages are: solving pinpoint issue, and guaranteeing standard AVS program stream.

Description

Support pinpoint audio-video frequency media data organization implementation method
Technical field
The present invention relates to a kind of relevant AVS media playing method of digital audio/video encoding and decoding standard that is used for areas of information technology, refer to that especially a kind of realization can pinpoint AVS media data playing method.
Background technology
The digital audio/video encoding and decoding standard is the general character basic standard of digital audio/video industry, has huge industry demand.At five to ten years of future, (high definition) Digital Television industry of China, high density compact disc industry, wideband multimedia application and 3G (Third Generation) Moblie industry became the important industry group who influences national economy with extensive high speed development.The 2008 Beijing Olympic Games will become the milestone of high definition television broadcasting and mobile multimedia application.
China digital audio/video encoding and decoding technique standard A VS (Audio Video codingStandard) that formulates that takes the lead has represented current international most advanced level.The AVS standard is that the digital audio/video industry chain (supply chain) of China's structure " technology → patent → standard → chip and software → complete machine and system's manufacturing → Digital Media operation and cultural industry " provides important opportunity.
The decoding of audio-video frequency media and broadcast are the piths of digital audio/video encoding and decoding technique standard, also are that the user uses maximum parts.Realize a kind of can having great importance for the industrialization that promotes AVS by pinpoint audio-video frequency media Play System.And at present, also do not have the pinpoint AVS media data playing method of a kind of realization.
Because AVS program stream (PS) file is made up of the bag of PS (program stream Program Stream) one by one, the PTS (PresentationTime Stamp) during audio video synchronization is wrapped by PES (Packetized Elementary Stream) finishes.Contain PTS in the PES bag that has, and do not have in the bag that has.Because PTS is a linear growth, and the code check of video sequence alters a great deal, and causes PTS to be non-linear appearance in program stream.This locatees, realizes scene hop, drags and bring certain trouble fast just for file fast.
Summary of the invention
The objective of the invention is to overcome the deficiencies in the prior art, a kind of be quick location, support scene hop that realizes the AVS program stream and the method that drags fast are provided.
The objective of the invention is to realize by the following technical solutions:
Support pinpoint audio-video frequency media data organization implementation method, comprise the steps:
1) the whole AVS program stream file of traversal is set up the index information of all I frames, and the end that this index information adds AVS program stream file to, is written into this index information in advance when playing the AVS program stream;
Wherein, the index information of setting up all I frames carries out as follows:
(1) index of definition item;
(2) definition AVS program stream file format adds the index marker symbol in original program stream end of file position;
(3) generate index entry;
2) according to the user locate fast, scene hop and operation such as drag fast, determine the position and the time of broadcast point;
3) according to step 2) in index information tabulation in the position of the broadcast point that obtains and the step 1), use search method in proportion to find bag, thereby find the PS at this I frame place to wrap in original position and timestamp (PTS) in the AVS program stream file from the PS at the nearest I frame place of broadcast point;
Wherein, described " using in proportion, search method finds from the nearest I frame of broadcast point " obtains by following steps:
(a) according to the position of broadcast point, system obtains approximate location and the time of this broadcast point in whole program stream;
(b) according to the approximate location that obtains in the step (a), in I frame index information list, find its approximate location according to same proportionate relationship, near this approximate location, find the most close index entry of time then;
(c) in step (b), find on the basis of index entry, directly from index entry, read position and the corresponding timestamp (PTS) of I frame in AVS program stream file;
4) according to the time and the position of the I frame of the broadcast point that obtains in the step 3), system navigates to the relevant position of AVS program stream automatically and plays.
Pinpoint AVS audio-video frequency media data organization of support provided by the invention and implementation method, by disposable traversal AVS program stream file in advance, set up the index file of I frame, on the basis of original program stream, at the ending place adding I of file frame index new range table; Then when being written into the AVS program stream at every turn, read in I frame index information list earlier, the user locate fast, scene hop and when operation such as dragging fast, system finds the I frame of broadcast point automatically in I frame index information, find the accurate position of this I frame in the AVS program stream, final system directly navigates to this position, and the PTS in the index of reference information realizes the synchronous playing of synchronized audio/video.
Compared with prior art, the invention has the advantages that:
The advantage of this method just is can disposable generation index information and be tied to the ending of program stream, both can solve pinpoint problem, guaranteed the standard of AVS program stream again, thereby function such as both can realize quick location, the scene hop of AVS program stream and drag fast in the broadcast that has accurate positioning function rises does not influence yet and does not support pinpoint broadcast to rise to play the AVS program stream simultaneously.Because index information and program stream are kept at together,, directly just can accurately navigate to corresponding position simultaneously according to accurate index information so need when each the broadcast, not travel through whole AVS program stream repeatedly.
Embodiment
Below in conjunction with the drawings and specific embodiments the present invention is described in further detail:
Support pinpoint AVS audio-video frequency media data organization and implementation method, comprise the steps:
1) the whole AVS program stream file of traversal is set up the index information of all I frames, and the end that this index information adds AVS program stream file to, is written into this index information in advance when playing the AVS program stream; With the C Plus Plus is example, and " the setting up the index information of all I frames " in this step 1) carried out as follows: the definition of (1) index entry:
The Index information definition is as follows:
struct?INDEXINFO{
LONGLONG llFilePoint; The defined point of // index position hereof;
LONGLONG l lCurrPts; First timestamp Pts behind the // adjacent file pointer;
}
Require: FilePoint points to the position that PS unwraps the beginning, comprises the initial code of an I frame in this bag.
(2) AVS program stream file format definition: add Index identifier FFFF in original PS end of file position, end position is 000001FA, and Idx Num is UINT type data, is illustrated in the number of index in this document, and is as shown in the table.
PS?File?Stream FF?FF Index?Table Idx?Num 00?00?01?FA
PS File Stream is an AVS file program stream in last table, and FF FF is the hexadecimal identifier that index entry begins, and 000001FA is the hexadecimal uniform of a specific trade symbol that index entry finishes, and Idx Num is all index entry tabulations.
(3) generation of index entry: those skilled in the art can generate the process of index according to existing techniques in realizing, repeat no more herein, but requiring llFilePoint item in the index entry must be the original position of PS bag, have in the file much owing to containing wrapping in of PTS simultaneously, when setting up index, should limit (32 Idex_Num can represent that at most 232 is 4G index) to sum, and final index number is presented in the Idx_Num item.The generative process of index can be introduced key frame recognizer or scene Recognition algorithm etc., but llFilePoint should be the original position of the PS bag at the I frame place before this frame.
2) according to the user locate fast, scene hop and operation such as drag fast, determine the position and the time of broadcast point;
3), use in proportion that search method finds the bag from the PS at the nearest I frame place of broadcast point, thereby find the PS at this I frame place to wrap in original position and timestamp in the AVS program stream file according to index information tabulation in the position and 1 of the broadcast point that obtains in 2;
" using in proportion, search method finds from the nearest I frame of broadcast point " in the step 3) obtains by following steps herein: (1) according to the position of broadcast point, system obtains approximate location and the time of this broadcast point in whole program stream;
(2) according to the approximate location that obtains in 1, in I frame index information list, find its approximate location, near this approximate location, find the most close index entry of time then according to same proportionate relationship;
(3) in 2, find on the basis of index entry, can directly from index entry, read position and the corresponding timestamp of I frame in AVS program stream file;
4) according to the time and the position of the I frame of the broadcast point that obtains in 3, system navigates to the relevant position of AVS program stream automatically and plays.
The present invention has different implementations in different platform, present embodiment is an example with the framework of DirectShow Filter, this process is described, playing program comprises three DirectShow Filter:File Reader, PS Demuxer, AVS Video Decoder, and concrete steps are as follows:
(1) in the initialized while of program start, File Reader is read into the information in the index information (Index Content) in the chained list, obtains new zero-time (StartTime) when action takes place when dragging;
(2) PS Demuxer removes to look into chained list according to this zero-time (Start Time), in chained list, find with the immediate current time stamp of this zero-time (currPts), find new file original position according to this current timestamp then, notice File Reader Filter is from new position reading of data, simultaneously send out message to AVS DecoderFilter, drag events has taken place in notice
(3) AVS Video Decoder drags after the message when receiving, decoding suspends, and waits pending data; If the data that obtain are sealing GOP, and contain I frame initial code (00 00 01 B3), then throw away the front end hash and begin decoding; If the data that obtain are sealing GOP, but do not contain the I frame in the packet, perhaps the I frame data are incomplete, then wait pending data; If the data that obtain are open GOP, that is to say that the P frame of I frame back might be with reference to the P frame before the I frame, decoder begins decoding from first I frame of receiving so, just begins later on to show separating second I frame, during this, exports with blank screen.Because flower screen phenomenon may appear in open GOP after restarting decoding, in general, open GOP restarts after the decoding, and image can recover normal behind second GOP.
Utilize method of the present invention that 150 hours AVS program stream is tested, the result shows that audio frequency and video keep synchronously, and reaches zero-lag, has realized and can accurately locate, the AVS playing programs of function such as support location, scene hop fast and drag fast.
The present invention has realized the pinpoint AVS audio-video frequency media data organization of a kind of support method, have simple in structure, realize simple, location characteristics such as location accurately and fast.Experiment shows the AVS Play System that the method for utilizing the present invention to propose is built, and is very easy to browsing of program, can realize the accurately Play System of location and zero-lag.
It should be noted last that above embodiment is only unrestricted in order to technical scheme of the present invention to be described.Although the present invention is had been described in detail with reference to embodiment, those of ordinary skill in the art is to be understood that, technical scheme of the present invention is made amendment or is equal to replacement, do not break away from the spirit and scope of technical solution of the present invention, it all should be encompassed in the middle of the claim scope of the present invention.

Claims (2)

1, supports pinpoint audio-video frequency media data organization implementation method, comprise the steps:
1) the whole AVS program stream file of traversal is set up the index information tabulation of all I frames, and the end that this index information adds AVS program stream file to, at first is written into this index information when playing the AVS program stream;
Wherein, the index information of setting up all I frames carries out as follows:
1-1. index of definition item;
1-2. definition AVS program stream file format adds the index marker symbol in original program stream end of file position;
1-3. generation index entry;
2) carry out rapid positioning operation, scene hop operation or quick drag operation according to the user, determine the position and the time of broadcast point;
3) according to step 2) in index information tabulation in the position of the broadcast point that obtains and the step 1), use search method in proportion to find program stream pack, thereby find original position and the timestamp of program stream pack in AVS program stream file at this I frame place from the nearest I frame place of broadcast point;
Wherein, described " using in proportion, search method finds from the nearest I frame of broadcast point " obtains by following steps:
3-1. according to the position of broadcast point, system obtains approximate location and the time of this broadcast point in whole program stream;
3-2. according to the approximate location that obtains in the step 1), in I frame index information list, find its approximate location, near this approximate location, find the most close index entry of time then according to same proportionate relationship;
3-3. in step 2) in find on the basis of index entry, directly from index entry, read position and the corresponding timestamp of I frame in AVS program stream file;
4) according to the time and the position of the I frame of the broadcast point that obtains in the step 3), system navigates to the relevant position of AVS program stream and plays.
2, according to the pinpoint audio-video frequency media data organization implementation method of the described support of claim 1, in DirectShow Filter framework, playing program comprises three DirectShow Filter:File Reader, PS Demuxer, AVS Video Decoder, and concrete steps are as follows:
(1) in the initialized while of program start, File Reader is read into the information in the index information in the chained list, obtains new zero-time when action takes place when dragging;
(2) PS Demuxer removes to look into chained list according to this zero-time, in described chained list, find with the immediate current time stamp of this zero-time, find new file original position according to this current timestamp then, notice FileReader Filter is from new position reading of data, simultaneously send out message to AVS Decoder Filter, drag events has taken place in notice;
(3) AVS Video Decoder drags after the message when receiving, decoding suspends, and waits pending data; If the data that obtain are sealing GOP, and contain I frame initial code, then throw away the front end hash and begin decoding; If the data that obtain are sealing GOP, but do not contain the I frame in the packet, perhaps the I frame data are incomplete, then wait pending data; If the data that obtain are open GOP, decoder just begins decoding from first I frame of receiving, just begins demonstration later on separating second I frame, during this, exports with blank screen.
CN 200510127655 2005-12-07 2005-12-07 Audio-video frequency media data organization realizing method of supporting precision positioning Expired - Fee Related CN100525447C (en)

Priority Applications (1)

Application Number Priority Date Filing Date Title
CN 200510127655 CN100525447C (en) 2005-12-07 2005-12-07 Audio-video frequency media data organization realizing method of supporting precision positioning

Applications Claiming Priority (1)

Application Number Priority Date Filing Date Title
CN 200510127655 CN100525447C (en) 2005-12-07 2005-12-07 Audio-video frequency media data organization realizing method of supporting precision positioning

Publications (2)

Publication Number Publication Date
CN1980390A CN1980390A (en) 2007-06-13
CN100525447C true CN100525447C (en) 2009-08-05

Family

ID=38131356

Family Applications (1)

Application Number Title Priority Date Filing Date
CN 200510127655 Expired - Fee Related CN100525447C (en) 2005-12-07 2005-12-07 Audio-video frequency media data organization realizing method of supporting precision positioning

Country Status (1)

Country Link
CN (1) CN100525447C (en)

Cited By (1)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US8875201B2 (en) 2008-03-19 2014-10-28 Huawei Technologies Co., Ltd. Method, device and system for implementing seeking play of stream media

Families Citing this family (25)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN101110247B (en) 2007-08-17 2011-04-20 华为技术有限公司 Playing method for audio files and device thereof
CN101202894B (en) * 2007-08-20 2011-11-30 深圳市同洲电子股份有限公司 Method, system for playing program sequence and digital television receiver
CN101262291B (en) * 2008-04-30 2010-04-07 中兴通讯股份有限公司 A method and device for realizing speed-varying playing media
CN101287107B (en) * 2008-05-29 2010-10-13 腾讯科技(深圳)有限公司 Demand method, system and device of media file
CN101888540B (en) 2009-05-13 2012-09-05 中兴通讯股份有限公司 Method and device for bearing transport streams TS in streaming media files
US8935320B2 (en) 2009-10-21 2015-01-13 Telefonaktiebolaget Lm Ericsson (Publ) Method, apparatus and system for media position control
CN102118539B (en) * 2009-12-30 2013-06-19 Tcl集团股份有限公司 Multimedia playing terminal as well as playing method and device for dragging multimedia files
CN102169709A (en) * 2010-12-08 2011-08-31 深圳市融创天下科技发展有限公司 Method and system for storing and positioning frame data, and terminal device
CN102137302A (en) * 2010-12-09 2011-07-27 华为技术有限公司 Method and device for playing video contents of streaming media
CN102131106A (en) * 2010-12-22 2011-07-20 华为技术有限公司 Method, device and system for playing streaming media contents
CN102231827B (en) * 2011-03-14 2013-03-06 新奥特(北京)视频技术有限公司 Indexing method capable of supporting direct and accurate positioning of frame of program stream (PS) media file
CN102880605B (en) * 2011-07-11 2017-12-08 上海聚力传媒技术有限公司 A kind of method, apparatus, equipment and system for being used to generate mixed seeding index information
CN102891997A (en) * 2011-07-20 2013-01-23 深圳市快播科技有限公司 Audio and video frequency multi-media file format for fast play, playing method and playing device
CN102325244B (en) * 2011-08-26 2014-02-19 杭州海康威视数字技术股份有限公司 Method for rapidly positioning videos by time, video storage control device and positioning device
CN102332284A (en) * 2011-08-29 2012-01-25 上海文广科技(集团)有限公司 Multimedia data processing method and processing system suitable for digital media broadcast
CN102761773A (en) * 2012-07-03 2012-10-31 Ut斯达康通讯有限公司 Method for improving user experience of IPTV (Internet Protocol Television) service by using I frames
CN102780919A (en) * 2012-08-24 2012-11-14 乐视网信息技术(北京)股份有限公司 Method for carrying out video location and displaying through key frame
CN103873891B (en) * 2014-03-20 2017-02-22 深圳创维-Rgb电子有限公司 TS streaming media file fast positioning method and system
CN103986978A (en) * 2014-04-14 2014-08-13 曦威胜科技开发(深圳)有限公司 Method for achieving functions of fast forward, fast backward and accurate Seek in HLS protocol in expanding mode
CN104053066B (en) * 2014-06-13 2017-08-08 无锡天脉聚源传媒科技有限公司 The method and device that a kind of video is got ready
CN109426603B (en) * 2017-08-21 2022-11-08 北京京东尚科信息技术有限公司 Method and device for analyzing application program blockage
CN108200434A (en) * 2017-12-25 2018-06-22 四川迪佳通电子有限公司 Flow media playing method and system
CN108683943A (en) * 2018-03-30 2018-10-19 晨星半导体股份有限公司 The method of electronic equipment and its positioning playing audio-video document
CN108737874A (en) * 2018-06-05 2018-11-02 武汉斗鱼网络科技有限公司 A kind of video broadcasting method and electronic equipment
CN109788372B (en) * 2019-01-24 2021-06-08 维沃移动通信有限公司 Streaming media playing method and related device

Cited By (1)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US8875201B2 (en) 2008-03-19 2014-10-28 Huawei Technologies Co., Ltd. Method, device and system for implementing seeking play of stream media

Also Published As

Publication number Publication date
CN1980390A (en) 2007-06-13

Similar Documents

Publication Publication Date Title
CN100525447C (en) Audio-video frequency media data organization realizing method of supporting precision positioning
US8818173B2 (en) Synchronous data tracks in a media editing system
CN109889882B (en) Video clip synthesis method and system
CN102215429B (en) Recording method for mobile TV
CN101842786A (en) Fast and editing-friendly sample association method for multimedia file formats
CN100520938C (en) Information storage medium storing still picture, reproducing apparatus and method therefor
CN1606001A (en) Information storage medium including event occurrence information, apparatus and method for reproducing the same
US20070031112A1 (en) Fast generation of a personalized DVD from a common template
CN103181164A (en) Method for content presentation during trick mode operations
CN1771553B (en) Storage medium in which audio-visual data with event information is recorded, and reproducing apparatus and reproducing method thereof
CN108429931A (en) A kind of method for broadcasting multimedia file and device
CN103391467A (en) Method for achieving synchronization of decoding and displaying of audio and video of network set-top box
CN102231827B (en) Indexing method capable of supporting direct and accurate positioning of frame of program stream (PS) media file
CN100531354C (en) Video frequency source material synthesizing method
CN105915965B (en) It is a kind of to broadcast single inspection method and device
JP4423551B2 (en) Broadcast recording / playback apparatus and broadcast recording / playback processing program
CN1647200B (en) Information edition device, information edition method, information edition program, information recording medium
CN101742302B (en) Method for demodulating and multiplexing multimode mpeg system layer
KR20080050998A (en) Apparatus and method for time-shift service based on multimedia information, apparatus for reproducing multimedia using that
CN101803378A (en) Method and apparatus for generating and accessing metadata in media file format
CN103647970A (en) Audio and video synchronization method and system for distributed transcoding
CN102231803B (en) Fault tolerant method for supporting TS streaming media file
CN100364327C (en) Information recording device, information reproduction device, information recording method, information reproduction method, information recording program, information reproduction program, and infor
CN102231847B (en) Direct and accurate frame positioning method supporting stream media files
CN100483533C (en) Information recording device, information reproduction device, information recording method, information reproduction method, information recording program, information reproduction program, and infor

Legal Events

Date Code Title Description
C06 Publication
PB01 Publication
C10 Entry into substantive examination
SE01 Entry into force of request for substantive examination
C14 Grant of patent or utility model
GR01 Patent grant
CF01 Termination of patent right due to non-payment of annual fee

Granted publication date: 20090805

Termination date: 20211207

CF01 Termination of patent right due to non-payment of annual fee