CN102231804B - Fault tolerance method supporting PS streaming media file - Google Patents

Fault tolerance method supporting PS streaming media file Download PDF

Info

Publication number
CN102231804B
CN102231804B CN 201110061161 CN201110061161A CN102231804B CN 102231804 B CN102231804 B CN 102231804B CN 201110061161 CN201110061161 CN 201110061161 CN 201110061161 A CN201110061161 A CN 201110061161A CN 102231804 B CN102231804 B CN 102231804B
Authority
CN
China
Prior art keywords
information
video
fault
secondary index
frame
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Expired - Fee Related
Application number
CN 201110061161
Other languages
Chinese (zh)
Other versions
CN102231804A (en
Inventor
杨珂
夏永宏
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
China Digital Video Beijing Ltd
Original Assignee
China Digital Video Beijing Ltd
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by China Digital Video Beijing Ltd filed Critical China Digital Video Beijing Ltd
Priority to CN 201110061161 priority Critical patent/CN102231804B/en
Publication of CN102231804A publication Critical patent/CN102231804A/en
Application granted granted Critical
Publication of CN102231804B publication Critical patent/CN102231804B/en
Expired - Fee Related legal-status Critical Current
Anticipated expiration legal-status Critical

Links

Images

Abstract

The invention discloses a fault tolerance method supporting PS streaming media file and solves a problem that format defect of different PS streaming media files existing in record and transmission can not satisfy frame accuracy positioning in non-linear editing processing. The fault tolerance method comprises the following steps: reading a streaming media file from file header and determining a real and effective object video and audio frequency data block; according to the determined data block, determining basic file header information and reserving first order index unit project space; parsing the object data block and establishing a secondary index unit project combined with a correction mode; according to secondary index unit project information, generating a first order index unit project and backfilling the first order index unit project to the first order index unit project space. Through the above fault tolerance method, supplementing key frame unit basic information and carrying out a correction operation in PS streaming are realized, and format defect of PS streaming media files existing in processes of packaging, transmission and decoding is effectively corrected to ensure operations of correct edit, play and the like.

Description

A kind of fault-tolerance approach of supporting the PS files in stream media
Technical field
The present invention relates to program making and Non-linear Editing Technique field, relate in particular to a kind of fault-tolerance approach of the PS of support files in stream media.
Background technology
Along with being widely used of the Internet, utilize the demand of Internet Transmission sound and vision signal also more and more, the media programs such as radio and television also need to issue by the Internet audio/video program of oneself day by day.But, audio frequency and video process and communication process in, often easily interrupted and caused discontinuously, cause the file of including or preserving as the material source imperfect, and the restriction that can be subject to preserving the document carrier capacity, restrict its use.In network transmission process, need the long transmission time to carry out transmission of video, caused not good user to experience, for some user, the not omnidistance program of watching, and be checking of jumping characteristic, but system still can expend very large Internet resources, all videos file is downloaded, caused the great wasting of resources.The appearance of stream media technology makes the situation of internet transmission audio frequency and video difficulty improve to a certain extent.The mode of traditional multimedia messagess such as Internet Transmission audio frequency and video is to play after downloading fully again, downloads and usually will spend several minutes a few hours even.And the employing stream media technology, just can realize stream transmission, with sound, image or animation by server to subscriber computer carry out continuously, the uninterrupted transmission, the user needn't wait until that whole file all downloads completely, and only need can watch through the startup time-delay of several seconds or tens seconds.When playing on the machines the user such as sound video, the remainder of file also can continue to download from server.
Mpeg standard is as the digital video, the audio standard that are widely used now, is widely used in Digital Television, real-time multimedia monitoring processing, mobile multimedia communication, mutual multimedia application, performs in a radio or TV programme the field such as TV.thereby also extensively be used in non-linear volume montage software and look audio frequency later stage special effect processing and composite software, Making Movies, advertisement, in the image/video processing procedure of film clips etc., therefore often need to call the mpeg standard video material processes, needs in the face of real-time video transmission, and the development of high-performance video decode technology, stream media technology also will be used in the mpeg standard file handling procedure, the transmission of mpeg standard files in stream media is by video delivery server, program to be sent as packet, be sent on network, after the user carries out decompress(ion) by decompression apparatus to these data, program will show as before sending, during the stream transmission of Streaming Media, sound, the time-base media such as image or animation by audio/video server to subscriber computer continuously, transmit in real time, the user needn't wait until whole file, and all download is complete, and only need can watch through the startup time-delay of several seconds or ten several seconds.
Reportedly the quality of defeated media is different, defined program stream (PS:ProgramStream) transmission means in MPEG-2, wherein the pack arrangement of PS stream is variable-length, therefore, in case the synchronizing information of a certain PS bag is lost, receiver can't be determined the sync bit of next bag, will cause step-out, causes serious information dropout.Therefore, and better at channel circumstance, when transmission error code is low, generally adopt PS code stream such as DVD format media file etc., but after PS stream file transmission success, the form of its file can be more complete, can better reduce the form of media file.
But because processing file, nonlinear video need to have reference format, therefore find in actual application based on the media file of PS form through encapsulation, Internet Transmission, and decoding after, be directly used in the nonlinear video processing and can have code error, or the mistake that impact is play occurs, therefore just need to be by in setting up the video file Index process, this type of situation is carried out fault-tolerant processing, address the above problem.Thereby guarantee that files in stream media can normally use under the non-linear editing environment.
Summary of the invention
For the defective that exists in prior art and deficiency, the fault-toleranr technique that the purpose of this invention is to provide a kind of PS of support, files in stream media, to realize the correct use of media file in the nonlinear video processing procedure based on the mpeg standard form, comprise and support PS Streaming Media type, carry out fault-tolerant processing, improve the correct usage of file.
For achieving the above object, the invention provides a kind of fault-toleranr technique of files in stream media: at first, after the reading flow media file, determine target data block; According to the target data block of determining, determine the constituent instruments header afterwards, and reserve one-level indexing units project space; Resolve target data block, by correcting mode, set up secondary index unit project; Generate one-level indexing units project according to described secondary index unit project information at last, and be backfilling in above-mentioned one-level indexing units project space.
Therefore by correctly setting up the secondary index data structure, give revisal to the form defective that exists in original.
For PS stream (transport stream) transmission means, the present invention proofreaies and correct mainly for additional key frame unit essential information defective.
the embodiment of the present invention provides a kind of support PS files in stream media pinpoint tolerant system, comprising: the Streaming Media loading system, extract media data information system, streaming media video, the audio decoding system of first record of retrieval, fault-tolerance processing system, the index file generation system, wherein, the media data information of first record of described extraction retrieval comprises video, audio-frequency information, described index file generation system comprises: one-level indexing units generation system, secondary index unit generation system, described one-level indexing units generation system comprises: the file header essential information, video GOP one-level indexing units, video Payload one-level indexing units, audio frequency one-level indexing units, described secondary index unit generation system comprises: video GOP secondary index, the Payload secondary index, the audio frequency secondary index, the Video segmentation data record, described fault-tolerance processing system comprises: the fault-tolerance processing system that replenishes key frame unit essential information, above system can also comprise the broadcast loading system.
The embodiment of the present invention provides a kind of PS of support files in stream media pinpoint fault-tolerant player method: comprising: load the Streaming Media index file; According to accurate frame alignment result, load files in stream media; Decompose files in stream media; Loading decoder plays; More than can also comprise: carry out the frame alignment retrieval by imposing a condition; Described decomposition files in stream media can be decomposed into video stream file, audio stream file; Described loading index file can be divided into loading one-level index file, load the secondary index file; Described loading decoder is play, and it loads decoder decoded video stream file, audio stream file, carries out video, audio frequency broadcast.
Compared with prior art, at first, after the media file that the invention solves the mpeg standard form transmits by the Media Stream mode, improved the availability of this class file for the nonlinear video processing procedure, next, but there is the solution of defective in the media file of the present invention's specification handles mpeg standard form in editor, encapsulation process.
Description of drawings
Technical scheme for the clearer explanation embodiment of the present invention, during the below will describe embodiment, the accompanying drawing of required use is done simple the introduction, apparent, accompanying drawing in the following describes is only some embodiments of the present invention, for those of ordinary skills, under the prerequisite of not paying creative work, can also obtain according to these accompanying drawings other accompanying drawing.
Fig. 1: a kind of PS of support files in stream media described in the embodiment of the present invention one generates secondary rope file and is used for realizing fault-tolerant generation schematic diagram;
Fig. 2: a kind of fault-tolerance approach schematic diagram of supporting the additional key frame of support unit essential information in PS files in stream media generation secondary rope file described in the embodiment of the present invention two;
Fig. 3: a kind of schematic diagram of supporting the pinpoint tolerant system of PS files in stream media described in the embodiment of the present invention three;
Fig. 4: a kind of schematic diagram of supporting the pinpoint player method of PS files in stream media described in the embodiment of the present invention four;
Fig. 5: in the embodiment of the present invention, the broadcast of Streaming Media loads schematic diagram;
Fig. 6: the present invention realizes the fault tolerance schematic diagram;
Embodiment
Below in conjunction with the accompanying drawing in the embodiment of the present invention; technical scheme in the embodiment of the present invention is carried out clear, complete description; obvious described embodiment is only a part of embodiment of the present invention; not whole embodiment; based on the embodiment in the present invention; those of ordinary skills belong to the scope of protection of the invention not paying the every other embodiment that obtains under the creative work prerequisite.
The present invention proposes after the streaming media of mpeg standard form, sets up in the process of secondary index the data that affects Nonlinear Processing are carried out fault-tolerant processing, has guaranteed correct data use, is elaborated below by embodiment:
Embodiment one:
With reference to Fig. 1, be that a kind of PS of support files in stream media described in the embodiment of the present invention one generates secondary rope file for realizing fault-tolerant generation schematic diagram;
Concrete steps are as follows:
after obtaining one section PS stream medium data by the PS streaming media, system will resolve this stream medium data, and main purpose is first effective video data message, first the effective voice data information of length of defining from the user, and prepare for setting up index file simultaneously, tentatively set up to comprise: the one-level index file project of file header, video GOP index, video Payload index, audio index project, and reserve the respective item space, afterwards the bag data block is resolved, according to the PID that resolves before (claiming again StreamID) value to " block of video data, audio data block, other data blocks, divide classification, wherein the every frame data in block of video data are sorted out, and deposit in video Payload index, and therefrom check whether be video GOP (key frame) data, and result is separately deposited in video GOP index, information in corresponding audio data block is deposited and is put in audio index, after detection is completed to an effective video data block, namely can analyze Sequenceheader, the basic GOP information such as Picture Header, represent that a valid data piece finishes dealing with, so far an effective secondary index file essential information generates, after the information of secondary index file data unit reaches default size, its information is backfilling in above-mentioned one-level index item, as can be seen from the above analysis, the foundation of secondary index file is the critical process of understanding the PS file, therefore main fault-tolerant processing also will judge and complete when set up secondary index unit project, overall fault-tolerant flow process please refer to shown in Figure 8.
Embodiment two:
With reference to Fig. 2, it is the fault-tolerance approach schematic diagram that a kind of PS of support files in stream media described in the embodiment of the present invention two generates the additional key frame of support unit essential information in secondary rope file;
Concrete steps are as follows:
At first, resolve time tag (PTS, the DTS) information of key frame in same video stream data piece; Whether verification exists the key frame of not free label (PTS, DTS), and judges whether its adjacent B frame exists PTS, DTS unit information; Generate key frame PTS, DTS unit information as existing by following account form;
Wherein: before pts value=rear frame, the pts value of last adjacent frame deducts the time quantum that a frame continues; The time quantum that the cumulative frame of DTS value=former frame DTS value continues; (regardless of key frame or normal frames)
Generate corresponding time tag (PTS, DTS) with above, and as the time tag of described key frame.
Embodiment three:
With reference to Fig. 3, be the schematic diagram of the pinpoint tolerant system of a kind of PS of support files in stream media described in the embodiment of the present invention three, specifically comprise:
The Streaming Media loading system; Extract the media data information system of first record of retrieval; Streaming media video, audio decoding system; Fault-tolerance processing system; The index file generation system; The annexation of its various piece as shown in the figure.
Wherein, in the Streaming Media loading system, can carry out the retrieval of files in stream media according to default querying condition;
In the media data information system of first the record that extract to extract retrieval; Information Monitoring comprises video, audio-frequency information, and file header essential information that will be wherein writes in the file header of one-level index file and reserves video GOP one-level indexing units space, video Payload one-level indexing units space, audio frequency one-level indexing units space;
In fault-tolerance processing system, can process by the method put down in writing in the present invention the fault-tolerant processing of inserting the key frame sequence number, inserting the video decoding unit essential information, frame time label basic point is proofreaied and correct;
In the indexed file generation system, described block of video data, audio data block recorded data are recorded in the secondary index file, comprising: video GOP secondary index project, Payload secondary index project, audio frequency secondary index project, Video segmentation data record, and by the pre-set threshold value program, the secondary index docuterm is write in the one-level index item;
Should be noted that for those skilled in the art, based on the thought of above system processing method, by the method for simple replacement, reach the simple in-order adjustment, should belong to the present invention program's protection range.
Embodiment four:
With reference to Fig. 4, be the schematic diagram of the pinpoint player method of a kind of PS of support files in stream media described in the embodiment of the present invention four, specifically comprise:
Load the Streaming Media index file; According to accurate frame alignment result, load files in stream media; Decompose files in stream media; Loading decoder plays.
Wherein, loading the Streaming Media index file is the secondary index file, according to accurate frame alignment result, load in the files in stream media step, can retrieve by carry out frame alignment by imposing a condition, can be namely from the retrieval of file start-up portion, also can retrieve from the file middle part simultaneously; Decompose files in stream media and be video stream media file, audio stream media file, and load respectively Video Decoder, audio decoder, and become respectively video output, and audio frequency output.
With reference to Fig. 5, the broadcast that is Streaming Media in the embodiment of the present invention loads schematic diagram, wherein signal is broadcasted the loading sequence of frame number according to different units, respectively from one-level indexing units sensing secondary index unit, and circular test file data intercept information, to former stream medium data unit carrying out correct reduction.

Claims (19)

1. support the pinpoint fault-tolerance approach of PS files in stream media for one kind, it is characterized in that, comprising:
After reading the PS files in stream media, determine target data block according to the media data information of first the record of retrieving;
Read the constituent instruments information of described target data block, and according to described constituent instruments information reservation one-level indexing units project space;
Resolve described target data block according to transport stream StreamID value, in conjunction with correcting mode, set up secondary index unit project;
Generate one-level indexing units project according to described secondary index unit project information, and be backfilling in above-mentioned one-level indexing units project space;
Described correcting mode comprises: replenish key frame unit essential information;
Described additional key frame unit essential information comprises:
Resolve PTS, the DTS information of key frame in the block of video data in same StreamID value;
If have the key frame that there is no PTS, DTS information, judge whether adjacent B frame exists PTS, DTS information;
Generate key frame PTS, DTS information as existing by following account form;
The chronomere that pts value-a frame of last the B frame before the P frame of pts value=appearance afterwards continues;
The chronomere that the B frame DTS value of DTS value=before+frame continues;
With above generation PTS, DTS information, be written back in described key frame.
2. fault-tolerance approach according to claim 1 is characterized in that:
The media data information of described first record according to retrieving comprises: video data information, voice data information.
3. according to claim 1 or 2 described fault-tolerance approaches is characterized in that:
Reserving the one-level indexing units according to described constituent instruments information comprises: file header essential information, video GOP one-level indexing units, video Payload one-level indexing units, audio frequency one-level indexing units.
4. according to claim 1 and 2 fault-tolerance approach is characterized in that: resolve target data block and comprise:
Block of video data; Audio data block; Other data blocks.
5. fault-tolerance approach according to claim 1 is characterized in that: the described secondary index unit project of setting up comprises: video GOP secondary index, Payload secondary index, audio frequency secondary index, Video segmentation data record.
6. fault-tolerance approach according to claim 5 is characterized in that: described Video segmentation data record can the effective video record obtains by recording first.
7. fault-tolerance approach according to claim 5 is characterized in that: described video GOP secondary index by to video Payload secondary index group judgement determine.
8. fault-tolerance approach according to claim 3 is characterized in that block of video data can determine according to StreamID value in the media data information file of first record of described retrieval.
9. fault-tolerance approach according to claim 3 is characterized in that audio data block can determine according to StreamID value in the media data information file of first record of described retrieval.
10. fault-tolerance approach according to claim 3 is characterized in that other data blocks can determine according to StreamID value in the media data information file of first record of described retrieval.
11. fault-tolerance approach according to claim 1 or 5 is characterized in that: describedly generate one-level indexing units project according to described secondary index unit project information, comprise video Payload index item, video GOP index item, audio index project.
12. fault-tolerance approach according to claim 1 is characterized in that: described according to described secondary index unit project information generation one-level indexing units project, can pass through the corresponding one-level indexing units project of secondary index unit project settings threshold values acquisition.
13. fault-tolerance approach, is characterized in that: comprise end-of-file information is write in described constituent instruments header according to claim 1 or 5.
14. support the pinpoint tolerant system of PS files in stream media for one kind, it is characterized in that, comprising:
The Streaming Media loading system is used for carrying out the retrieval of files in stream media according to default querying condition;
Extract the media data information system of first record of retrieval;
Streaming media video, audio decoding system;
Fault-tolerance processing system be used for to insert the key frame sequence number, the fault-tolerant processing of inserting the video decoding unit essential information, frame time label basic point being proofreaied and correct;
Described fault-tolerance processing system comprises: the fault-tolerance processing system that replenishes key frame unit essential information;
The concrete steps of described additional key frame unit essential information comprise: PTS, the DTS information of resolving key frame in the block of video data in same StreamID value;
If have the key frame that there is no PTS, DTS information, judge whether adjacent B frame exists PTS, DTS information;
Generate key frame PTS, DTS information as existing by following account form;
The chronomere that pts value-a frame of last the B frame before the P frame of pts value=appearance afterwards continues;
The chronomere that the B frame DTS value of DTS value=before+frame continues;
With above generation PTS, DTS information, be written back in described key frame;
The index file generation system is used for block of video data, audio data block recorded data are recorded to the secondary index file, and by the pre-set threshold value program, the secondary index docuterm is write in the one-level index item.
15. the tolerant system according to claim 14 is characterized in that:
The media data information of first record of described extraction retrieval comprises video, audio-frequency information.
16. the tolerant system according to claim 14 is characterized in that:
Described index file generation system comprises: one-level indexing units generation system, secondary index unit generation system.
17. the tolerant system according to claim 16 is characterized in that:
Described one-level indexing units generation system comprises: file header essential information, video GOP one-level indexing units, video Payload one-level indexing units, audio frequency one-level indexing units.
18. the tolerant system according to claim 16 is characterized in that:
Described secondary index unit generation system comprises: video GOP secondary index, Payload secondary index, audio frequency secondary index, Video segmentation data record.
19. the tolerant system according to claim 14 is characterized in that: comprise the broadcast loading system.
CN 201110061161 2011-03-14 2011-03-14 Fault tolerance method supporting PS streaming media file Expired - Fee Related CN102231804B (en)

Priority Applications (1)

Application Number Priority Date Filing Date Title
CN 201110061161 CN102231804B (en) 2011-03-14 2011-03-14 Fault tolerance method supporting PS streaming media file

Applications Claiming Priority (1)

Application Number Priority Date Filing Date Title
CN 201110061161 CN102231804B (en) 2011-03-14 2011-03-14 Fault tolerance method supporting PS streaming media file

Publications (2)

Publication Number Publication Date
CN102231804A CN102231804A (en) 2011-11-02
CN102231804B true CN102231804B (en) 2013-06-05

Family

ID=44844331

Family Applications (1)

Application Number Title Priority Date Filing Date
CN 201110061161 Expired - Fee Related CN102231804B (en) 2011-03-14 2011-03-14 Fault tolerance method supporting PS streaming media file

Country Status (1)

Country Link
CN (1) CN102231804B (en)

Families Citing this family (1)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN105242718B (en) * 2015-10-30 2017-11-14 珠海格力电器股份有限公司 The temprature control method and device of the controllable silicon of rice cooker

Family Cites Families (4)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US8261312B2 (en) * 2008-06-27 2012-09-04 Cisco Technology, Inc. Linear hint video streaming
US9955107B2 (en) * 2009-04-23 2018-04-24 Arris Enterprises Llc Digital video recorder recording and rendering programs formed from spliced segments
CN101909049A (en) * 2009-12-17 2010-12-08 新奥特(北京)视频技术有限公司 Method and system for quickly searching and playing stream media data
CN101917388A (en) * 2009-12-17 2010-12-15 新奥特(北京)视频技术有限公司 Streaming media data storage method and device

Also Published As

Publication number Publication date
CN102231804A (en) 2011-11-02

Similar Documents

Publication Publication Date Title
WO2016184229A1 (en) Method and system for recording live video
US8559788B2 (en) Process for placing a multimedia object in memory, data structure and associated terminal
US10715571B2 (en) Self-adaptive streaming medium processing method and apparatus
EP2731346A2 (en) Micro-filtering of streaming entertainment content based on parental control setting
CN102215429B (en) Recording method for mobile TV
US20050169303A1 (en) Multiplex scheme conversion apparatus
EP2214398B1 (en) A method for processing an audio/video stream
CA2842810C (en) Fragmenting media content
US20090232469A1 (en) Method and apparatus for re-constructing media from a media representation
US8989280B2 (en) Frame identification
US9883216B2 (en) Method and apparatus for carrying transport stream
CN103491430A (en) Streaming media data processing method and electronic device
US20190007754A1 (en) Identification and timing data for media content
TW201417570A (en) Scene control system and method and recording medium thereof
US8887225B2 (en) Method and apparatus for reproducing broadcast content, and method and apparatus for providing broadcast content
CN102231804B (en) Fault tolerance method supporting PS streaming media file
CN102231803B (en) Fault tolerant method for supporting TS streaming media file
US20180295395A1 (en) Method for splicing video content into livestreams
CN102857812B (en) A kind of fault-tolerance approach supporting TS files in stream media and system
US20060210248A1 (en) Information recording apparatus and information
US20220182688A1 (en) Systems, methods, and devices for video stream signal analysis
CN103875252A (en) Method for displaying contents, method for synchronizing contents, and method and device for displaying broadcast contents
US20080235401A1 (en) Method of storing media data delivered through a network
JP2011244268A (en) Broadcast apparatus, broadcast receiver, broadcast method, and broadcast reception method
CN102231847B (en) Direct and accurate frame positioning method supporting stream media files

Legal Events

Date Code Title Description
C06 Publication
PB01 Publication
C10 Entry into substantive examination
SE01 Entry into force of request for substantive examination
C14 Grant of patent or utility model
GR01 Patent grant
CF01 Termination of patent right due to non-payment of annual fee

Granted publication date: 20130605

Termination date: 20180314

CF01 Termination of patent right due to non-payment of annual fee