CN100382549C - System for realizing multi data source flow media on-line view - Google Patents

System for realizing multi data source flow media on-line view Download PDF

Info

Publication number
CN100382549C
CN100382549C CNB200610034961XA CN200610034961A CN100382549C CN 100382549 C CN100382549 C CN 100382549C CN B200610034961X A CNB200610034961X A CN B200610034961XA CN 200610034961 A CN200610034961 A CN 200610034961A CN 100382549 C CN100382549 C CN 100382549C
Authority
CN
China
Prior art keywords
media
data source
data
module
key frame
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Expired - Fee Related
Application number
CNB200610034961XA
Other languages
Chinese (zh)
Other versions
CN1852283A (en
Inventor
罗笑南
凌若天
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
Sun Yat Sen University
Original Assignee
Sun Yat Sen University
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Sun Yat Sen University filed Critical Sun Yat Sen University
Priority to CNB200610034961XA priority Critical patent/CN100382549C/en
Publication of CN1852283A publication Critical patent/CN1852283A/en
Application granted granted Critical
Publication of CN100382549C publication Critical patent/CN100382549C/en
Expired - Fee Related legal-status Critical Current
Anticipated expiration legal-status Critical

Links

Images

Landscapes

  • Data Exchanges In Wide-Area Networks (AREA)

Abstract

The present invention provides a system for realizing online browse of streaming media with multiple data sources, which comprises a network service module, a media information acquiring module, a media information buffer, integration module, a QoS analyzing and controlling module and a key frame analyzing module. By the cooperation among the modules, the online browse of the media with stable transmission and high quality can be realized.

Description

A kind of system that realizes multi data source flow media on-line view
Technical field
The invention belongs to digital home network technical field and multimedia technology field, particularly relate to a kind of system of Streaming Media online browse.
Technical background
Streaming Media is meant in Internet/Intranet the continuous media that uses the stream transmission technology, as audio frequency, video, text, picture etc. at interior multimedia file.The utilization stream media technology is put into files in stream media on the Internet Server, allows client (comprising browser) download and watch, listen on one side, just can not watch immediately and the download of whole multimedia file such as do not need to finish.
The key technology that Streaming Media is realized is transmitted as a stream exactly.In general, stream comprises two kinds of implications: sensu lato stream is to make Voice ﹠ Video form the general name of a series of technology, method and the agreement of stable and continuous transport stream and playback stream, is referred to as stream media system traditionally; And sense stricto stream is a kind of media formats for traditional download-playback (Download-Playback) mode, can obtain continuous media streams such as Voice ﹠ Video from Internet, the user can receive the limit broadcast by edge joint, and time-delay is significantly reduced.
The fast development of Internet and popularize to the streaming media service development powerful market forces, the streaming media service increased popularity that just becoming is provided.Stream media technology is widely used in the every aspect of internet information services such as multimedia news briefing, online live, the web advertisement, ecommerce, video request program (VOD), long-distance education, tele-medicine, network radio station, real-time video meeting.
Nowadays very many online stream media play systems have been arranged, the system that typical C/S, B/S structure are arranged is as Windows MediaPlayer, players such as Realplayer, just can be used as in client or the embedded web page, play in real time from the online media information that obtains of server.But the system of this C/S, B/S structure, since the network condition of burst and the upper limit of server-capabilities, the smooth inadequately stable situation of the service that exists.
The online Media Play System that many P2P are also arranged now, online number of watching is many more simultaneously on this Systems Theory, and service quality is just good more, and the media information that obtains is just smooth more.In fact this effect has also been accomplished by this system, as playout softwares such as PPLive, CoolStreaming, in playing ordinary tv programme very large advantage is arranged.Few, just do not reach the purpose of desirable result of broadcast but if this system exists online number of watching.Simultaneously because the system of this a kind of P2P, the source of data is not a server, Data Source all is other clients generally speaking, media data is transferred to a client earlier, could be forwarded to media information in the local client by a plurality of clients again, so just cause the time-delay of big program.
The online multimedia technology is in the past because the restriction of bandwidth, fail on network, extensively to use, nowadays basic technology is ripe, nowadays the bandwidth of the Internet can satisfy the needs that online multimedia is browsed substantially, though the network bandwidth is increasing, data quantity transmitted is also in quick growth in the network.The not basic situation that solves network congestion of the increase of bandwidth, still can not accurately predicting when the network in what location congestion phenomenon will appear.The Internet just can obtain smooth multimedia effect because the online browse multimedia messages need be stablized fast, and congestion phenomenon also will reduce user's impression greatly once in a while.Simultaneously, present multimedia browser technology, no matter be the solution of C/S structure, or the solution of P2P, all need from data source a certain amount of media information of buffer memory to prevent network congestion once in a while, but the cache-time of opening before the program is all not fully up to expectations, buffer memory means that program has bigger time-delay for a long time, the media program of having relatively high expectations for real-time, as the athletic competition program, significantly time-delay sometimes cannot be accepted, because late result of the match usually allows the people feel discontented.
To this, need a kind of stable transfer, high-quality online Media navigation scheme of obtaining.
Summary of the invention
The objective of the invention is to overcome the difference of prior art, proposed the system of a kind of stable transfer, high-quality multi data source flow media on-line view.
In order to realize goal of the invention, the technical scheme of employing is as follows:
A kind of system that realizes multi data source flow media on-line view is provided with as lower module:
Be responsible for network service module with the data source of stream media interaction data;
Obtain the media information acquisition module of data from the data source of stream media on the network by network service module;
Be used to store two or more media information buffers of the data of being obtained from the various flows media data source;
With the data recombination of media information buffer and be sent to the integrate module of playback terminal;
And QoS analysis and Control module and key frame analysis module.
In the technique scheme, the quantity of set media information buffer is no less than the quantity of data source of stream media.
Described QoS analysis and Control module by analyze each media information buffer from data source of stream media, obtain the transmission speed of packet, packet loss in the data packet transmission decide each media information buffer from data source of stream media, to obtain how many data and obtain which part data.
Described QoS analysis and Control module according to the different sizes of obtaining data from data source of stream media of controlling of the network connection speed of each data source of stream media, for the slower data source of connection speed, give less relatively data acquisition task; For the desirable data source of speed, then give more relatively data acquisition task.
Described key frame analysis module, comes the media information of various flows media data source is carried out time synchronized according to the time difference that obtains identical key frame from the various flows media data source by extracting the key frame feature of the data of obtaining from data source of stream media.
The key frame feature of described key frame analysis module adopts image information relevant.
The function that each module of the present invention realized is specific as follows:
Network service module is responsible for and online data source of stream media interaction data.The network service part all is to be responsible for by this module.And the main modular that communicates with is the media information acquisition module.Media information acquisition module informing network service module need obtain any data from which data source of stream media, network service module returns to the media information that the media information acquisition module needs as requested.
Described media information acquisition module receives the control information of QoS control module, and the media information acquisition module, is stored in the different media information buffers from the different pieces of information source that network obtains according to these control informations.
The present invention is for each different media information data source, and independently buffer is corresponding with it all to generate one.By the media information acquisition module, the information of obtaining from different data sources is deposited in the different media information buffers.Content in each media information buffer is also inequality, so need resequence all contents again, form output with single Streaming Media, at media player, this is a single data flow, rather than, reach architecture to the transparent purpose of player by the data flow that each media information buffer is formed.
Described QoS analysis and Control module is by analyze each media information buffer transmission speed of obtaining packet from data source of stream media, the information such as packet loss in the data packet transmission, determine how many data each buffer queue obtains from data source of stream media, obtain which the part data.QoS analysis and Control module is different according to the connection speed of each current computer and each data source of stream media also, for slow data source, then give less relatively data acquisition task; For the desirable data source of speed, then give more relatively data acquisition task.QoS analysis and Control module is crucial module among the present invention, and the quality of media play, smooth degree are all influenced by this module.
Described key frame analysis module is by extracting the feature of key frame, characteristic information is kept in the media information buffer, when analyzing in the homogeneous turbulence media data source never when obtaining identical feature, just think and constantly obtained identical key frame from two stream medium data source servers in difference, according to the time difference that obtains identical key frame from different servers, come the media information in these different pieces of information sources is carried out time synchronized like this.
That the key frame characteristic that the key frame analysis module is analyzed out has is irrelevant with resolution, irrelevant with color depth, with the irrelevant character of the brightness of key frame, it is only relevant with the content of picture to analyze the key frame characteristic of coming out.
Technical characterstic of the present invention mainly embodies as follows:
1, can from a plurality of streaming media servers of the same program of correspondence, obtain media information simultaneously.
In the Internet, a plurality of data source of stream media are arranged, and identical program right and wrong usually see playing, and use when playing these online Media from single server by traditional media player, and speed usually can not satisfy the requirement of use.Sacrifice media quality or the bigger caching mechanism of foundation all can not be dealt with problems.This is not stable because of network conditions, and perhaps certain section link is very congested in a certain period, but after the congested phase, it is normal that network condition is recovered again.The present invention is by visiting a plurality of streaming media servers simultaneously, simultaneously never obtain different data in the homogeneous turbulence media server, by QoS analysis and Control module, can reach the purpose of avoiding congested section link again, to obtain the online Media play quality of stabilised quality.
2, inside structure is transparent to media player.
Though architectural framework of the present invention is to obtain different data from a plurality of data source of stream media, the architectural framework of this multi-data source is transparent to player.After the data in each media information buffer being integrated, just be sent to player, so for player, it is still identical with the workflow of playing single data source by information integrated module.
3, possesses good autgmentability.
What the present invention provided is the modular design of dividing by function, under the situation of following whole framework context constraint, can flexible configuration realize each module.As QoS analysis and Control module, can substitute original strategy with new analysis and Control strategy; The key frame analysis module also can be by changing original strategy with other analysis strategy, to reach the purpose of raising speed or minimizing resource overhead.
Description of drawings
Fig. 1 is a structural representation of the present invention;
Fig. 2 is applied to schematic diagram on the network for the present invention.
Embodiment
The present invention is described further below in conjunction with accompanying drawing.
Structural representation of the present invention is made up of network service module, media information acquisition module, media information buffer, integrate module, QoS analysis and Control module, key frame analysis module as shown in Figure 1.
Described network service module is connected with media server on the network, is responsible for carrying out alternately with the data source of stream media of server.
Described media information acquisition module is connected with network service module, the informing network service module need obtain any data from which data source of stream media, network service module returns to the media information that the media information acquisition module needs as requested, and the media information acquisition module is deposited in media information in the different media information buffers.
Described QoS analysis and Control module is by analyze each media information buffer transmission speed of obtaining packet from data source of stream media, the information such as packet loss in the data packet transmission, determine how many data each buffer queue obtains from data source of stream media, obtain which the part data.QoS analysis and Control module is different according to the connection speed of each current computer and each data source of stream media also, for slow data source, then give less relatively data acquisition task; For the desirable data source of speed, then give more relatively data acquisition task.
Described key frame analysis module is by extracting the feature of the key frame relevant with the content of picture, characteristic information is kept in the buffer memory, when analyzing in the homogeneous turbulence media data source never when obtaining identical feature, just think and constantly obtained identical key frame from two servers in difference, according to the time difference that obtains identical key frame from different servers, come the media information in these different pieces of information sources is carried out time synchronized like this.
Described integrate module is connected with user's playback terminal, is used for sending to playback terminal after the data integration with the media information buffer.
The schematic diagram that the present invention is applied to an example on the network as shown in Figure 2, different regions have a plurality of servers to relay media program just simultaneously on the network, these servers are ServerA, ServerB, ServerC, ServerD, ServerE.Because online in real time is watched the numerous of this program, a large amount of users have increased load of server, make server may not in time serve each user, a large amount of users has also increased the burden of network simultaneously, because network congested, cause the time-delay that the media information packet propagates even be dropped.Because the connection speed of client and ServerA is very good, but just slow with the connection speed of ServerB, other server service speed are general.Give ServerA so client by QoS analysis and Control module, distributes more information to obtain task, distribute few relatively task to give ServerB, the task amount of other server-assignment between ServerA and ServerB.But ServerA is owing to the number of visiting people increases gradually, the response speed of ServerA is descending, QoS analysis and Control module is found to obtain the speed of information slack-off from ServerA, so distributing to the task of ServerA also reduces gradually, the QoS module finds that also the service rate of ServerC is increasing, so task is distributed to ServerC more.By this mechanism, reached and avoided congested network, the ability of avoiding reaches the purpose of the server of the upper limit, thus the quality of the medium browsing that guarantees.

Claims (5)

1. system that realizes multi data source flow media on-line view is characterized in that being provided with as lower module:
Be responsible for network service module with the data source of stream media interaction data;
Obtain the media information acquisition module of data from the data source of stream media on the network by network service module;
Be used to store two or more media information buffers of the data of being obtained from the various flows media data source, the quantity of media information buffer is no less than the quantity of data source of stream media;
With the data recombination of media information buffer and be sent to the integrate module of playback terminal;
And QoS analysis and Control module and key frame analysis module.
2. the system of realization multi data source flow media on-line view according to claim 1, it is characterized in that described QoS analysis and Control module by analyze each media information buffer from data source of stream media, obtain the transmission speed of packet, packet loss in the data packet transmission decide each media information buffer from data source of stream media, to obtain how many data and obtain which part data.
3. the system of realization multi data source flow media on-line view according to claim 2, it is characterized in that described QoS analysis and Control module according to the different sizes of obtaining data from data source of stream media of controlling of the network connection speed of each data source of stream media, for the slower data source of connection speed, give less relatively data acquisition task; For the desirable data source of speed, then give more relatively data acquisition task.
4. the system of realization multi data source flow media on-line view according to claim 3, it is characterized in that described key frame analysis module is by extracting the key frame feature of the data of obtaining from data source of stream media, according to the time difference that obtains identical key frame from the various flows media data source, rice carries out time synchronized to the media information of various flows media data source.
5. the system of realization multi data source flow media on-line view according to claim 4 is characterized in that the key frame feature of described key frame analysis module adopts image information relevant.
CNB200610034961XA 2006-04-13 2006-04-13 System for realizing multi data source flow media on-line view Expired - Fee Related CN100382549C (en)

Priority Applications (1)

Application Number Priority Date Filing Date Title
CNB200610034961XA CN100382549C (en) 2006-04-13 2006-04-13 System for realizing multi data source flow media on-line view

Applications Claiming Priority (1)

Application Number Priority Date Filing Date Title
CNB200610034961XA CN100382549C (en) 2006-04-13 2006-04-13 System for realizing multi data source flow media on-line view

Publications (2)

Publication Number Publication Date
CN1852283A CN1852283A (en) 2006-10-25
CN100382549C true CN100382549C (en) 2008-04-16

Family

ID=37133752

Family Applications (1)

Application Number Title Priority Date Filing Date
CNB200610034961XA Expired - Fee Related CN100382549C (en) 2006-04-13 2006-04-13 System for realizing multi data source flow media on-line view

Country Status (1)

Country Link
CN (1) CN100382549C (en)

Families Citing this family (6)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN101345638B (en) * 2007-07-12 2011-06-22 中兴通讯股份有限公司 Equity system supporting time shift business
CN101146110B (en) 2007-09-25 2011-06-29 深圳市迅雷网络技术有限公司 A method for playing stream media
CN101453688B (en) * 2007-12-04 2010-07-14 中兴通讯股份有限公司 Method for fast responding scene switching in mobile stream media service
CN103023934B (en) * 2011-09-23 2017-03-15 中兴通讯股份有限公司 Multi-stream service synchronous method in virtual terminal system and virtual terminal system
CN102946389A (en) * 2012-11-01 2013-02-27 上海文广互动电视有限公司 Media service pushing system
CN105847382A (en) * 2016-04-20 2016-08-10 乐视控股(北京)有限公司 CDN file distribution method and system

Citations (8)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US20020161900A1 (en) * 2001-04-30 2002-10-31 Brown Scott K. Managing access to streams hosted on duplicating switches
US20030055995A1 (en) * 2001-09-20 2003-03-20 Pekka Ala-Honkola Adaptive media stream
JP2003333548A (en) * 2002-05-15 2003-11-21 Nippon Telegr & Teleph Corp <Ntt> Stream media distribution method and apparatus, software, and recording medium
CN1567381A (en) * 2003-06-20 2005-01-19 北京北佳信息系统有限公司 Multimedia material synchronous editing device
CN1606302A (en) * 2003-10-10 2005-04-13 微软公司 Media stream scheduling for hiccup-free fast-channel-change in the presence of network chokepoints
CN1633109A (en) * 2005-01-20 2005-06-29 杨金钰 A flow media system
CN1645858A (en) * 2005-02-24 2005-07-27 广东省电信有限公司研究院 Service system for distributed reciprocal flow media and realizing method for requesting programm
CN1744592A (en) * 2005-09-29 2006-03-08 西安交通大学 Multi-source flow media transmission QoS control method

Patent Citations (8)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US20020161900A1 (en) * 2001-04-30 2002-10-31 Brown Scott K. Managing access to streams hosted on duplicating switches
US20030055995A1 (en) * 2001-09-20 2003-03-20 Pekka Ala-Honkola Adaptive media stream
JP2003333548A (en) * 2002-05-15 2003-11-21 Nippon Telegr & Teleph Corp <Ntt> Stream media distribution method and apparatus, software, and recording medium
CN1567381A (en) * 2003-06-20 2005-01-19 北京北佳信息系统有限公司 Multimedia material synchronous editing device
CN1606302A (en) * 2003-10-10 2005-04-13 微软公司 Media stream scheduling for hiccup-free fast-channel-change in the presence of network chokepoints
CN1633109A (en) * 2005-01-20 2005-06-29 杨金钰 A flow media system
CN1645858A (en) * 2005-02-24 2005-07-27 广东省电信有限公司研究院 Service system for distributed reciprocal flow media and realizing method for requesting programm
CN1744592A (en) * 2005-09-29 2006-03-08 西安交通大学 Multi-source flow media transmission QoS control method

Also Published As

Publication number Publication date
CN1852283A (en) 2006-10-25

Similar Documents

Publication Publication Date Title
US10609447B2 (en) Method of unscrambling television content on a bandwidth
CN100559776C (en) A kind of stream media system
US11025982B2 (en) System and method for synchronizing content and data for customized display
CN101917613B (en) Acquiring and coding service system of streaming media
US20070162945A1 (en) System and method for routing content
CN100382549C (en) System for realizing multi data source flow media on-line view
CN101917389A (en) Network television direct broadcasting system
CN103210642A (en) Method for transmitting a scalable http stream for natural reproduction upon the occurrence of expression-switching during http streaming
KR20090039041A (en) System and method for iptv vodcasting service using really simple syndication
US11805285B2 (en) Systems and methods to signal changes in HLS content constructs via the media playlist
Liu et al. IPTV, towards seamless infotainment
CA2306524A1 (en) A system and method for enhanced streaming media viewing
Lazova et al. Personalized TV Distribution to Adaptive HTTP Streaming Clients
CA2314744A1 (en) A system and method for enhanced streaming media viewing
Janniello et al. The role of a DTV Edge Server in support of Data Broadcasting Applications

Legal Events

Date Code Title Description
C06 Publication
PB01 Publication
C10 Entry into substantive examination
SE01 Entry into force of request for substantive examination
C14 Grant of patent or utility model
GR01 Patent grant
CF01 Termination of patent right due to non-payment of annual fee

Granted publication date: 20080416

Termination date: 20150413

EXPY Termination of patent right or utility model