CN101014947A - Apparatus, system, and method for adaptive-rate shifting of streaming content - Google Patents
Apparatus, system, and method for adaptive-rate shifting of streaming content Download PDFInfo
- Publication number
- CN101014947A CN101014947A CN 200580022210 CN200580022210A CN101014947A CN 101014947 A CN101014947 A CN 101014947A CN 200580022210 CN200580022210 CN 200580022210 CN 200580022210 A CN200580022210 A CN 200580022210A CN 101014947 A CN101014947 A CN 101014947A
- Authority
- CN
- China
- Prior art keywords
- low
- volume traffic
- traffic stream
- stream
- content
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Pending
Links
Images
Landscapes
- Information Transfer Between Computers (AREA)
Abstract
Apparatus for adaptive-rate shifting of streaming content includes an agent controller module 402 configured to simultaneously request a plurality of streamlets 212. The agent controller module 402 is further configured to continuously monitor streamlet requests and subsequent responses, and accordingly request higher or lower quality streamlets. A staging module 409 is configured to stage the streamlets 212 and arrange the streamlets 212 for playback on a content player 408. A system includes a data communications network 106, a content server 102 coupled to the data communications network 106 and having a content module 112 configured to process content and generate a plurality of high and low quality streams, and the apparatus. A method includes simultaneously requesting a plurality of streamlets 212, continuously monitoring streamlet requests and subsequent responses, and accordingly requesting higher or lower quality streamlets, and staging the streamlets 212 and arranging the streamlets 212 for playback on a content player 408.
Description
Technical field
The present invention relates at the video flowing online as the packet switch of internet, particularly the adaptation rate in such network upper reaches content (streaming content) switches.
Background technology
The internet becomes the prefered method to terminal user's publication medium file apace.Current, music or video can be downloaded to computing machine, mobile phone or almost any equipment that network capabilities is arranged.Many portable electronic devices have been equipped the network connection also can playing back music or video.Music or video file (calling " media file " in the following text) can be stored in local media player or computing machine, perhaps inject or download from server.
" Streaming Media " refers to a technology, and when receiving data, for showing medium to the user in real time, it transmits content with enough speed.Data are stored until broadcast in storer temporarily, and deleted immediately.User's satisfaction immediately can be seen the content of being asked and need not wait for that media file downloads fully.Regrettably, for real-time play the audio/video quality that can receive be subjected to the restriction of the available bandwidth that user network connects.Can use stream transmit program request (recording in the past) or from the content of live broadcast.
As selection, can the downloads of media file and be stored to permanent storage appliance, as hard disk drive or optical memory, in order to playing later on.Depend on that network connects, and downloads complete media file and can take a large amount of time.Yet, in case download, can be at any time or any place view content repeatedly.Usually use than the higher-quality audio/video that can transmit in real time for the media file of download preparing and to encode.The user generally dislikes this selection, because they think just to see at once or hear media file often.
Stream provides the advantage of instant access medium, but compares with the file of the identical content of downloading, and has sacrificed quality usually.Stream is also watched the chance of selecting different content for the user provides impromptu, and according to definition, download is limited to whole receptions or does not receive specific content choice.Download and also support rewinding (rewind), (fast forward), direct search (direct seek) operation fast forward, and stream can not fully be supported these functions.Stream also is subjected to network failure or congested influence easily.
Another technology that is known as " progressive download " is attempted the strong point combination with above-mentioned two technology.When starting progressive download, media file download begins, and media player waits begins to reset, and makes playback to begin until having downloaded enough files, desirable is that before, the remainder of file is downloaded fully in playback " catching up with (catches up) ".This section stand-by period before resetting depends on the condition of network in fact, and therefore, for the problem that the medium on the network show, this section stand-by period is not complete or thorough acceptable solution.
Usually, for as have data transmission stream on the network of internet of variable obliterated data quantity, have three basic challenges.First challenge is a reliability.Many stream solutions use TCP to connect or " virtual circuit " transmits data.TCP connects provides guaranteed transfer mechanism, makes the data of sending from a terminal be transferred into the destination, even some partial loss and re-transmission.When data must transmit in real time, the interrupting of continuity that TCP connects can be brought serious consequence.When network adapter detected the delay in the TCP connection or loses, adapter slowly returned to original transfer rate from transmission operation " retreating (back off) " for a moment immediately.This behavior alleviates perceived congested.The experience that the user sees or listen is hindered in slowing down like this, therefore can not accept.
Second challenge of data transmission is efficient.Efficient refers to the transmission of how to flow for content and makes full use of the bandwidth that the user can use.This method directly relates to the reliability that TCP connects.When the TCP connection is subjected to the integrity problem puzzlement, caused the loss of bandwidth availability ratio.Efficiency measure changes suddenly sometimes, and can have a strong impact on viewing experience.
The 3rd challenge is time-delay.From client's viewpoint, time-delay is that interlude is measured between the moment that the moment that request sends and response data begin to arrive.Reliability and efficient that network connects, and the source preparation required processing time of response have influence on this value.For example, server busy or overload will be handled request with more time.Time-delay had both influenced the zero-time of specific request, and the network throughput to TCP has significant impact again.
By above discussion, clearly, there are needs, to alleviate reliability, efficient and latency issue to device, system and method.In addition, such device, system and method can provide immediately and watch, and fast forward, rewinding, directly search and browse the ability of a plurality of data stream (browse multiplestreams).Can be beneficially, such device, system and method can use a plurality of connections between the source and destination, and the different bit rates stream of network condition is depended in request.
Summary of the invention
Answer the requirement of the current state in present technique field, especially, should also not have the thoroughly problem and the requirement that needs in the present technique field of solution, exploitation the present invention by current available content streaming system (content streaming system).Therefore, exploitation the present invention is to be provided for device, the system and method for adaptation rate content stream, and it can solve many or whole shortcoming discussed above in the art.
The device of adaptation rate content stream is equipped with logical block, and it comprises a plurality of modules that are configured to carry out steps necessary on function.These modules in described embodiment comprise the agent controller module that is configured to ask simultaneously a plurality of low-volume traffic streams (streamlet), the agent controller module further is configured to watch-keeping streamlet request and response subsequently, and correspondingly ask the low-volume traffic stream of higher or lower quality, and also comprise and be configured to show low-volume traffic stream and arrange the display module of described low-volume traffic stream on content player, resetting.
In one embodiment, described device further is configured to set up the low-volume traffic stream that is connected and asks different bit rates with a plurality of transmission control protocols (TCP) of content server.Each low-volume traffic stream can further comprise the part of content file.In addition, the agent controller module can be configured to generate performance factor according to the response of streamlet request.
In other embodiment, the agent controller block configuration become when performance factor bigger and than threshold value according to the combination of the factor, the agent controller module determines to support higher-quality playback time, on transfer to higher-quality low-volume traffic stream.The described factor can comprise the quantity that is stored in the continuous available low-volume traffic stream in the display module, minimum safety margin and the current surplus (read aheadmargin) that reads in advance.
The agent controller module can be configured to hour be adjusted downward to low-qualityer low-volume traffic stream when performance factor than second threshold value.And the agent controller module can further be configured to expect streamlet request and ask low-volume traffic stream in advance, can have fast forward, to skip at random (skip randomly) and rewind functions.In one embodiment, the agent controller block configuration becomes the initial request lower quality streamlets, with energy instant replay content file, and raises according to performance factor subsequently.
The of the present invention a kind of system that is used for adaptation rate content stream also is provided.Particularly, in one embodiment, system comprises data communication network and content server, and this content server links to each other with data communication network, and has content module, and this content module is configured to contents processing and generates a plurality of high and low-quality streams.In one embodiment, each height and low-quality stream can comprise a plurality of low-volume traffic streams.
In other embodiment, system also comprises the agent controller module that is configured to ask simultaneously a plurality of low-volume traffic streams, this agent controller module further is configured to watch-keeping streamlet request and response subsequently, and correspondingly ask the low-volume traffic stream of higher or lower quality, and also comprise and be configured to show low-volume traffic stream and arrange the display module of described low-volume traffic stream on content player, resetting.
The of the present invention a kind of method that is used for adaptation rate content stream also is provided.In disclosed embodiment the method consist essentially of execution about the operation of described device and system above shown in the steps necessary of function.In one embodiment, the method comprises asks a plurality of low-volume traffic streams, watch-keeping streamlet request and response subsequently simultaneously, and correspondingly ask the low-volume traffic stream of higher or lower quality, and show low-volume traffic stream and arrange described low-volume traffic stream on content player, resetting.
In other embodiment, this method can comprise setting up and a plurality ofly be connected with the transmission control protocol (TCP) of content server, and the low-volume traffic stream of request different bit rates.This method can also comprise according to the response of streamlet request and generate performance factor, transfers to more quality streamlet on performance factor is during greater than threshold value, and judges and whether can support this more high quality playback.Further, this method can comprise when performance factor and is adjusted downward to more lower quality streamlets during less than second threshold value.
In one embodiment, this method comprises the expection streamlet request and asks low-volume traffic stream can have fast forward, to skip at random and rewind functions in advance.This method also can be included in the initial request lower quality streamlets with energy instant replay content file, and raises subsequently according to performance factor.
Run through this instructions, to feature, advantage mention or similar term do not mean that all feature and advantage that can realize about the present invention should or in arbitrary single embodiment of the present invention.On the contrary, the term that should understand about these feature and advantage means that describing specific feature, advantage or characteristic in conjunction with embodiment is included at least one embodiment of the present invention.Therefore, the discussion and the similar term of feature, advantage that runs through this instructions is passable, but not necessarily, refers to same embodiment.
In addition, described feature of the present invention, advantage and characteristic can make up with any suitable manner in one or more embodiments.The those of skill in the art of association area will appreciate that, lack the one or more specific feature or the advantage of specific implementations, and the present invention also can implement.In other example, can recognize additional features and advantage in some embodiments, it may not occur in all of the embodiments of the present invention.
Show more obviously in description that these feature and advantage of the present invention will be below and the appended claim, maybe can grasp these feature and advantage by the practice of the present invention that proposes below.
Description of drawings
In order more easily to understand advantage of the present invention, by with reference to the specific implementations that in institute's accompanying drawing, illustrates, more detailed description of the present invention will be proposed, it was above briefly being described.Be appreciated that these figure have only described typical embodiment more of the present invention, therefore do not think that it is the restriction of the scope of the invention,, utilize additional feature and details to describe and explain the present invention by the use of institute's accompanying drawing, wherein:
Fig. 1 is a schematic block diagram, and it has illustrated an embodiment of the system of switching according to the adaptation rate that is used to flow content of the present invention;
Fig. 2 a is a schematic block diagram, its drawing illustrate according to an embodiment of content file of the present invention;
Fig. 2 b is a schematic block diagram, and it has illustrated an embodiment that has a plurality of streams of different quality and bandwidth according to of the present invention;
Fig. 2 c is a schematic block diagram, and it has illustrated an embodiment that is divided into the data stream of a plurality of low-volume traffic streams according to of the present invention;
Fig. 3 is a schematic block diagram, and it has illustrated an embodiment according to content module of the present invention;
Fig. 4 is a schematic block diagram, its drawing illustrate according to an embodiment of client's module of the present invention;
Fig. 5 is an indicative flowchart, and it has illustrated an embodiment that is used for the method for contents processing according to of the present invention;
Fig. 6 is an indicative flowchart, and it has illustrated an embodiment that is used for the method for a plurality of low-volume traffic streams playbacks according to of the present invention; With
Fig. 7 is a schematic flow diagram, and it has illustrated an embodiment that is used for the method for request low-volume traffic stream under adaptation rate content stream environment according to of the present invention.
Embodiment
In order to emphasize the independence of its enforcement more, the described many functional units of this instructions are noted as module.For example, module can be used as the VLSI circuit that comprises customization or the hardware circuit of gate array, existing semiconductor such as logic chip, transistor or other discrete component is implemented.Also can in programmable hardware device, implement module as field programmable gate array, programmable logic array, programmable logic device or analog.
Module also can be implemented in software to be carried out by dissimilar processors.For example, the module of determining of executable code can comprise that one or more for example can be built into the physics or the logic module of the computer instruction of object, program or function.Yet, but the operating part of the module of determining needn't be positioned at physically together, but can comprise the diverse instruction that is stored in diverse location, when combined together in logic, it comprises this module and realizes the purpose that this module is illustrated.
In fact, the module of executable code can be a perhaps multiple instruction of single instruction, and even can and cross over several memory devices distributions on several different code segments, in different programs.Similarly, service data can be identified and illustrate in module in this, and can represent also can organize in the data structure of any adequate types with any suitable form.Can be used as the individual data set and collect service data, maybe can be distributed in different positions, be included on the different memory devices, also can only exist to small part as the electronic signal in network or the system.
Run through present disclosure, for " embodiment ", " embodiment " mention or similar term means in conjunction with the described specific feature of embodiment, structure or characteristic and is included at least one embodiment of the present invention.Therefore, run through this instructions word " in one embodiment ", " in embodiment " and similar term appearance can but needn't all refer to same embodiment.
The mentioning adopting of signal-bearing media (signal bearing medium) can generate signal, causes that signal produces, or any form that machine readable instructions is carried out.Can realize signal-bearing media by transmission line, compact disk, digital video disc, tape, Bernoulli Jacob (Bernoulli) driver, disk, punch card, flash memory (flash memory), integrated circuit or other digital processing unit memory device.
In addition, described feature of the present invention, structure or characteristic can combinations in any suitable manner in one or more embodiments.In the following description, many specific detail are provided, as programming, software module, user's selection, web transactions, database query, database structure, hardware module, hardware circuit, hardware chip or the like example, so that the complete understanding of embodiments of the present invention to be provided.Yet the those of skill in the art of association area will appreciate that, lack one or more specific detail or utilize other method, parts, material or the like the present invention also can realize.In other examples, at length do not show or describe well-known structure, material or operation, to avoid interference feature of the present invention.
Fig. 1 is a schematic block diagram, and it has illustrated an embodiment of the system of switching according to the dynamic rate that is used to flow content of the present invention 100.In one embodiment, system 100 comprises content server 102 and terminal user 104.Content server 102 can be connected by data communication network with end user station 104.Data communication network can comprise internet 106 with to the internet 106 be connected 108.Can be selectively, content server 102 and terminal user 104 can be positioned on conventional LAN (Local Area Network), radio area network, cellular network, VLAN or the analog.End user station 104 can comprise personal computer (PC), be configured to the entertainment systems of communication on the internet or be configured to the portable electric appts of displaying contents.
In described embodiment, system 100 also comprises the distributor 110 and the webserver 116.Distributor 110 can be the fabricator or the publisher of content.For example, if the content of fluidisation (stream) is the TV programme of broadcasting, distributor 110 can be TV or cable network channel such as NBC or MTV .By internet 106, content is transferred into content server 102, and wherein, content is received by content module 112.Content module 112 can be configured to reception, processing and memory contents.In one embodiment, the content of handling is by 114 visits of client's module, and client's module 114 is configured to play content on end user station 104.In other embodiment, client's module 114 is configured to from a plurality of places the different piece of received content stream simultaneously.For example, any one content from a plurality of webservers 116 can be asked or receive to client's module 114.
Fig. 2 a is a schematic block diagram, its drawing illustrate an embodiment of content file 200.In one embodiment, content file 200 is by distributor 110 issues.Content file 200 can comprise television broadcasting, sport event, film, music, concert or the like.Content file 200 can be a content live or that file.Content file 200 can comprise unpressed video and audio frequency, perhaps, and video or audio frequency.In addition, content file 200 can be compressed.The example of the content file 200 that has compressed includes but not limited to DivX , Windows Media Video 9 , Quicktime6.5Sorenson3 or Quicktime6.5/MPEG-4 encoded content.
Fig. 2 b is a schematic block diagram, and according to the present invention, it has illustrated an embodiment of a plurality of streams 202 with different quality and bandwidth.In one embodiment, a plurality of streams 202 comprise stream 206 and high-quality stream 208 of a low-quality stream 204, a fair average quality.Each stream the 204,206, the 208th, the duplicating of content file 200, it is encoded and compressed to different bit rates.For example, it is 100 kilobits/second (100kbps) that low quality stream 204 can be encoded and compressed to bit rate, and it is 200kbps that medium quality stream 206 can be encoded and compressed to bit rate, and it is 600kbps that high quality stream 208 can be encoded and compressed to bit rate.
Fig. 2 c is a schematic block diagram, and it has illustrated an embodiment of the data stream 210 that is divided into a plurality of low-volume traffic streams 212.As used herein, low-volume traffic stream refers to the part of any size of content file 200.Each low-volume traffic stream 212 can comprise a part that is included in the content in the stream 210, and it is packed as independent media's object.The content of low-volume traffic stream 212 can have unique time index, and this time index is initial relevant with stream 210 contents that comprised.In one embodiment, be included in each low-volume traffic stream 212 in have duration of 2 seconds.For example, low-volume traffic stream 0 can have the represent content initial time index 00:00 that resets, and low-volume traffic stream 1 index 00:02 or the like if having time.Selectable, the duration of low-volume traffic stream 212 can be any duration less than the duration of the whole contents playback of data stream 210.In other embodiment, low-volume traffic stream 212 can be cut apart according to file size rather than time index.
Fig. 3 is a schematic block diagram, and it understands an embodiment according to content module 112 of the present invention in more detail.Content module 112 can comprise flow module 302, streamlet module 304, coder module 306, low-volume traffic stream database 308 and the webserver 116.In one embodiment, flow module 302 is configured to from distributor 110 received content files 200, and generates a plurality of streams 202 of different quality.Original content file 200 from distributor can be the form of numeral and can comprise the content that has high bit rate such as 2mbps.Content can be sent to content module 112 from distributor 110 by internet 106.Such data are transmitted as known in the art and need be in this further discussion.Selectable, content can comprise the broadcasting of obtaining.
In described embodiment, a plurality of streams 202 can comprise the stream 206 and the high-quality stream 208 of low-quality stream 204, fair average quality.Selectable, what a plurality of streams 202 can comprise arbitrary number is considered to adapt to the required stream of terminal user's bandwidth.Streamlet module 304 can be configured to receive a plurality of streams 202 from flow module and to generate a plurality of streams 312, and each stream comprises a plurality of low-volume traffic streams 212.Shown in Fig. 2 c, each low-volume traffic stream 212 can comprise predefined part stream.Coder module 306 is configured to each low-volume traffic stream from a plurality of streams 312 is encoded, and stores low-volume traffic stream in low-volume traffic stream database 308.Coder module 306 can be used the encoding scheme as DivX , Windows Media Video9 , Quicktime6.5Sorenson3 or Quicktime6.5/MPEG-4 .Selectable, can use conventional encoding scheme.
In case low-volume traffic stream is received and is processed, client's module 114 can be utilized the low-volume traffic stream 212 of HTTP request from the webserver 116.The utilization of the request that this client's side starts does not require the configuration of the extra wall of setting fire.In addition, because client's module 114 is initiated request, the webserver 116 only needs to be retrieved and the low-volume traffic stream of described request is provided.In other embodiment, client's module 114 can be configured to from a plurality of webserver 310 retrieve streamlets 212.Each webserver 116 can be positioned at the diverse location that spreads all over internet 106.Low-volume traffic stream 212 is static file in essence.Like this, for client's module 114, do not need special media server or server-side intelligence to come retrieve streamlets 212.Low-volume traffic stream 212 can provide service by the webserver 116, or provide service by the network operator's of ISP (ISP) or any other network infrastructure cache server (cache server) high-speed cache with by cache server.The use of cache server is known those skilled in the art, does not further discuss at this.Like this, proposed the solution that can highly upgrade, in any certain location, it is not subjected in a large number the obstruction of client's module 114 requests of proposing to the webserver 116.
Fig. 4 is a schematic block diagram, its drawing illustrate according to an embodiment of client's module 114 of the present invention.Client's module 114 can comprise an agent controller module 402, a streamlet cache module 404 and a network controller module 406.In one embodiment, agent controller module 402 is configured to be connected with viewer 408, and low-volume traffic stream 212 is sent to viewer 408.In other embodiment, client's module 114 can comprise a plurality of agent controller modules 402.Each agent controller module 402 can be configured to be connected with a viewer 408.Selectable, each agent controller module 402 can be configured to be connected with a plurality of viewers 408.Viewer 408 can be the media player (not shown) of moving on PC or hand-hold electronic equipments.
Agent controller module 402 is configured to select be sent to the quality scale of the low-volume traffic stream of viewer 408.Based on the continuous observation in the time interval between the continuous time of reception of each low-volume traffic stream of asking, the lower or higher-quality stream of agent controller module 402 requests.Ask method lower or higher-quality stream to discuss in more detail with reference to figure 7 hereinafter.
Agent controller module 402 can be configured to receive user command from viewer 408.Such order can comprise broadcast, fast forward, rewinding, suspend and stop.In one embodiment, agent controller module 402 is arranged received low-volume traffic stream 212 from streamlet cache module 404 request low-volume traffic streams 212 and in display module 409.Display module 409 can be configured to the series arrangement low-volume traffic stream 212 according to the ascending order playback duration.In described embodiment, low-volume traffic stream 212 is numbered 0,1,2,3,4 or the like.Yet each low-volume traffic stream can identify with unique filename.
In addition, agent controller module 402 can be configured to expect low-volume traffic stream 212 request and ask low-volume traffic stream 212 in advance.By asking low-volume traffic stream 212 in advance, the user can carry out fast forward, skip at random or rewinding content, and does not experience buffer delay.In other embodiment, agent controller module 402 can be asked low-volume traffic stream 212, and it corresponding to 30 seconds in the whole contents playback duration time index at interval.Selectable, agent controller module 402 can be asked low-volume traffic stream on any interval less than time index length.When content file 200 beginning or fast forward the time, this has realized " beginning fast " ability and need not cushion wait.In other embodiment, agent controller module 402 can be configured to ask in advance low-volume traffic stream 212, and it is corresponding to in context or the particular index point in the other guide scope of terminal user's 104 expections of selecting to watch fresh content.
In one embodiment, streamlet cache module 404 is configured to receive low-volume traffic stream 212 requests from agent controller module 402.When receiving request, streamlet cache module 404 checks that at first streamlet cache 410 is to confirm whether low-volume traffic stream 212 exists.In other embodiment, streamlet cache module 404 is handled low-volume traffic stream 212 requests from a plurality of agent controller modules 402.Selectable, streamlet cache module 404 can be offered each agent controller module 402.If the low-volume traffic stream 212 of request is not present in the streamlet cache 410, request is passed to network controller module 406.In order to realize fast forward and rewind capabilities that streamlet cache module 404 is configured to after low-volume traffic stream is observed, and stores a plurality of low-volume traffic streams 212 in the specific period in streamlet cache module 404.Yet in case low-volume traffic stream 212 is deleted, it can be asked once more to the webserver 116.
In other embodiment, streamlet request can comprise the fragment of asking any streamlet file.Low-volume traffic stream is divided into littler fragment or part to be of value to and to promote potential efficient, and elimination and a plurality of full-streamlet requests are in the relevant problem of any given time shared bandwidth.This obtains by low-volume traffic stream 212 fragments being used parallel TCP/IP connect.Thereby, overcome efficient and network loss problems, and reaching of low-volume traffic stream has and the time limit that can estimate more useful.
In one embodiment, client's module 114 is configured to use between client's module 114 and the webserver 116 or network cache a plurality of TCP to connect.The intervention of high-speed cache can be transparent for the client or be configured as one by the client and transmit high-speed cache.By certain time with the mode request that is called as " parallel search " low-volume traffic stream 212 more than one, or by in certain time request more than low-volume traffic stream 212 parts, improved efficient significantly and in fact eliminated delay.In other embodiment, client's module allows maximum three uncompleted low-volume traffic stream 212 requests.If other connection failures, client's module 114 can support extra open TCP to connect as available backup.Low-volume traffic stream 212 requests are that wheel changes in all opening in the connection, so that be arbitrary specific connection maintenance TCP stream logic that falls into initial slowly or " shut " mode".If network controller module 406 is with a plurality of low-volume traffic streams 212 of partly asking, each institute's requested part is in separate TCP/IP connection, network controller module 406 reconfigures these parts, and a complete low-volume traffic stream 212 that is used by all other parts of client's module 114 is provided.
When the TCP connection falls flat,, can on connecting, difference send a new request for same low-volume traffic stream 212.In other embodiment, do not satisfy if request is instant, for same low-volume traffic stream 212, can on connecting, difference send a redundant request.If the response of first streamlet request arrived, can end redundant request before redundant request response.If redundant request response arrived, can end first request before first request response.
The request of several low-volume traffic streams 212 can send in single TCP connection, and response is flowed back to along the order of same connection with coupling.This has removed all delays except that first request.Because send a plurality of responses always, the processing delay of low-volume traffic stream 212 responses that each after first is new is not a factor of performance.This technology is known as " stream line operation " in industry.By the major part influence that the request of removing postpones, streamline behaviour provides efficient in the request response is handled.Yet stream line operation has serious weakness.Transmission delays affect all responses.If single TCP connection failure, all not finishing asked and response loss.Stream line operation has caused the serious dependence between the request.
In the independently while of keeping each low-volume traffic stream 212 request, can between the client's module 114 and the webserver 116, open a plurality of TCP and connect, so that the reduction of acquisition stream line operation postpones the benefit on the effect.Can send several low-volume traffic stream 212 requests simultaneously, each request sends in the TCP connection that differs from one another.This technology is called " empty stream line operation " and is an innovation of the present invention.Can transmit a plurality of responses simultaneously, guarantee that the communication bandwidth between the client's module 114 and the webserver 116 always is utilized.The weakness of traditional stream line operation has been removed in empty stream line operation.The delay of a response or fall flat and do not influence the transmission of other response because each response occupy one independently TCP connect.Can do not used by other uncompleted response by one in a plurality of responses any transmission bandwidth of (no matter whether owing to postpone or the TCP connection failure) that uses.
Can be that whole low-volume traffic stream 212 sends single low-volume traffic stream 212 requests, or send a plurality of requests that its each be different piece or section at low-volume traffic stream.If low-volume traffic stream with several sections be requested, can this several sections be reassembled into low-volume traffic stream by client's module 114.
In order to use and the suitable balance of maintenance between the response time in the maximization bandwidth, must carry out timing to sending of new streamlet request, so that client's module 114 receive fully for before before one of them the response of uncompleted streamlet request, the webserver 116 does not transmit response.For example, if 212 requests of three low-volume traffic streams do not finish, a quilt in three responses receive fully also " getting off " from streamline a little before, client's module 114 should send next request.In other words, adjust request regularly to keep three responses in transmission.Shared channel has reduced the clean response time of other three responses between four responses.Can adjust by observing dynamically to calculate regularly, and correspondingly adjust request time to keep effect and the suitable balance of response time.
Following schematic flow sheet proposes as logical flow chart usually.Like this, the step of the order of description and label is represented an embodiment of this method.Can envision other step and method, its one or more step or wherein a few partial function, logic or effect to institute's describing method is equal to.In addition, provide employed form and symbol to explain this method logic step and be interpreted as not limiting the scope of this method.Though can in process flow diagram, use different the arrow type and the line style of type, be appreciated that the scope that does not limit correlation method for it.In fact, some arrows and other connector can be used to only represent the logic flow of this method.For example, arrow can be illustrated in specifying wait or the supervision stage that continues period between the enumerated steps of institute's describing method.The order of the corresponding steps shown in addition, the order of ad hoc approach generation can or can not strictly observe.
Fig. 5 is a schematic flow diagram, and it has illustrated an embodiment that is used for the method 500 of contents processing according to of the present invention.In one embodiment, method 500 beginnings 502, content module 112 receives 504 contents from distributor 110.Received content 504 can comprise the numeral backup that receives 504 content files 200, or with the physical backup digitizing of content file 200.Selectable, receive 504 contents and can comprise that receiving radio or television broadcasts.In case receive 504, flow module 302 generates more than 506 streams 202, and each stream 202 has different quality.Quality can be pre-defined, or be provided with automatically according to terminal user's bandwidth, or corresponding to the criterion of distributor of design in advance.
Fig. 6 is a schematic flow diagram, and it has illustrated an embodiment that is used to watch the method 600 of a plurality of low-volume traffic streams according to of the present invention.Method 600 beginnings provide 604 to act on behalf of control module device 402 and it is related with viewer 408, and display module 409 are provided.Agent controller module device 402 is subsequently to streamlet cache module 404 requests 606 low-volume traffic streams.Selectable, agent controller module device 402 can be simultaneously to more than 606 low-volume traffic stream of streamlet cache module 404 requests.Store 608 in streamlet cache 410 if low-volume traffic stream is local, streamlet cache module 404 retrievals 610 low-volume traffic streams also send low-volume traffic stream to agent controller module 402.Retrieval 610 or when receiving low-volume traffic stream, agent controller module 402 judges whether 611 switch to higher or lower mass flow 202.This judgement will be with reference to figure 7 more detailed description hereinafter.
In one embodiment, display module 409 is arranged 612 one-tenth suitable orders with low-volume traffic stream subsequently, and agent controller module 402 sends 614 low-volume traffic streams to viewer 408.In other embodiment, send 614 low-volume traffic streams and be included in displaying video or audio frequency low-volume traffic stream on the viewer 408 to the terminal user.If in this locality storage 608, then streamlet request is not passed to network controller module 406 to low-volume traffic stream.Network controller module 406 is subsequently to the webserver 116 requests 616 low-volume traffic streams subsequently.In case receive low-volume traffic stream, network controller module 406 is passed to streamlet cache module 404 with low-volume traffic stream.Streamlet cache module 404 files 618 low-volume traffic streams.Selectable, file subsequently 618 low-volume traffic streams and low-volume traffic stream is passed to agent controller module 402 of streamlet cache module 404, and as mentioned above, method 600 continues from operating 610 subsequently.
Refer now to Fig. 7, shown here is schematic flow diagram, and it has illustrated an embodiment that is used for asking at the environment of adaptation rate switch contents stream the method 700 of low-volume traffic stream according to of the present invention.In one embodiment, method 700 can be as the operation 611 as Fig. 6.Method 700 beginnings, as indicated above referring to Fig. 6, act on behalf of control module device 402 and receive 704 low-volume traffic streams.Agent controller module 402 monitors the time of reception of 706 low-volume traffic streams of asking immediately.In one embodiment, agent controller module 402 monitors the time interval Δ between the continuous time of reception of each low-volume traffic stream response.The order request corresponding with it of response is incoherent in proper order.
Because the fluctuation of network behavior feature, sometimes very suddenly, perhaps given Δ is different from another fully arbitrarily.In order to compensate this fluctuation, agent controller module 402 is calculated the 708 PR r of n window of sampling that stride the low-volume traffic stream of playback length S.In one embodiment, use equation
The calculated performance ratio r.
Owing to handle a plurality of low-volume traffic streams simultaneously, and central tendency (central tendency) in order to judge PR r better, agent controller module 402 can be calculated the geometric mean of the window of striding the m size, or selectively equivalent average algorithm, obtains performance factor :
By comparing
CurrentWith activation threshold value Θ
Up, beginning is judged about the strategy that whether raises 710 reproduction qualities.If
Current〉=Θ
Up, then can consider to transfer on 716 next higher-quality stream.In one embodiment, activation threshold value Θ
UpBy with current to read surplus (current readahead margin) (that is: continuous available low-volume traffic stream number, it is showed with current playback duration index by arranging continuously being used for by the display module 409) factor set relevant with minimum safety margin in advance incompatible definite.In one embodiment, minimum safety margin can be 24 seconds.It is more little to read surplus in advance, Θ
UpBig more, it will stop the rise quality, until setting up the bigger surplus that reads in advance to interrupt to resist network.If agent controller module 402 can support 716 to raise quality, agent controller module 402 will raise 717 quality and ask higher-quality stream subsequently so.By the valuation of the performance factor of high quality stream more more
HigherAnd Θ
Up, determine whether to support the 716 more uses of high quality stream.If
Higher〉=Θ
Up, think that so more the use of high quality stream is supported.If about whether can support 716 more the judgement of high flow rate be "No", then agent controller module 402 will no longer attempt to raise 717 current masses.If arrived the end 714 of stream, method 618 finishes 716.
If about the judgement of whether attempting to raise 710 are "No", then carry out judgement 712 about whether reducing.In one embodiment, with Θ
UpSimilarly mode defines activation threshold value Θ
DownIf
Current〉=Θ
Down, then current mass is suitable, and agent controller module 402 does not cut 718 current masses.Yet, if
Current≤ Θ
Down, agent controller module 402 downward modulations 718 current masses.If the end 714 of no show stream, agent controller module 402 begins request and receives 704 low-qualityer low-volume traffic streams, and method 618 begins once more.Certainly, above-described equation and algorithm only illustrate, and can be replaced by selectable low-volume traffic stream method for supervising.
The present invention can specifically implement with other specific forms, does not depart from its purport or essential characteristic.Described embodiment should think it only is to illustrate and nonrestrictive in all respects.Therefore, by appended claim rather than foregoing description scope of the present invention is described.Institute in the connotation that is equal to of next comfortable claim and the scope changes and all is included in its scope.
Claims (34)
1. device about adaptation rate content stream, described device comprises:
One acts on behalf of controller module, and it is configured to ask simultaneously at least a portion of a plurality of low-volume traffic streams;
Described agent controller module further is configured to the progress of watch-keeping for the subsequent response of streamlet request, and according to the described progress of described response, asks the low-volume traffic stream of higher or lower quality; With
One display module, it is configured to show described low-volume traffic stream, and arranges described low-volume traffic stream for resetting on content player.
2. device as claimed in claim 1, wherein, described agent controller block configuration becomes to set up and a plurality ofly is connected with the transmission control protocol (TCP) of content server, and asks the low-volume traffic stream of different bit rates.
3. device as claimed in claim 1, wherein, each low-volume traffic stream further comprises the part of content file.
4. device as claimed in claim 1, wherein said low-volume traffic stream comprises the HTML (Hypertext Markup Language) file.
5. device as claimed in claim 3, wherein, described agent controller block configuration becomes according to the described response to streamlet request to generate performance factor.
6. device as claimed in claim 4, wherein, described agent controller block configuration becomes, when described performance factor than selected threshold value big and described agent controller module determine to support higher-quality playback time according to combinations of factors, on transfer to the little data stream of described more high-quality.
7. device as claimed in claim 5, wherein, described combinations of factors is from being selected by the quantity that is stored in the continuous available small data the described display module, minimum safety margin and current reading in advance in the group that surplus forms.
8. device as claimed in claim 4, wherein, described agent controller block configuration become when described performance factor than the second selected threshold value hour, be adjusted downward to more lower quality streamlets.
9. device as claimed in claim 1, wherein, described agent controller module further is configured to expect streamlet request and ask low-volume traffic stream can have fast forward, to skip at random and rewind functions in advance.
10. device as claimed in claim 1, wherein, described agent controller block configuration becomes at initial request low quality data stream with can the described content file of instant replay, and raises according to described performance factor subsequently.
11. the system about adaptation rate content stream, described system comprises:
One data communication network;
One content server, it is connected with described data communication network and has a content module that is configured to contents processing and generates a plurality of high and low-quality streams;
Each described height and low quality stream comprise a plurality of low-volume traffic streams;
One acts on behalf of controller module, and it is configured to ask simultaneously at least a portion of a plurality of low-volume traffic streams;
Described agent controller module further is configured to the progress of watch-keeping for the subsequent response of streamlet request, and according to the described progress of described response, asks the low-volume traffic stream of higher or lower quality; With
One display module, it is configured to show described low-volume traffic stream and arranges described low-volume traffic stream for resetting on content player.
12. system as claimed in claim 11, wherein, described agent controller block configuration becomes to set up and a plurality ofly is connected with the transmission control protocol (TCP) of described content server, and asks the low-volume traffic stream of different bit rates.
13. system as claimed in claim 11, wherein, each low-volume traffic stream further comprises the part of content file.
14. device as claimed in claim 13, wherein, described agent controller block configuration becomes according to the described response for streamlet request to generate performance factor.
15. system as claimed in claim 14, wherein, described agent controller block configuration becomes, when described performance factor than selected threshold value big and described agent controller module determine to support higher-quality playback time according to the combination of the factor, on transfer to described higher-quality low-volume traffic stream.
16. system as claimed in claim 15, wherein, described combinations of factors is from being selected by the quantity that is stored in the continuous available small data the described display module, minimum safety margin and current reading in advance in the group that surplus forms.
17. system as claimed in claim 14, wherein, described agent controller block configuration become when described performance factor than the second selected threshold value hour, be adjusted downward to more lower quality streamlets.
18. system as claimed in claim 11, wherein, described agent controller module further is configured to expect streamlet request and ask low-volume traffic stream can have fast forward, to skip at random and rewind functions in advance.
19. system as claimed in claim 11, wherein, described agent controller block configuration becomes at initial request low quality data stream with can the described content file of instant replay, and raises according to described performance factor subsequently.
20. one kind about representing the method for adaptation rate stream, described method comprises:
Ask at least a portion of a plurality of low-volume traffic streams simultaneously;
Watch-keeping is for the progress of the subsequent response of streamlet request, and according to the described progress of described response, asks the low-volume traffic stream of higher or lower quality; With
Show described low-volume traffic stream and arrange described low-volume traffic stream on content player, resetting.
21. method as claimed in claim 20 further comprises setting up a plurality ofly being connected with the transmission control protocol (TCP) of content server, and the low-volume traffic stream of request different bit rates.
22. method as claimed in claim 20 further comprises according to the response for streamlet request generating performance factor.
23. method as claimed in claim 20 transfers to higher-quality low-volume traffic stream on further comprising when described performance factor is bigger than selected threshold value and judges and whether can support described more high quality playback.
24. method as claimed in claim 20, further comprise when described performance factor than the second selected thresholding hour, be adjusted downward to low-qualityer low-volume traffic stream.
25. method as claimed in claim 20 further comprises the expection streamlet request and asks low-volume traffic stream can have fast forward, to skip at random and rewind functions in advance.
26. method as claimed in claim 20 further is included in initial request low quality data stream with can the instant replay content file, and raises according to described performance factor subsequently.
27. a computer readable storage medium, it comprises computer-readable code, and it is configured to carry out the operation that is used to represent adaptation rate content stream, and described operation comprises:
Ask at least a portion of a plurality of low-volume traffic streams simultaneously;
Watch-keeping is for the progress of the subsequent response of streamlet request, and according to the described progress of described response, asks the low-volume traffic stream of higher or lower quality; With
Show described low-volume traffic stream and arrange described low-volume traffic stream on content player, resetting.
28. computer readable storage medium as claimed in claim 27, wherein, described operation further comprises setting up and a plurality ofly is connected with the transmission control protocol (TCP) of content server, and the low-volume traffic stream of request different bit rates.
29. computer readable storage medium as claimed in claim 27, wherein, described operation comprises that further basis generates performance factor for the response of streamlet request.
30. computer readable storage medium as claimed in claim 27, wherein, described operation further comprises when described performance factor is bigger than threshold value, on transfer to more quality streamlet and judge and whether can support described more high quality playback.
31. computer readable storage medium as claimed in claim 27, wherein, described operation further comprise when described performance factor than second threshold value hour, be adjusted downward to more lower quality streamlets.
32. computer readable storage medium as claimed in claim 27, wherein, described operation further comprises the expection streamlet request and asks low-volume traffic stream can have fast forward, to skip at random and rewind functions in advance.
33. computer readable storage medium as claimed in claim 27, wherein, described operation further is included in initial request low quality data stream with can the instant replay content file, and raises according to described performance factor subsequently.
34. a device that is used to represent adaptation rate content stream, described device comprises:
Be used for asking simultaneously the device of at least a portion of a plurality of low-volume traffic streams;
Be used for the progress of watch-keeping, and, ask the device of the low-volume traffic stream of higher or lower quality according to the described progress of described response for the subsequent response of streamlet request; With
Be used to show described low-volume traffic stream and arrange the device of described low-volume traffic stream on content player, resetting.
Applications Claiming Priority (3)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| US56683104P | 2004-04-30 | 2004-04-30 | |
| US60/566,831 | 2004-04-30 | ||
| US11/116,783 | 2005-04-28 |
Publications (1)
| Publication Number | Publication Date |
|---|---|
| CN101014947A true CN101014947A (en) | 2007-08-08 |
Family
ID=38701556
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN 200580022210 Pending CN101014947A (en) | 2004-04-30 | 2005-05-02 | Apparatus, system, and method for adaptive-rate shifting of streaming content |
Country Status (1)
| Country | Link |
|---|---|
| CN (1) | CN101014947A (en) |
Cited By (18)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN101389017B (en) * | 2007-09-14 | 2011-11-30 | 中兴通讯股份有限公司 | Method for storing media file in mobile stream media live service |
| CN102439938A (en) * | 2009-02-09 | 2012-05-02 | 拜特移动网络公司 | Method for controlling download rate of real-time streaming as needed by media player |
| CN102918594A (en) * | 2010-05-28 | 2013-02-06 | 微软公司 | Cache control for adaptive stream player |
| CN103222277A (en) * | 2010-06-04 | 2013-07-24 | 三星电子株式会社 | Method and apparatus for adaptive streaming based on plurality of elements for determining quality of content |
| CN103493496A (en) * | 2011-04-27 | 2014-01-01 | 莫雷加系统股份有限公司 | Streaming video server with virtual file system and method for use therewith |
| CN103959274A (en) * | 2011-10-07 | 2014-07-30 | 爱立信电视公司 | Http adaptive streaming server with automatic rate shaping |
| US9197689B2 (en) | 2010-03-19 | 2015-11-24 | Samsung Electronics Co., Ltd. | Method and apparatus for adaptively streaming content including plurality of chapters |
| CN105580375A (en) * | 2013-08-02 | 2016-05-11 | 英国电讯有限公司 | Video caching |
| CN106134147A (en) * | 2014-03-18 | 2016-11-16 | 高通股份有限公司 | Realize the delivery acceleration device of request manager and connection manager function |
| CN103222277B (en) * | 2010-06-04 | 2016-12-14 | 三星电子株式会社 | The method and apparatus of self adaptation streaming based on the multiple elements for determining content quality |
| US9699486B2 (en) | 2010-02-23 | 2017-07-04 | Samsung Electronics Co., Ltd. | Method and apparatus for transmitting and receiving data |
| US9756364B2 (en) | 2009-12-07 | 2017-09-05 | Samsung Electronics Co., Ltd. | Streaming method and apparatus operating by inserting other content into main content |
| US9860573B2 (en) | 2009-11-13 | 2018-01-02 | Samsung Electronics Co., Ltd. | Method and apparatus for providing and receiving data |
| US9967598B2 (en) | 2009-11-13 | 2018-05-08 | Samsung Electronics Co., Ltd. | Adaptive streaming method and apparatus |
| US10425666B2 (en) | 2009-11-13 | 2019-09-24 | Samsung Electronics Co., Ltd. | Method and apparatus for adaptive streaming using segmentation |
| CN111083202A (en) * | 2019-11-28 | 2020-04-28 | 中科驭数（北京）科技有限公司 | Multi-connection interaction method and device for TCP/IP accelerator |
| CN111756850A (en) * | 2020-06-29 | 2020-10-09 | 金电联行（北京）信息技术有限公司 | Automatic proxy IP request frequency adjusting method serving for Internet data acquisition |
| USRE48360E1 (en) | 2009-11-13 | 2020-12-15 | Samsung Electronics Co., Ltd. | Method and apparatus for providing trick play service |
-
2005
- 2005-05-02 CN CN 200580022210 patent/CN101014947A/en active Pending
Cited By (22)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN101389017B (en) * | 2007-09-14 | 2011-11-30 | 中兴通讯股份有限公司 | Method for storing media file in mobile stream media live service |
| CN102439938A (en) * | 2009-02-09 | 2012-05-02 | 拜特移动网络公司 | Method for controlling download rate of real-time streaming as needed by media player |
| CN102439938B (en) * | 2009-02-09 | 2015-07-22 | 茨特里克斯系统公司 | Method for controlling download rate of real-time streaming as needed by media player |
| USRE48360E1 (en) | 2009-11-13 | 2020-12-15 | Samsung Electronics Co., Ltd. | Method and apparatus for providing trick play service |
| US9860573B2 (en) | 2009-11-13 | 2018-01-02 | Samsung Electronics Co., Ltd. | Method and apparatus for providing and receiving data |
| US10425666B2 (en) | 2009-11-13 | 2019-09-24 | Samsung Electronics Co., Ltd. | Method and apparatus for adaptive streaming using segmentation |
| US9967598B2 (en) | 2009-11-13 | 2018-05-08 | Samsung Electronics Co., Ltd. | Adaptive streaming method and apparatus |
| US9756364B2 (en) | 2009-12-07 | 2017-09-05 | Samsung Electronics Co., Ltd. | Streaming method and apparatus operating by inserting other content into main content |
| US9699486B2 (en) | 2010-02-23 | 2017-07-04 | Samsung Electronics Co., Ltd. | Method and apparatus for transmitting and receiving data |
| US9197689B2 (en) | 2010-03-19 | 2015-11-24 | Samsung Electronics Co., Ltd. | Method and apparatus for adaptively streaming content including plurality of chapters |
| CN102918594A (en) * | 2010-05-28 | 2013-02-06 | 微软公司 | Cache control for adaptive stream player |
| CN103222277A (en) * | 2010-06-04 | 2013-07-24 | 三星电子株式会社 | Method and apparatus for adaptive streaming based on plurality of elements for determining quality of content |
| US9277252B2 (en) | 2010-06-04 | 2016-03-01 | Samsung Electronics Co., Ltd. | Method and apparatus for adaptive streaming based on plurality of elements for determining quality of content |
| CN103222277B (en) * | 2010-06-04 | 2016-12-14 | 三星电子株式会社 | The method and apparatus of self adaptation streaming based on the multiple elements for determining content quality |
| CN103493496A (en) * | 2011-04-27 | 2014-01-01 | 莫雷加系统股份有限公司 | Streaming video server with virtual file system and method for use therewith |
| CN103959274A (en) * | 2011-10-07 | 2014-07-30 | 爱立信电视公司 | Http adaptive streaming server with automatic rate shaping |
| CN103959274B (en) * | 2011-10-07 | 2017-06-27 | 爱立信电视公司 | HTTP self adaptation streams transmission server with automatic rate shaping |
| CN105580375A (en) * | 2013-08-02 | 2016-05-11 | 英国电讯有限公司 | Video caching |
| CN106134147A (en) * | 2014-03-18 | 2016-11-16 | 高通股份有限公司 | Realize the delivery acceleration device of request manager and connection manager function |
| CN111083202A (en) * | 2019-11-28 | 2020-04-28 | 中科驭数（北京）科技有限公司 | Multi-connection interaction method and device for TCP/IP accelerator |
| CN111083202B (en) * | 2019-11-28 | 2021-03-26 | 中科驭数（北京）科技有限公司 | Multi-connection interaction method and device for TCP/IP accelerator |
| CN111756850A (en) * | 2020-06-29 | 2020-10-09 | 金电联行（北京）信息技术有限公司 | Automatic proxy IP request frequency adjusting method serving for Internet data acquisition |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| CN101014947A (en) | Apparatus, system, and method for adaptive-rate shifting of streaming content | |
| US20200389510A1 (en) | Apparatus, system, and method for adaptive-rate shifting of streaming content | |
| US11677798B2 (en) | Apparatus, system, and method for multi-bitrate content streaming | |
| AU2011213730B2 (en) | Apparatus, system, and method for adaptive-rate shifting of streaming content |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| C06 | Publication | ||
| PB01 | Publication | ||
| C10 | Entry into substantive examination | ||
| SE01 | Entry into force of request for substantive examination | ||
| C12 | Rejection of a patent application after its publication | ||
| RJ01 | Rejection of invention patent application after publication |
Open date: 20070808 |