CN101611365B - Hybrid buffer management - Google Patents

Hybrid buffer management Download PDF

Info

Publication number
CN101611365B
CN101611365B CN200780043185.2A CN200780043185A CN101611365B CN 101611365 B CN101611365 B CN 101611365B CN 200780043185 A CN200780043185 A CN 200780043185A CN 101611365 B CN101611365 B CN 101611365B
Authority
CN
China
Prior art keywords
media stream
impact damper
processing apparatus
contents processing
frame
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Expired - Fee Related
Application number
CN200780043185.2A
Other languages
Chinese (zh)
Other versions
CN101611365A (en
Inventor
哈尔帕·S·巴萨利
马赛罗·D·莱希纳
莫舍万·明瓦拉
劳尔·阿尔德雷
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
Verizon Data Services LLC
Original Assignee
Verizon Data Services LLC
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Priority claimed from US11/691,730 external-priority patent/US8341282B2/en
Application filed by Verizon Data Services LLC filed Critical Verizon Data Services LLC
Publication of CN101611365A publication Critical patent/CN101611365A/en
Application granted granted Critical
Publication of CN101611365B publication Critical patent/CN101611365B/en
Expired - Fee Related legal-status Critical Current
Anticipated expiration legal-status Critical

Links

Images

Landscapes

  • Two-Way Televisions, Distribution Of Moving Picture Or The Like (AREA)
  • Information Transfer Between Computers (AREA)

Abstract

A computing device selectively receives a media stream. A buffer included within the computing device selectively stores frames from the media stream, the buffer being configured to be a certain size. Program instructions within the computing device are for sending an alert message when the alert threshold is reached and for receiving, in response to the alert message, a flush instruction along with recovery information.

Description

Hybrid buffer management
The cross reference of related application
The application require on November 21st, 2006 submit to be entitled as " streaming media buffer device time-delay management (STREAMING MEADIA BUFFER LATENCY MANAGEMENT) ", application number is the right of priority of 60/860,278 U.S. Provisional Patent Application.
Background information
Streaming Media be commonly referred to as in the source media content download such as media server via or can come the playing media content via playback software or reproducing device at least.Can the for example such streaming medium content of video and audio content be provided according to multiple standards and form.For example, well-known have standard of announcing such as the such video standard of Quick Time and RealMedia and by Motion Picture Experts Group (MPEG) or the like.
Such many of design such as mpeg stream delivery of content have two purposes when being used for many standards of streaming medium content: (1) is kept the network bandwidth and is kept video quality with (2).Yet, when designing the Streaming Media of MPEG and other kind, do not have the purpose that for example reduces the timely transmission content of time-delay and so on.For example, at present, the contents processing apparatus such as STB (STB) uses MPEG usually and is designed to and transmits complete video flowing with time-delay as cost.
The Media Stream that arrives the arrival STB such as mpeg stream of STB possibly face network jitter (jitter), and it can cause the excessive storage in the impact damper of media frame in STB of frame of video and so on for example.Before showing all previous frames, do not show the frame that STB receives.Yet in some situation, for example, in the interactive application such as recreation, user expectation is pushed in response to key and on its video display, is upgraded in time.At present, the user supports application unsatisfactorily in multiple situation video flowing is usually left in the time-delay that is caused by shake for.
Game on-line is a kind of situation that the Media Stream time-delay can cause unsatisfied user experience.For example, when through when recreation is provided such as STB contents processing apparatus such as (STB), the game server of gaming session (session) from video hub office (VHO) is delivered to the STB in the client as mpeg video stream etc. through packet switching network.That is to say, on game server, carry out gaming session, but this gaming session is come to appear through mpeg stream by STB.Therefore, gaming session is encoded to mpeg stream and is sent to STB through the network streaming.Be presented on the media playback such as TV or video monitor by STB decoding mpeg stream and with it.Through will collect the input of user such as input equipments such as radio frequency (RF) or infrared remote control, USB (USB) game paddles to recreation.Then, send user's input back to game server through packet switching network.This game server receives user's input and it is offered gaming session handling, thereby suitably revises outputting video streams based on this input.It is untimely and/or invalid that time-delay in the mpeg stream can cause that the user imports, and therefore causes to make the unsatisfied game experiencing of user.
Therefore, being used to such as the mpeg stream delivery of content provides many standards of Streaming Media to be designed to have traditional purpose that (a) keeps the network bandwidth and (2) maintenance video quality.Yet the same with the situation of many Media Streams, mpeg video stream is not designed to not have the purpose that for example reduces the timely transmission content of time-delay and so on.For example, at present, it is that cost is transmitted unbroken video flowing that the contents processing apparatus such as STB (STB) is designed to the time-delay.
Description of drawings
Fig. 1 illustrates the example system that is used to provide game on-line.
Fig. 2 illustrates exemplary buffer management process.
Fig. 3 illustrates and is used for removing according to the instruction that receives from server the example process of (flush) impact damper.
Fig. 4 illustrates the example process that is used for when the buffer capacity restriction that reaches predetermined application-specific, removing impact damper.
Fig. 5 shows the process that is used for local controller buffer and is used for from the example process of the mixing of the process of the removing of server triggers impact damper.
Embodiment
Fig. 1 shows the example system 100 that is used for providing to client residence 101 game on-line, and said client residence 101 is used for being visited through contents processing apparatus 110 and media player 115 by user 102.Client residence 101 can be household, enterprise or any other position that comprises contents processing apparatus 110, and can comprise a plurality of contents processing apparatus 110.
Contents processing apparatus 110 normally for example STB (STB) or similar devices and so on specialized equipment, be used for offering media player 115 from head end 155 receiving media contents 150 and with media content 150 via network 145.Can media content 150 for example be provided as simulating signal or as digital signal, wherein the analog or digital vision signal comprises Media Stream.Contents processing apparatus 110 generally includes processor and storer, and can provide privately owned or special purpose operating system.For example, contents processing apparatus 110 can provide the STB such as known real time operating system (RTOS).Yet; Be understood that; Usually the role who belongs to contents processing apparatus 110 among this paper can be by replacing serving as such as computing machine 118, computing equipment or the mobile device such as cell phone 121 119, as long as this equipment is can be from network 145 receiving media contents 150 and/or through network 125 receiving medias stream 127 and can store and carry out such as the programmed instruction that can be stored on the computer-readable medium.In addition, illustrated like the layout of the equipment among Fig. 1 119 and 121, need this type of computing equipment be arranged in the client residence 101, can insert packet switching network 125 Anywhere but can it be arranged on it usually.
Contents processing apparatus 110 can comprise games application 111.Games application 111 can comprise the programmed instruction especially for receiving media stream 127.Games application 111 comprises also usually and is used for Media Stream 127 is provided and is used for for example receiving the programmed instruction from user 102 instruction and input via controller 116 to user 102 through media player 115 that this type of instruction and input will be provided for games application server 140.In order to promote Media Stream 127 to be provided through media player 115; Contents processing apparatus 110 generally includes for example known frame buffer 112, stream decoder 113, for example video encoder/decoder (codec) and audio encoder/decoder (codec).When the unit that in contents processing apparatus 110, receives Media Stream 127 (for example frame), usually it is stored in the impact damper 112 to wait for that demoder 113 handles.Be understood that demoder 113 can be for example known to the MPEG codec that is used for MPEG-2 or MPEG-4 standard.Other programmed instruction in the contents processing apparatus 110 is used for making the audio & video of Media Stream 127 synchronous, suitably scaling video or the like.
Media player 115 is from contents processing apparatus 110 receiving media contents 150 and play this type of media content 150 and make that it can be by user's perception.Media player 115 can be for example known television receiver, comprises TV or HDTV (HDTV).Media player 115 can also be used to providing some function that provided by contents processing apparatus 110 and the user interface of menu.For example, TV can be used for display graphical user interfaces with the various menus in the visit STB.In addition; Can and possibly carry out the operation that belongs to contents processing apparatus 110 and media player 115 among this paper by one in computing equipment 118,119,121 etc. fully fully or almost in many cases, can from system 100, save media player 115 and/or contents processing apparatus 110 thus.
User 102 can utilize controller 116 to come operating content treatment facility 110.The known wireless communication that controller 116 normally can infrared through comprising (IR) be communicated by letter with radio frequency (RF) is come the telepilot of optionally communicating by letter with contents processing apparatus 110.Controller 116 can comprise numerical key, arrow button, special function keys, directionkeys or the like, but also can comprise alphanumeric key.Controller 116 can also be for example known wired or wireless keyboard or game paddle or another kind of human interface device (HID).User 102 can utilize controller 116 to select carrier content channel, visit various menus and option setting, select and ask and import data, such as the user instruction or the user's input that are used to be included in the game client application 1 11 in the content treatment facility 110.Controller 116 help usually visiting by or the various functions and the menu that provide through contents processing apparatus 110, and can also be used to controlling miscellaneous equipment, comprise media player 115.In carrying out this paper, belong to the operation of media player 115 and/or contents processing apparatus 110; In the computing equipment 118,119,121 etc. one can also comprise key, button, touch pad etc. to carry out among this paper with reference to controller 116 the operation described, can from system 100, save controller 116 thus.
Contents processing apparatus 110 is optionally communicated by letter with various device via broadband home router (BHR) 117, and said broadband home router (BHR) 117 comprises the computing machine 118 that user 102 can visit.BHR 117 can be the one or more equipment that become known for route network traffic usually.The data transmission that BHR 117 promotions are carried out through one or more networks, said network comprises packet switching network 125 and media distributing network 145.
Known BHR 117 be used in client residence 101 such as contents processing apparatus 110 such equipment distribution audio frequency, video and data.For example, BHR 117 can be broadband home router or the WiMAX home router from the intelligence advanced in years Microtronic A/S in actiontec electronics, inc. city.BHR 117 can also provide wired or WLAN (LAN), thereby the selective communication between the various device in the client residence 101 is provided.For example, computing machine 118 can utilize BHR 117 to communicate by letter with contents processing apparatus 110.Computing machine 118 can be computer workstation, desk-top computer, notebook, laptop computer, handheld computer, PDA(Personal Digital Assistant), mobile phone, smart phone or some other computing equipment of utilizing hardware and software to communicate by letter with contents processing apparatus 110.
Contents processing apparatus 110 can use BHR 117 to come to packet switching network 125 transmission information with from packet switching network 125 reception information.BHR 117 can insert packet switching network 125 through gateway router 120.
Contents processing apparatus 110 can also come receiving media stream 127 via packet switching network 125.Each provenance in the video hub office (VHO) 135 can provide Media Stream 127, comprises games application server 140.Can be according to Media Stream 127 being provided such as in many known standards such as MPEG any one.Known games server 140 is used for providing various interactive entertainments to use to user 102, and this type of application provides Media Stream 127.
Media distributing network 145 is networks that for example known being used to provides media content 150.For example, network 145 can comprise the hardware and software that is used for providing via coaxial cable and/or optical fiber cable vision signal.As known, from head end 155 media content 150 is offered media distributing network 145 usually.
Packet switching network 125 can be Internet protocol (IP) network that utilizes the known protocol that exists usually in the Internet protocol family usually.For example, network 125 can use such as agreements such as UDP (UDP), transmission control protocol (TCP), HTTP(Hypertext Transport Protocol)s.In addition, network 125 can comprise multiple network, such as wide area network (WAN), for example the Internet, Local Area Network, fiber optic network or the like.As known, can transmit several data with packet switching network 125, comprise multi-medium data, such as Voice & Video.Therefore; Be understood that; Such embodiment can be arranged; Wherein in fact network 125 and 145 is combined into a network, perhaps wherein saves media distributing network 145 simply, use packet switching network 125 to come media content 150 to be provided thus to contents processing apparatus 110, computing machine 118 etc.
Known gateway router one 20 is used for dividing into groups at packet switching network 125 route datas.Gateway router 120 allows contents processing apparatus 110 to insert packet switching network 125.Through communicating by letter with router one 20, contents processing apparatus 110 can obtain such as network addresss such as Internet protocol (IP) addresses, thereby makes contents processing apparatus 110 to ask or receive data from application server 140 etc. to application server 140 grades.
Computing equipment such as contents processing apparatus 110, client computer 118, games application server 140 and similar devices can adopt any in many known computer operating systems.For example, this kind equipment can use Microsoft Windows operating system; The Unix operating system solaris operating system of the Sun Microsystems of California Menlo Park issue (for example, by); AIX UNIX operating system by the issue of the International Business Machine Corporation (IBM) of New York A Mengke; And by the (SuSE) Linux OS of the Motorola Inc. of schaumburg issue and any known version and/or the kind of Vortex operating system.Computing equipment can comprise and any in known many computing equipments includes but not limited to computer workstation, desk-top computer, notebook, laptop computer, handheld computer, STB or some other computing equipment.
Computing equipment such as the miscellaneous equipment that contents processing apparatus 110 and this paper mention can be carried out the instruction that is stored on the computer-readable medium usually, such as the instruction that is included in the application 1 11.Can use the multiple known programming language and/or the computer program compiling or the interpretive machine executable instruction of technological innovation; Said known programming language and/or technology comprise either alone or in combination; But be not limited to Java, C, C++, Visual Basic, Java Script, Perl or the like.Usually, processor (for example microprocessor) receives from the instruction of for example storer, computer-readable medium etc. and carries out these instructions, thereby carries out one or more processes, comprises one or more process as herein described.Can be with using multiple known computer-readable medium to store and send this type of instruction and other data.
Computer-readable medium comprises any medium of participating in providing data (for example instruction), and it can be read by computing equipment.This type of medium can be taked many kinds of forms, includes but not limited to non-volatile media, Volatile media and transmission medium.Non-volatile media comprises for example CD or disk and other permanent memory.Volatile media comprises the dynamic RAM (DRAM) of common formation primary memory.Transmission medium comprises coaxial cable, copper cash and optical fiber, comprises the lead that comprises the system bus that is coupled to processor.Transmission medium can comprise or transmit sound wave, light wave and Electromagnetic Launching, such as during radio frequency (RF) or infrared (IR) data communication, generate those.The general type of computer-readable medium for example comprises: floppy disk, flexible plastic disc, hard disk, tape, any other magnetic medium, CD-ROM, DVD, any other optical medium, punched card, paper tape, any other physical medium with sectional hole patterns, RAM, PROM, EPROM, FLASH-EEPROM, any other storage chip or box, the carrier wave described in hereinafter, computing machine can be from its any other medium that reads.
Fig. 2 shows exemplary buffer management process 200; It uses through the buffer capacity of adjustment effectively, promptly limits the maximum-delay that the media units of frame of video and so on for example allows experience from the angle of subscriber equipment 118,119,121 etc.; And if expection will then be left out this frame above this restriction from impact damper 112.Process 200 advantageously consumes the minimum of resources on the contents processing apparatus 110.Process 200 also provides the advantage of the minimum of resources on the application server consumption such as the server 140.Should see that process 200 causes removing of most recent units (for example frame of video) in the Media Stream 127.
In step 205, application 1 11 is set up the capacity of impact damper 112, for example from the maximum number of the unit that can be stored in the Media Stream 127 in the impact damper 112 (for example frame).Can come according to the programmed instruction in the application 1 11 to confirm in advance perhaps can be according to the capacity of the impact damper of confirming from the message of server 140 in step 205, to set up 112.Can be at the capacity that comprises the initialized any time of stream and during streaming is sent, set up or revise impact damper 112.According to confirming that from the message of server 140 or instruction the capacity of impact damper 112 provides at the different types of Media Stream 127 that provides through 11 pairs of servers 140 of application 1 (for example different types of recreation) dirigibility in the different time delay is provided effectively.In addition, recreation possibly will be allowed different media application (for example advertisement) interruption of the time-delay of varying level.Usually, media flow with different 127 can be allowed the time-delay more more or less than other Media Stream.It should be understood that the capacity that limits impact damper 112 provides the unit of Media Stream 127 in impact damper 112, to spend effectively through the unit (for example one or more packet) of when impact damper 112 is full of, leaving out Media Stream 127 maximum time postpones.That is to say, when impact damper 112 is full of, can leave out rather than on the basis that postpones, provide the unit of Media Stream 127.
Next, in step 210, contents processing apparatus 110 receives from the unit in the Media Stream 127 of application server 140 according to the instruction in the application 1 11 through aforesaid network 125 usually.
Next, in step 215, contents processing apparatus 110 confirms according to the instruction in the application 1 11 whether impact damper 112 is full of.If impact damper 112 underfills, then execution in step 220 next.Otherwise next execution in step 225.
In step 220, the unit (for example frame of video) of the Media Stream 127 that application 1 11 receives in the comfortable step 210 in the future is stored in the impact damper 112.
In step 225, leave out the unit that in step 210, receives, wherein application 1 11 has confirmed in above-mentioned steps 215 that impact damper 112 is full of.
Next, in step 230, application 1 11 confirms whether Media Streams 127 are to stop or continue, promptly exist other frame that will handle.If then process 200 turns back to step 210.Otherwise process 200 finishes.
About process 200 and other process as herein described; Be understood that; Usually with continuous basically form the Media Stream 127 that has begun is provided; Even and when other step in the implementation 200 (or other process, if be suitable for), also as preceding text are set forth with reference to step 210, continue to provide Media Stream 127 usually.It should be understood that for the different frame in the Media Stream 127, simultaneously the various steps of implementation 200.That is to say that before second frame being begun processing, step 215 to 240 the process that is used for first frame possibly not accomplished.Therefore, Fig. 2 shows process 200 about a frame in the Media Stream 127, but is not intended to cover up wherein simultaneously or handles concomitantly the real world example of a plurality of frames in the Media Stream 127.For example, in step 215, after storage first frame, can even before about the first frame execution in step 230, store second frame like step 215 saidly.In addition, though from impact damper 112, remove frame about process 200 is not mentioned, even be understood that when from impact damper 112, removing unit (for example frame) by games application 111, impact damper 112 also can become full or near threshold value.
Fig. 3 shows and is used for removing according to the instruction that receives from server 140 example process 300 of impact damper 112.Process 300 provides the advantage that consumes the minimum of resources in the contents processing apparatus 110, and relatively easily in client device, realizes.In addition, when removing according to process 300, impact damper 112 advantageously keeps up-to-date and " important " frame of video.
In step 305, contents processing apparatus 110 receives the Media Stream 127 from application server 140 through aforesaid network 125 according to the instruction in the application 1 11 usually.
Next, in step 310, application 1 11 confirms whether it has detected the instruction of removing impact damper 112 in Media Stream 127.For example, when when network 125 receives Media Stream 127, Media Stream 127 is the stream that comprises the grouping of header and other known field.This type of grouping can comprise the part as Media Stream 127 such as audio-frequency information, video information.Yet this type of grouping can also comprise the information that instruction is provided to application 1 11.For example; Server 140 can provide instruction according to programmed instruction; Specific frame or frame set that said programmed instruction is confirmed to be stored in the impact damper 112 are particular importances, therefore should leave out present frame in impact damper 112 to hold the set of this type of frame on the horizon or frame.Therefore, can order application 1 11 to remove impact damper 112.For example, can in known manner this type of instruction be included in the MPEG transport stream.Perhaps, can be in known manner this type of instruction be included in independently in the control stream.Advantageously, can make the application-specific that this type of instruction is applicable to be provided by server 140, for example specific recreation.Under any circumstance, if in step 310, receive the instruction of removing impact damper 112 from server 140, execution in step 315 next then.Otherwise next execution in step 320.
Next, in step 315, application 1 11 impels impact damper 112 to be eliminated.Therefore, impact damper 112 will be idle, the frame in the Media Stream 127 that can be used for arriving, and will handle the frame of these type of arrivals immediately by codec 113 and codec 114 from impact damper 112.
Next, in step 320, application 1 11 confirms whether Media Stream 127 has arrived its terminal point.If then process 300 finishes.Otherwise process 300 turns back to step 305.
Fig. 4 shows the example process 400 that is used for when reaching the restriction of predetermined application specific buffer capacity, removing impact damper 112.Be important to note that, trigger according to the impact damper 112 of process 400 by the condition in the impact damper 112 rather than by server 140 and remove.The method of process 400 has provides the adjustment of dynamic buffer limit with compensation such as the delay in other system's 100 elements such as network 125, server 140 and keep the advantage of up-to-date frame during gaming session.In addition, process 400 need also suitably be removed impact damper to measure end-to-end delay such as the realization of application vendors such as game provider, is impact damper 112 and sets up the capacity limit that is fit to application.
In step 405, set up the capacity limit of impact damper 112.It should be understood that as stated, can flow at receiving media and revise this capacity limit in 127 the process.For example, server 140 can send instruction is provided with impact damper 112 with the application (for example recreation) of being asked based on user 102 capacity limit to application 1 11.
Next, in step 410, contents processing apparatus 110 receives the Media Stream 127 from application server 140 through aforesaid network 125 according to the instruction in the application 1 11 usually.
Next, in step 415, application 1 11 determines whether to reach the capacity limit of the impact damper of in step 405, setting up 112.If reached this capacity limit, execution in step 420 next then.Otherwise next execution in step 425.
In step 420, remove impact damper 112.Note that and to come implementation 400, particularly step 420 through partly rather than fully removing impact damper 112.Under the situation of partly removing impact damper 112, the frame of removing is the earliest a frame in the impact damper, and this is desirable, because the up-to-date frame that receives that keeps in the impact damper 112 is normally desirable.Situation about removing fully with the impact damper that for example in step 420, possibly carry out 112 is the same; Impact damper 112 parts remove can during gaming session, provide dynamic buffer limit adjustment with compensation such as the delay in other system's 100 elements such as network 125, server 140, and impact damper 112 parts are removed and are kept up-to-date frame.In addition; Situation about removing fully with impact damper 112 is the same; Impact damper 112 parts are removed to utilize such as the realization of application vendors such as game provider and are measured end-to-end delay and suitably remove impact damper, are impact damper 112 and set up the capacity limit that is fit to application.
In step 425, application 1 11 confirms whether Media Stream 127 has arrived its terminal point.If then process 400 finishes.Otherwise process 400 turns back to step 410.
Fig. 5 shows example process 500, and it is the process that is used for local controller buffer 112 and be used for triggering mixing of process that impact dampers 112 remove from server 140.
Step 505 is similar to above-mentioned steps 205, and step 505 that different is comprises setting up of alarm levels that the capacity with impact damper 112 in this step, set up equally is relevant in addition.The alarm levels of in this step 505, setting up can be expressed as certain mark (fraction) of the capacity of impact damper 112 usually.In addition, it should be understood that the alarm levels and the capacity that can be in operation, promptly in receiving media stream 127, revise impact damper 112.As will see hereinafter that the purpose of the alarm levels of in this step, setting up provides the mechanism of the warning that is used for can being filled very soon to server 140 transmission buffers 112.That is to say, can alarm levels be regarded as being used to providing the threshold value of the alarm of relevant impact damper 112 states.
Next, the similar mode of step 210 process 200 described modes is come execution in step 510 with preceding text.
Whether next, in step 515, contents processing apparatus 110 determines whether to reach the alarm levels of in step 505, setting up, that is, impact damper 112 has been filled to or surpasses alarm levels (being threshold value).If no, then process 500 turns back to step 510.Otherwise next execution in step 520.
In step 520, contents processing apparatus 110 sends message has reached impact damper 112 with notification server 140 alarm levels to server 140 according to the programmed instruction in the application 1 11 usually.
Next, in step 525, server 140 sends and contents processing apparatus 110 receives the message of removing impact damper 112.
Next, in step 530, contents processing apparatus 110 impels impact damper 112 to be eliminated according to application 1 11 and programmed instruction usually.
Next, in step 535, server 140 sends and contents processing apparatus 110 receives the information that allows stream decoders 113 from the removing of the impact damper 112 that forms about step 530 like preceding text, to recover saidly.For example, in mpeg stream, known decoder expectation frame of video arrives successively, and further depends on the reception reference frame, and this reference frame is used for not only itself being decoded, and will depend on other frame decoding of this reference frame.Therefore, when impact damper 112 is eliminated, maybe to stream decoder 113 again reference frame information is provided in case allow not to user 102 experience serious, so that continue under the situation about significantly disturbing with Media Stream 127 decodings.
Next, application 1 11 confirms whether Media Stream 127 has arrived its terminal point.If then process 500 finishes.Otherwise process 500 turns back to step 510.
The exemplary embodiment that this paper discussed comprises based on network stream game services, and in the situation of stream video, further discusses.Yet, embodiment can and expection will expand to remove to shorten delay time the also very favourable any Media Stream service of timely transmission of content.For example, Media Stream 127 can comprise rest image, data or the similar information of stock quotation machine information is provided.
About process as herein described, system, method, heuristic method (heuristics) etc.; Be understood that; Though the step of this class process etc. is described as taking place according to certain sequence, can use according to except that order described herein other in proper order and the said step of execution is implemented this class process.It will also be appreciated that and to carry out some step simultaneously, can add other step, perhaps can omit some step as herein described.In other words, the purpose that among this paper the explanation of process is in some embodiment of explanation provides, and never should it be interpreted as the described invention of restriction claim.
Therefore, it should be understood that above-mentioned illustration is an illustrative and nonrestrictive.When reading above-mentioned explanation, the many embodiment except that providing example are conspicuous with using for a person skilled in the art.Should not confirm scope of the present invention, but should confirm scope of the present invention with reference to the gamut of equivalent of enclosing claims and authorized the right of this type of claim with reference to above-mentioned explanation.Can expect and be intended to be that further development will take place in the technology of discussing at this paper, and disclosed system and method will be merged among this type of following embodiment.In a word, it should be understood that the present invention can carry out various modifications and change, and only limit following claim.
Only if carry out opposite clearly indication among this paper, otherwise employed all terms intention is endowed its its common meaning of being understood of reasonable dismissal and those skilled in the art the most widely in claims.Especially, only if the restriction that claim is explicit in one's statement on the contrary, otherwise should the use such as speech such as " one ", " being somebody's turn to do ", " said " be read to quoting one or more indicated elements.

Claims (15)

1. method of managing impact damper comprises:
By contents processing apparatus is that impact damper is set up limited capacity, and wherein said limited capacity is corresponding to the particular media stream that is provided by application server, and the frame that said limited capacity is said Media Stream is provided at the maximum delay that stops in the said impact damper;
Set up the alert threshold of said impact damper by said contents processing apparatus;
Receive said Media Stream via packet switching network from said application server by said contents processing apparatus;
To be stored in the said impact damper from the frame of the Media Stream that receives by said contents processing apparatus;
When reaching said alert threshold, send alert message to said application server by said contents processing apparatus; And
Receive the clear instruction in response to said alert message by said contents processing apparatus from said application server, and receive recovering information subsequently, said recovering information comprises reference frame.
2. method according to claim 1 also comprises:
Carry out said clear instruction; And
After carrying out said clear instruction, use said recovering information with the Media Stream decoding that receives.
3. method according to claim 2 also comprises to media player decoded output is provided.
4. method according to claim 1, wherein, said alert threshold is less than said limited capacity.
5. method according to claim 1, wherein, according to the standard of Motion Picture Experts Group (MPEG) with said media stream formatsization.
6. buffer management system comprises:
Computing equipment, its via packet switching network from application server receiving media stream optionally;
Impact damper; It is included in the said computing equipment; Optionally store frame from said Media Stream; Said impact damper is configured to limited capacity, and wherein said limited capacity is corresponding to the particular media stream that is provided by said application server, and the frame that said limited capacity is said Media Stream is provided at the maximum delay that stops in the said impact damper; And
Buffer management block, it is used in said computing equipment: for said impact damper is set up alert threshold; When reaching said alert threshold, send alert message to said application server; And from the clear instruction of said application server reception in response to said alert message, and receiving recovering information subsequently, said recovering information comprises reference frame.
7. system according to claim 6 also comprises:
Remove module, it is used to carry out said clear instruction; And
Demoder, it uses said recovering information with the Media Stream decoding that receives after carrying out said clear instruction.
8. system according to claim 7 also comprises the media player that optionally receives decoded output from said demoder.
9. system according to claim 6, wherein, said alert threshold is less than said limited capacity.
10. system according to claim 6 also comprises receiving said alert message and sending the server of said clear instruction and said recovering information.
11. system according to claim 6, wherein, said Media Stream is formatd according to the standard of Motion Picture Experts Group (MPEG).
12. system according to claim 6 also comprises the packet switching network that transmits said Media Stream.
13. a method of managing impact damper comprises:
By contents processing apparatus is that impact damper is set up limited capacity, and said limited capacity is corresponding to the particular media stream that is provided by application server, and the frame that said limited capacity is said Media Stream is provided at the maximum delay that stops in the said impact damper;
Set up the alert threshold of said impact damper by said contents processing apparatus, said alert threshold is less than the said limited capacity of said impact damper;
Receive said Media Stream via packet switching network from said application server by said contents processing apparatus;
To be stored in from the frame of received Media Stream in the said impact damper by said contents processing apparatus and it to be handled with device to be decoded;
When reaching said alert threshold, send alert message to said application server by said contents processing apparatus;
Receive the clear instruction in response to said alert message by said contents processing apparatus from said application server, and receive recovering information subsequently, said recovering information comprises reference frame;
Carry out said clear instruction by said contents processing apparatus; Wherein carrying out said clear instruction comprises: from the Media Stream that is received, abandon being stored in the subclass at least of the frame in the said impact damper, rather than the said subclass at least of said frame is offered said demoder on the basis of delaying; And
After carrying out said clear instruction, use said recovering information with the Media Stream decoding that receives, wherein use said recovering information to comprise reference frame information is offered said demoder again by said contents processing apparatus.
14. method according to claim 13 also comprises to media player decoded output is provided.
15. method according to claim 13, wherein, according to the standard of Motion Picture Experts Group (MPEG) with said media stream formatsization.
CN200780043185.2A 2006-11-21 2007-11-12 Hybrid buffer management Expired - Fee Related CN101611365B (en)

Applications Claiming Priority (5)

Application Number Priority Date Filing Date Title
US86027806P 2006-11-21 2006-11-21
US60/860,278 2006-11-21
US11/691,730 2007-03-27
US11/691,730 US8341282B2 (en) 2006-11-21 2007-03-27 Hybrid buffer management
PCT/US2007/084443 WO2008063964A1 (en) 2006-11-21 2007-11-12 Hybrid buffer management

Publications (2)

Publication Number Publication Date
CN101611365A CN101611365A (en) 2009-12-23
CN101611365B true CN101611365B (en) 2012-11-14

Family

ID=41471008

Family Applications (2)

Application Number Title Priority Date Filing Date
CNA200780042892XA Pending CN101606354A (en) 2006-11-21 2007-11-12 Buffer management based on priority
CN200780043185.2A Expired - Fee Related CN101611365B (en) 2006-11-21 2007-11-12 Hybrid buffer management

Family Applications Before (1)

Application Number Title Priority Date Filing Date
CNA200780042892XA Pending CN101606354A (en) 2006-11-21 2007-11-12 Buffer management based on priority

Country Status (1)

Country Link
CN (2) CN101606354A (en)

Families Citing this family (1)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN109889542B (en) 2012-10-11 2021-08-31 三星电子株式会社 Method and apparatus for receiving media data in a broadcast network

Citations (1)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN101002453A (en) * 2004-06-17 2007-07-18 惠普开发有限公司 Method and system for interactive control of media over a network

Patent Citations (1)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN101002453A (en) * 2004-06-17 2007-07-18 惠普开发有限公司 Method and system for interactive control of media over a network

Also Published As

Publication number Publication date
CN101611365A (en) 2009-12-23
CN101606354A (en) 2009-12-16

Similar Documents

Publication Publication Date Title
US8341282B2 (en) Hybrid buffer management
EP1382173B1 (en) Data distribution system
US8078228B2 (en) Method and apparatus for displaying messages in an idle state of mobile terminal, driving an application for an idle state in a mobile terminal and providing idle state contents for a mobile terminal
CN102281473A (en) Information processing method for television terminal and television terminal
CN101502111A (en) Synchronized media experience
CN101978624B (en) Method and system for updating an interaction document
US20080059648A1 (en) Dynamically Configurable Processing System
Tizon et al. MPEG-4-based adaptive remote rendering for video games
CN113661692A (en) Dynamic self-adaptive streaming transmission method and device based on HTTP
US20140153581A1 (en) Priority-based buffer management
US20030153265A1 (en) Video and graphics distribution system for mobile users
JP2004102339A (en) Content looking and listening system and its method
CN101193269A (en) A method for improving response speed of client VCR operation
CN102447950A (en) Method and equipment for video play
CN101611365B (en) Hybrid buffer management
CN103716651A (en) Image processing device, image processing method, and image processing system
CN1327443C (en) Method for switching between audio and video frequency instream media broadcast on demand
KR20230098146A (en) Insertion of target content into live streaming media
KR100612729B1 (en) Internet contents auto recording apparatus and method thereof, and internet contents auto recording system
CN117714798A (en) Remote video dynamic push control method and device
JPH1141585A (en) Video communication system

Legal Events

Date Code Title Description
C06 Publication
PB01 Publication
C10 Entry into substantive examination
SE01 Entry into force of request for substantive examination
REG Reference to a national code

Ref country code: HK

Ref legal event code: DE

Ref document number: 1136884

Country of ref document: HK

C14 Grant of patent or utility model
GR01 Patent grant
REG Reference to a national code

Ref country code: HK

Ref legal event code: GR

Ref document number: 1136884

Country of ref document: HK

CF01 Termination of patent right due to non-payment of annual fee

Granted publication date: 20121114

Termination date: 20141112

EXPY Termination of patent right or utility model