CN1996813B - Self-adapted media transfer management of the continuous media stream used for LAN/WAN environment - Google Patents
Self-adapted media transfer management of the continuous media stream used for LAN/WAN environment Download PDFInfo
- Publication number
- CN1996813B CN1996813B CN200610000213XA CN200610000213A CN1996813B CN 1996813 B CN1996813 B CN 1996813B CN 200610000213X A CN200610000213X A CN 200610000213XA CN 200610000213 A CN200610000213 A CN 200610000213A CN 1996813 B CN1996813 B CN 1996813B
- Authority
- CN
- China
- Prior art keywords
- client
- server
- video signal
- data
- transfer rate
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Expired - Fee Related
Links
Images
Landscapes
- Data Exchanges In Wide-Area Networks (AREA)
- Two-Way Televisions, Distribution Of Moving Picture Or The Like (AREA)
Abstract
This invention relates to one method to send compressed video flow by real-time type over traditional network or signal channel, wherein, each system adopts self-adaptive speed control technique based on detection deficiency pack, other integral system function , use mode and signal channel property factors; in order to control each signal channel materials plug, keeping vision quality into certain level by full use of human vision and eye adaptive ability.
Description
Technical field
The transmission of the relevant multimedia document of the present invention, the method and system of continuous data real-time Transmission in especially relevant LAN/Wide Area Network environment.
The mutual reference data of related application
The application's case is a U. S. application case the 11/172nd; No. 489; The continuity application case of denomination of invention " self-adapted media transfer management that is used for network/Wide Area Network environment continuous media stream ", this case is to be filed an application by Huang on June 29th, 2005, wherein asks the temporary transient application case the 60/583rd of the U.S. that proposed on June 29th, 2004; No. 360 rights and interests, and the whole case is incorporated this case into.
Background technology
Along with the appearance of all new application processes with new use pattern, the video signal of LAN/Wide Area Network environment current downflow has obtained significant importance.The consumer can enjoy the enjoyment of viewing and admiring video signal stream and/or listening to message stream from desktop or laptop computer, from the consumption of traditional media, creates a kind of brand-new typical case.Not only in the environment of individual digital video signal amusement, video signal stream also obtains to accept in corporate environment along with day by day popularizing of video conference and distance learning.
Unfortunately, the universalness of video signal stream has caused great burden for the available bandwidth of existing network capital construction.In the various application that with the network are the basis before, the data with meaning can use a kind of burst mode (burst mode) to transmit or reception.For example, use the user of web browser to chain to call out and call out usefulness (invoking) network address, to upgrade (update) user's webpage at a U RL (single resource addressing device) by mouse button.Network service between web browser and desired network address possibly last till that page refreshment is accomplished or the user chooses till another U RL renewal (refresh) its browser.Yet different with the various application that with the network are the basis before is that the audiovisual materials that flow just must be sent to a client (beholder) with the mode of Continuous Flow after the online foundation between client and the server-side.If the quantity of data stream does not maintain a certain position when accurate above when not equaling a minimum throughput (or), video signal may not have enough data can handle (decoding) and stop conditions occurs because of decoder.But but etc. data time spent once again, video signal can be replied immediately.
Visual radio before is in simulation net territory, to transmit video information; The video signal information that flows is also different with visual radio before; It must convert number format earlier to; Therefore become an IP Datagram (IP packets), could go up at an Internet Protocol (IP) network " such as home network (LAN) or world-wide web (Wide Area Network) " and transmit.Yet simple conversion becomes the digital network territory to video signal from simulation net territory, and can't let the user can on IP network, transmit video signal immediately, because the bandwidth that required video signal bandwidth allows greater than most existing networks.For example; (according to NTSC) is with the speed projection of per second 30 frames of standard; And pixel reaches 720 * 480 standard household TV; Wherein each pixel needs 2 bytes to do colored projection, and when not needing any data compression if will transmit a full screen video signal, its minimum throughput (throughput) will be about 19.78MBps or 158Mbps.The scope that this condition obviously can be supported above the capacity (10/100Mbps) of a typical LAN.Therefore, it is unactual to transmit original video signal length overall through the existing network framework; Perhaps, be difficult at least on network, do on-the-spot video signal transmission with prior art.Therefore, on IP network, compress video data before the data transmission, become a kind of necessary condition.
Existing multiple at present video signal compress technique is released, and constantly in improvement.Several kinds of compress techniques of wherein interest are MPEG, H.261, H.263, and H.264.Yet, even these compression engine are arranged, still needing constant throughput, the video signal that could will flow is sent to a display client from server-side.Unfortunately, zone/Wide Area Network is to be designed to a kind of " type as possible " media, attempts in minimum possible time range, to make data to arrive at receiving terminal (client) from source end (server-side) though meaning is it, can not guarantee so certain.
If the minimum throughput of unmet video signal may occur and beat when playing.Beat in order to find out in the video signal that flows existing video signal, the distinct methods that is widely used during video signal on the various lines (VOD) is used is such as all disposing buffer in client and server-side.Content provider (equaling server-side) during video signal is used on typical case's line can be transmitted video data again when display client requires because of producing the package leakage in transmitting or changeing blackmail.This kind technology can be removed video signal and beated and strengthen and view and admire impression.Yet,, in the application that needs are viewed and admired in real time, possibly cause significant delay though this kind method reaches the purpose of video signal on the line.During some is used in real time, such as on-the-spot video signal relay, save from damage supervise, and video conference, have time sensitivity, in the case, server-side can only transmit video data once.
In order to overcome " as possible type " characteristic of network, and simultaneously with the traffic on the mode supervising the network that more effectively has more predictability, developed now and multiple different service quality (QoS) processing method.For example, wherein a kind of method is can a preferential flag be placed in the header of information flow, to allow mobile an application from router and the higher excellent service standard of other application reception.This kind method is represented with DiffServ.Another kind method is to allow flow applications to keep request via one its service important document is broadcast to network.This kind method is represented with IntServ.Usually, know the flow applications of type (QoS-awared) router, can use resource reservation setup protocol (RSVP) as its end-to-end signal agreement according to service quality.Unfortunately, these methods can not guarantee that all between server-side and the client each passes on the equipment of supporting or understanding these agreements is a little all arranged, and therefore, might can't reach the great type of those tasks and use required continuous data and flow important document.
Therefore, people need a kind of system badly, both can cross over the system of legacy network with the real-time mode data transmission, and can during transfer of data, satisfy minimum threshold important document simultaneously, to keep the acceptable video signal quality of human vision.
Summary of the invention
The present invention provides multiple legacy network or channel have compressed audiovisual materials stream with real-time Transmission the method and system of crossing over.Each system all uses adaptation rate control (Adaptive Rate Control, ARC) technology.This kind technology be with detecting flaw package and other such as total system usefulness, use pattern, and the characteristic of channel etc. influence sexual factor and be the basis.For the data stream of controlling in each channel is jammed, and visual display quality is maintained more than a certain level, the vision that the present invention and then effective utilization are human and the mankind are to the adaptive faculty of the visual state of change.
Aforementioned adaptation rate control (ARC) technology depends on client server-side is transmitted the computing capability of video signal package quality, and server-side is transmitted the ability of required transfer rate information.This kind method has been simplified hardware and the software implementation instrument complexity that server-side before or content provide the end to bear, and the burden that will supervise bandwidth and transmission control is passed to client from server-side, reduces the global design cost thus.
One of the object of the invention provides the real-time control method of a kind of server-side to client data flow transmission rate, and wherein, this client has the comparison check table that uses the one of which stack features to produce.The method may further comprise the steps: receive first part that a data flows with a transfer rate from server-side, wherein this first part comprises most Datagrams; Check the integrality of these Datagrams; Determine package leakage ratio according to its integrality; Use this package leakage requirement of this comparison check table generation one this transfer rate of adjustment when; This requirement is sent to this server-side; And, receive second part that this data flows with adjusted transfer rate from this server-side.
Another purpose of the present invention provides the real-time control method of a kind of server-side to client data flow transmission rate, and wherein, this client has the comparison check table that uses the one of which stack features to produce.The method may further comprise the steps: receive the requirement of client to the adjustment transfer rate, wherein this client is to use package leakage this this requirement of comparison check table generation when; Receive at least one audio frequency input and at least one video signal input; Require to upgrade a data rate and this transfer rate according to this; With this audio frequency input of the data rate coding after upgrading and the input of this video signal; Back audio frequency and the video signal of will encoding input is combined in this data stream; And, with this data flow transmission to this client.
Still a further object of the present invention provides the real-time control method of a kind of server-side to client data flow transmission rate, and wherein, this client has the comparison check table that uses the one of which stack features to produce.The method may further comprise the steps: make this server-side with a transfer rate first of one data stream partly transferred to this client; Make this client receive this first part, wherein this first part comprises most Datagrams; Make the integrality of these these Datagrams of client inspection, and determine package leakage ratio according to its integrality; Make this client use this package leakage requirement of this comparison check table generation one this transfer rate of adjustment when, and this requirement is sent to this server-side; Make this server-side this requirement of reception and adjust transfer rate according to this requirement; And, make second part of this server-side with adjusted this data stream of transfer rate transmission.
Description of drawings
By with reference to following accompanying drawing, embodiment, can understand the present invention above-mentioned and other characteristics, purpose and advantage more, wherein:
Fig. 1 is according to real-time audio-video data flow transmission system schematic of the present invention;
Fig. 2 is a calcspar, the data stream between one of key diagram 1 said server-side and client;
Fig. 3 is the audio-visual hybrid system calcspar of implementing in the server-side shown in Figure 2;
Fig. 4 is the audio-visual compound decomposing system calcspar of implementing in the client shown in Figure 2; And
Fig. 5 is the exemplary steps flow chart of data transmission rate control of the present invention.
Embodiment
Below specifying is the present best Implementation Modes of the present invention, and its purpose is not in order to restriction the present invention, only is explanation General Principle of the present invention, because the scope of the invention is fully defined by appended claim.
Must be pointed out that at first singulative " ", " reaching ", " being somebody's turn to do " of using in this specification and the appended claim only if in the context clearly expression is arranged in addition up and down, otherwise are to comprise majority.Therefore, when for example, mentioning " client ", be to comprise one or more client and be familiar with this type of technological equivalence that the personage knew.
In the broadest sense, the present invention provides multiple and in real time environment, crosses over most legacy networks or channel and transmit the method and system of compression audiovisual materials stream.Each system can use adaptation rate control (Adaptive Rate Control, ARC) technology.This kind technology be with detecting flaw package and other such as total system usefulness, use pattern, and the characteristic of channel etc. influence sexual factor and be the basis.The present invention is different with the existing only controlling mechanism of being jammed according to channel characteristics or multilayer stream organon, and it can effectively utilize the human vision and the mankind to the adaptive faculty of the visual state of change, and visual display quality is maintained on the acceptable level.
Aforementioned adaptation rate control (ARC) technological responsible client transmits the computing capability of video signal package quality to server-side, and transmits the ability that required transfer rate information is given server-side.This kind method has been simplified the hardware/software implementation tool complexity that server-side before or content provide the end to bear, and the burden that will supervise bandwidth and transmission control is passed to client from server-side, reduces the global design cost thus.
Please with reference to Fig. 1.Fig. 1 is the sketch map according to real-time audio-video data transmission system 100 of the present invention, and this system comprises a LAN (LAN) system 101 and Wide Area Network (WAN) system 121.As shown in the figure; LAN 101 is meant the network system in aerial 120 left sides; It can comprise a network cable or WiFi channel 130 (hereinafter to be referred as cable), the server-side 106 that most personal computers 114,116, that are connected with cable 130 are connected with cable 130; One router one 12 that is connected with cable 130, and a framework is the laptop computer 110 that can communicate by letter with router one 12.LAN system 101 also can comprise most audio-visual display unit, such as network camera 108, cassette player 104, and television set 102.Wherein, these audio-visual display unit can couple with server-side 106, and with server-side (wired or wireless) 106 real-time exchange audiovisual materials.LAN system 101 can see through aerial 120 and with other LAN or Wide Area Network system communication.So-called aerial, the preferable world-wide web (Internet) that is meant.Can comprise in the LAN system 101 that a fire compartment wall 118 prevents that the data/program such as malice such as computer virus and spyware from getting into system.
Wide Area Network is meant the system on aerial 120 right sides, and it can comprise that one group of client or client terminal device and are commonly referred to access (leading to) point 122 of focus (Hot Spot), in order to the radio communication to client to be provided.Wherein, client comprises a personal computer 128 and other hand-held device, such as PDA(Personal Digital Assistant) 124 and mobile phone 126.Client 124,126,128 can be communicated by letter with server-side through aerial 120.Wherein, server-side can be a media server or a content provider, in order to provide the data that flows to client in real time.When below mentioning client or client terminal device one speech, be meant framework be can communicate by letter with server-side 106 and can with the flow device of data of server-side 106 real-time exchange.One client can have one or more audio-visual display system in order to show mobile data.The following data that further specifies between one of server-side and most clients with reference to Fig. 2-4 flows details.Among Fig. 1,, only show nine clients 102,104,108,110,114,116,124,126 and 128 for convenient event.Yet the personage who possesses general technical ability should be able to understand, and can also use the client terminal device of other suitable type in the system 100.
Among square Figure 200 of Fig. 2, the real-time mode data between one of the displayed map 1 whole institute server-side that is set forth in and most client terminal devices flows.As shown in the figure, a server-side 202 can be given a client 212 with compound audio-visual output data transmission via a network (zone or Wide Area Network) 210.Below will use " compound " (multiplex) and " polynary inserting " (interleave) two speech alternately.Compound audio-visual output data can comprise with preset data rate (compression ratio) compression to reduce mobile in the network 210 and be jammed and according to user's data packet protocol (userdatagram protocol, UDP) a formative video data.Can specify the method for decision data rate after a while.
When client 212 is received compound audiovisual materials, can data temporarily be stored in the addressee buffer 214.Then, addressee buffer 214 can be passed to an audio-visual compound decomposing system 218 with the data commentaries on classics.Audio-visual compound decomposing system 218 can resolve into two groups other data with complex document, and wherein each group data comprises a video signal or an audio signal; Check the integrality of two groups of data, and with two groups of data decodings.Can explain that after a while server-side 202 can be before the transmission data be given client 212, earlier audio stream and video signal being flowed polynary inserting becomes single data stream.As previously mentioned, each video signal frame possibly need suitable data quantity, and therefore, each frame data can be divided into many Datagrams earlier before seeing through network 210 transmission.Each package can have a header, package numbering in package sum, the frame in the record frame, frame (coordination) summation inspection, and information such as package length.
Audio-visual compound decomposing system 218 has a video signal ring buffer 244 and an audio frequency ring buffer 242 (see figure 4)s can be used for verifying the integrality of video data package and audio data package respectively.Below can be with reference to the audio-visual compound decomposing system 218 of Fig. 4 further explain.When video signal ring buffer 244 meets with when changeing package (being generically and collectively referred to as the flaw package) blackmail or leakage, it can abandon the frame that contains the flaw package, and a packet error accumulator 222 is transmitted notice.In another embodiment, if the package that changes blackmail is arranged, can use such as forward error more the error correction method of (ForwardError Corrections) rebuild this frame.In another embodiment, if the data (package of loss) of leakage is arranged, can use such as the restoring method of reversible variable-length (Reversible Variable Length) sign indicating number and handle this frame.Audio-visual compound decomposing system 218 can send audio frequency and the video data after the decoding to one player/loud speaker 220a and a video display 220b respectively.
Packet error accumulator 222 can regularly determine and transmit package leakage than giving a transfer ratio to check table (Transmission LUT) 224.Wherein, the definition of this package leakage ratio is: the ratio of the package sum of receiving in flaw package counting and the time-histories.When this time-histories begins, packet error accumulator 222 resettable flaw package countings.Packet error accumulator 222 can increase by 1 with flaw package counting when receiving the flaw package notice of audio-visual compound decomposing system 218.Simultaneously, the package sum in this time-histories, received of its count enable.When this time-histories finished, packet error accumulator 222 can calculate package leakage ratio, and sent this ratio to transfer ratio to check table 224.
This client 212 also can send its characteristic information to intelligent video signal delivery manager 208 when communicating by letter of 212 of server-side 202 and clients begins.Client features information can comprise display sizes; Highest resolution; Can support color figure place (or color depth); Type of display is (such as LCD; CRT; Or electric slurry type); Cpu type; Indication can support Format Type (such as MPEG1; MPEG2; MPEG4; H.263; H.264 or the like decoder capability); Free memory; Online type is (such as WiFi; LAN; Blue bud or the like); The previous online record that transmission information is described is (such as frame rate; Data rate; Quantization level; Resolution or the like); And the line construction (formula/alternating expression continues) of video display 220b.Then, according to these characteristic informations, server-side 202 can determine the initial transmission rate, and the stand-by period in the transfer of data is minimized, and makes the quality of data maximization of receiving.
Transfer ratio can be used this package leakage than reading a comparison check table to check table 224, whether needs adjustment to determine present transfer rate.This comparison check table can be client's special use, and uses the characteristic of this client 212 to produce.Then, transfer ratio can send intelligent video signal delivery manager 208 to via the requirement (like " control command " that indicates among Fig. 2) that network 210 will be adjusted present transfer rate to check table 224.Below can further specify the details of adjustment with reference to Fig. 4.
The requirement and the characteristic information that utilize client 212 to transmit; Intelligent video signal delivery manager 208 can be adjusted one group of parameter; Comprise that target frame rate, target show bit rate, target resolution, target audio sampling rate, quantized value, adjustment YC (YUV) transformation approach (4: 2: 2 to 4: 2: 0), engineer's scale size.Manager 208 also tunable integers and will be adjusted back data rate information and send an audio-visual hybrid system 24 to according to compression ratio (abbreviation data rate).Audio-visual hybrid system 204 can receive one or many audio-visual inlet flows 205; The inlet flow that coding receives; Use to receive and compress inlet flow from the data rate information of intelligent video signal delivery manager 208; Each frame data is divided into most packages, and these packages are sent to medium access control (MAC) buffer 206.As previously mentioned, each video signal frame can comprise suitable data quantity, and can be divided into most Datagrams, to be easy to see through network 210 transmission.Below can relevant audio-visual hybrid system 204 more detailed information be provided with reference to Fig. 3.Medium access control (MAC) buffer 206 can temporarily comprise the package that desire sees through network 210 transmission; And look the number of client and decide, transmit these packages with mono FM broadcasting (unicast), multicasting (multicast) or broadcasting (broadcast) pattern.
Fig. 3 is the calcspar of the audio-visual hybrid system 204 of enforcement in the server-side 202 shown in Figure 2.As shown in the figure, audio-visual hybrid system 204 can comprise an audio coder 230, in order to the input audio stream of encoding; One audio frequency ring buffer 232 is given an audio-visual recombiner 238 in order to relay coding back input audio stream; One video information coder 234 can be according to data rate coding (or compression) video signal inlet flow of receiving from intelligent video signal delivery manager 208; One video signal ring buffer 236 can be broadcast the video signal circulation of coding back to audio-visual recombiner 238; And this audio-visual recombiner 238, can coding back audio stream and video signal stream be combined into unitary composite data stream.In order to keep audio frequency/video signal synchronization and sampling clock pulse integrality, but audio stream and coding back video signal stream behind audio-visual recombiner 238 interweaving encodings.
As previously mentioned, the combined-flow package by a server-side transmits may be jammed because of network, the saturated and leakage or change blackmail during seeing through Network Transmission of decoder load saturation or system load.Therefore, must be after decomposing the combined-flow package, inspection sees through the integrality of the combined-flow package of network reception.For example, Fig. 4 shows the calcspar of audio-visual compound decomposing system 218 shown in Figure 2, and wherein, this audio-visual compound decomposing system 218 can resolve into an audio frequency and video signal stream with the combined-flow that receives; Check the integrality of this video signal stream; And, play for player/loud speaker 220a and video display 220b with these audio streams and the decoding of video signal stream.As shown in the figure, audio-visual compound decomposer 240 can become an audio stream and video signal stream with the data stream decoupling zero that receives.Then, it can be banished video signal into video signal ring buffer 244, and audio stream is put into an audio frequency ring buffer 242.Audio frequency ring buffer 242 can be checked audio-visual synchronous and frame synchronization respectively with video signal ring buffer 244, and before decoding, carries out necessary corrigendum.Video signal ring buffer 244 also can be checked the package whether any commentaries on classics blackmail and/or leakage are arranged, with the integrality of checking video signal stream (or package).When video signal ring buffer 244 ran into the flaw package, it can transmit a notice and give packet error accumulator 222.
Like preceding explanation, packet error accumulator 222 can determine and transmit package leakage to be compared to transfer ratio check table 224.Transfer ratio can be missed than the requirement that produces the adjustment transfer rate according to this package check table 224, and requires (or control command) to send server-side 202 to through user's data packet protocol (UDP) channel this.UDP command port/channel is a kind of arbitrary port (arbitraryport), by server-side 202 special appointments and reservation, for the usefulness of communicating by letter with client 212.Subsequently, server-side 202 can be adjusted transfer rate by control compression ratio, frame rate, groups of pictures (GOP) size, quantization level, display resolution or any combination of above each item.
The package leakage is than the indicating device that can be used as transmission state in the network 210.Transfer ratio can be used this package leakage than reading a comparison check table to check table 224.Wherein, it is special-purpose that this comparison check table can be the client, and use a stack features to produce.These characteristics comprise display sizes; Highest resolution; Can support color figure place (or color depth); Type of display is (such as LCD; CRT; Or electric slurry type); Cpu type; Indication can support Format Type (such as MPEG1; MPEG2; MPEG4; H.263; H.264 or the like decoder capability); Free memory; Online type is (such as WiFi; LAN; Blue bud or the like); The previous online record that transmission information is described is (such as frame rate; Data rate; Quantization level; Resolution or the like); And the line construction (formula/alternating expression continues) of video display 220b.
Transmission state can be subdivided into three sub-states: (1) no-load condition (2) load condition (3) state that is jammed.Each sub-state can have the package leakage ratio of a preset range.For example, suppose that present transmission state is at no-load condition, the leakage of wherein package is than less than 5% (the maximum leakage of expression transmission speed when per second 30 frames (30fps) is 1.5fps).When package leakage than less than 5% the time, transfer ratio is at no-load condition to the present transmission state of check table 224 decidables, and can reach higher data rate from the record of client features side.Transfer ratio can require server-side 202 to increase transfer rate with incremental mode to check table 224, surpasses till 30% up to package leakage ratio, that is, till transmission state arrives at the state that is jammed.Then, transfer ratio can require server-side 202 to reduce transfer rate to check table 224, till reaching load condition (package is missed than reaching a stable state).If the package leakage is than indicating; Transmission state has reached stable state, and then transfer ratio can transmit a requirement to intelligent video signal delivery manager 208 to check table 224, comprising a NOP signal (no operation signal or " being failure to actuate " signal; That is, " not changing data rate " signal).But because the traffic overview time to time change on the network, so client 212 can transmit the requirement that increases data rate at random to server-side 202.
The threshold position of package leakage ratio will definitely be with careful adjustment, so that the display quality of the user of client 212 institute perception can change and appropriateness decline or improvement along with network condition.Because client 212 does not have other available bandwidth communication amount information except itself present transfer rate, so client 212 may regularly require server-side 202 to increase transfer rates, so that can reach higher video signal quality.Except the audio-visual flow quality that supervises entering, whether client 212 also can notify server-side 202 display sizes to be dwindled by client, reduces the data transmission rate by this mating new size of display, and reduces the bandwidth important document.
It should be noted that the method that is used for the control transmission rate at present, be called adaptation rate control (ARC) technology, its available leakage package detecting is the basis, but not holds in the palm helping of real-time transport protocol (rtp) before and be the method on basis with the buffer.Have the ability to calculate video signal stream package quality and can transmit the client of required transfer rate information because adaptation rate control (ARC) technology mainly can rely on,, can be passed to client from server-side so supervise the burden of bandwidth and data rate control to server-side.In addition, adaptation rate control (ARC) technology also can allow client to require server-side to flow with optimized transfer rate transmission data, reduces the possibility that transmission through network is jammed.
Fig. 5 is the exemplary steps flow chart 500 of data transmission rate control of the present invention.Personage with general technical ability is appreciated that method shown in the figure can use multiple mode to revise and do not break away from spirit of the present invention and scope.For example, in another embodiment of the present invention, can combine various different parts in the icon method, rearrange these different parts in proper order or remove these differences partly with another kind.Should also be noted in that in addition the method can implement with multitude of different ways, such as executive software in an all-purpose computer, use microprocessor to carry out the hardware of firmware and/or computer-readable media, use special purpose, or the like.
This method can be since a state 502.In state 502, a client can be via the online or channel between a network (zone/Wide Area Network) foundation and a server-side, for exchanges data.Then, in state 504, client can transmit one group of client features information to server-side when channel is set up beginning.Client features information can comprise display sizes; Highest resolution; Can support color figure place (or color depth); Type of display is (such as LCD; CRT; Or electric slurry type); Cpu type; Indication can support Format Type (such as MPEG1; MPEG2; MPEG4; H.263; H.264 or the like decoder capability); Free memory; Online type is (such as WiFi; LAN; Blue bud or the like); The previous online record that transmission information is described is (such as frame rate; Data rate; Quantization level; Resolution or the like); And the line construction (formula/alternating expression continues) of video display 220b.Then, in state 506, server-side can determine a transfer rate according to client features information, and uses this transfer rate that client is transmitted complex document stream with real-time mode.This complex document can comprise audio frequency and the video data that is the Datagram form.Then, program can get the hang of 508.
In state 508, client can receive this complex document stream from server-side.Secondly, in state 510, client can be separated into audio frequency and video data package with the complex document flow point that receives.Subsequently, in state 512, client can be according to the package leakage ratio of flaw data package number decision video data package.Then, program can enter a decision rhombus 514.
In state 514, client can determine the leakage of this package than whether the state that is jammed in the indication network.When the answer of state 514 was sure, in state 516, client can produce the requirement that reduces transfer rate.Then, program can enter state 522.Otherwise program can enter another decision rhombus 518.
In state 518, can determine package leakage than whether the no-load condition in the indication network.When if the answer of state 518 is sure, then program can enter state 519.In state 519, can determine whether transfer rate has reached maximum transfer rate.When if the answer of state 519 is negated, in state 520, client can produce the requirement that increases transfer rate.Then, program can enter state 522.
The answer of state 518 is when negating, or the answer of state 519 is for certainly the time, and then program enters state 521.In state 521, client can produce one and comprise NOP (not changing data rate) signal.Then, program can enter state 522.In state 522, client can transmit this requirement to server-side.Subsequently, in state 524, server-side can be used this complex document stream of adjusted transfer rate transmission; Wherein, adjustment back transfer rate determines according to requiring.Then, program can be transmitted the laggard state 508 that arrives of accomplishing by the time.It should be noted that step 508 should regularly implement to 524, to keep the channel of setting up between server-side and the client.
We should be appreciated that aforementioned is relevant exemplary embodiments of the present invention, wherein can do multiple modification and does not break away from this method such as said spirit of following claim and scope.
Claims (16)
1. the real-time control method of server-side to a client data flow transmission rate; It is characterized in that; This client produces one and comprises the comparison check table of a stack features, and to use package leakage to liken to be that the golden key of a comparison inspection reads the comparison check table, and the method comprises:
Between server and client, set up one online;
This client transmits the information of this stack features and gives this server-side;
The information that this server-side uses this client to produce determines a transfer rate to give client;
This client receives the first that a data flows with this transfer rate from this server-side, and this first comprises most Datagrams;
The integrality of these these Datagrams of client inspection;
This client determines package leakage ratio according to this integrality;
This client is adjusted the requirement of this transfer rate according to this package leakage than reading this comparison check table generation one;
This client sends this requirement to this server-side;
This server-side receives this requirement with an intelligent video signal delivery manager, and this intelligent video signal delivery manager requires this transfer rate of adjustment according to this;
This client receives the second portion of this data stream of an adjustment back transfer rate from server-side.
2. the real-time control method of server-side as claimed in claim 1 to client data flow transmission rate; It is characterized in that, wherein this stack features comprise display sizes, highest resolution, color depth, type of display, cpu type, one or more decoder capability, free memory, online type, have transmission information previous online record, and the video display line construction one of them.
3. the real-time control method of server-side as claimed in claim 1 to client data flow transmission rate is characterized in that, this data stream is the complex document stream that comprises an audio stream and video signal stream; Before the step of this checked for integrity, and then comprise:
The first of this complex document stream is decomposed into this audio stream and video signal stream.
4. the real-time control method of server-side as claimed in claim 3 to client data flow transmission rate is characterized in that, before the step of this checked for integrity, and then comprises: with these audio streams and the decoding of video signal stream.
5. the real-time control method of server-side as claimed in claim 1 to client data flow transmission rate is characterized in that, wherein the step of this decision package leakage ratio may further comprise the steps:
Measure the flaw data package percentage in these most Datagrams; Wherein, each flaw package is one to change erroneous Datagram, or is the Datagram in the step of this reception data stream first, lost.
6. the real-time control method of server-side as claimed in claim 1 to client data flow transmission rate is characterized in that, wherein the step of this generation adjustment requirement may further comprise the steps:
Determine the leakage of this package than whether indicating the state that is jammed;
The state if this package leakage ratio indication one is jammed;
Then produce the requirement of this transfer rate of reduction;
Determine whether this package leakage ratio indicates a no-load condition;
If this package leakage is than being not indication one no-load condition;
Then produce one comprise no operation signal requirement; And
If this package leakage is than indication one no-load condition;
Determine then whether this transfer rate has reached high transmission rates;
If this transfer rate does not reach high transmission rates as yet;
Then produce the requirement of this transfer rate of increase; And
If this transfer rate has reached this high transmission rates
Then produce one comprise no operation signal requirement.
7. the real-time control method of server-side as claimed in claim 1 to client data flow transmission rate is characterized in that, wherein this data stream is to format according to user's data packet protocol.
8. the real-time control method of server-side as claimed in claim 1 to client data flow transmission rate is characterized in that, wherein this data stream is to see through a Network Transmission, and this network comprises a LAN and a Wide Area Network at least.
9. the real-time control method of server-side as claimed in claim 1 to client data flow transmission rate is characterized in that wherein this client comprises a visual device.
10. the real-time control method of server-side as claimed in claim 1 to client data flow transmission rate is characterized in that, and then comprises:
Repeat the step of the step of this integrity checking to this reception second portion, receive the integral part of this data stream up to this client.
11. the real-time control method of server-side as claimed in claim 1 to client data flow transmission rate; It is characterized in that; This transfer rate has one group of parameter, comprises that at least a target frame rate, a target show bit rate, a target resolution, a target audio sampling rate, a quantized value, a YC transformation approach, engineer's scale size, and one the online record of on line state before are described.
12. the real-time control method of server-side as claimed in claim 1 to client data flow transmission rate is characterized in that, the step of server-side adjustment transfer rate may further comprise the steps:
This server-side receives this requirement with an intelligent video signal delivery manager;
This intelligent video signal delivery manager requires to upgrade this data transfer rate according to this;
This audio frequency input of data transfer rate coding and the input of this video signal after server-side upgrades with this; And
The second portion that audio frequency after this server-side is encoded these and video signal input are combined into this data flow.
13. the real-time control method of server-side to a client data flow transmission rate; It is characterized in that; This client produces one and comprises the comparison check table of a stack features, and to use package leakage to liken to be that a comparison check table gold key reads the comparison check table, and the method comprises:
This server-side receives at least one audio frequency input and at least one video signal imported, and with this audio frequency input of data rate coding and the input of this video signal, audio frequency behind the said coding and video signal input is combined into the first that this data flows;
This server-side transfers to this client with a transfer rate with the first of data stream, and wherein this server-side contains an intelligent video signal delivery manager and adjusts this transfer rate;
This client receives this first, and wherein this first comprises most Datagrams;
This client is checked the integrality of these Datagrams, and determines package leakage ratio according to its integrality;
This client is used this package leakage than the requirement of reading this comparison check table generation one this transfer rate of adjustment, and this requirement is sent to this server-side;
This server-side receives this requirement that this client transmits with this intelligent video signal delivery manager, and this intelligent video signal delivery manager requires this transfer rate of adjustment according to this;
Make this server-side give this client with the second portion of adjusted this data stream of transfer rate transmission; And
The data of enforcement client reception regularly flow to server-side and uses this data stream of adjusted transfer rate transmission, to keep the channel of setting up between server-side and the client.
14. the real-time control method of server-side as claimed in claim 13 to client data flow transmission rate is characterized in that, before the step of this transmission second portion, and then comprises:
Make this server-side upgrade this data rate according to this requirement;
This audio frequency input of data transfer rate coding after making this server-side with this renewal and the input of this video signal; And
Audio frequency after making this server-side with these codings and video signal input are combined into the second portion of this data stream.
15. the real-time control method of server-side as claimed in claim 14 to client data flow transmission rate is characterized in that, and then comprises:
Make this client that an audio stream and video signal stream are resolved in the first of this complex document stream; And
Make these client these audio frequency of decoding and video signal stream.
16. the real-time control method of server-side as claimed in claim 13 to client data flow transmission rate; It is characterized in that wherein this stack features comprises a display sizes, highest resolution, color depth, type of display, cpu type, one or more decoder capability, free memory, online type at least, has the previous online record of transmission information, the video display line construction of this client.
Priority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN200610000213XA CN1996813B (en) | 2006-01-06 | 2006-01-06 | Self-adapted media transfer management of the continuous media stream used for LAN/WAN environment |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN200610000213XA CN1996813B (en) | 2006-01-06 | 2006-01-06 | Self-adapted media transfer management of the continuous media stream used for LAN/WAN environment |
Publications (2)
| Publication Number | Publication Date |
|---|---|
| CN1996813A CN1996813A (en) | 2007-07-11 |
| CN1996813B true CN1996813B (en) | 2012-05-16 |
Family
ID=38251776
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN200610000213XA Expired - Fee Related CN1996813B (en) | 2006-01-06 | 2006-01-06 | Self-adapted media transfer management of the continuous media stream used for LAN/WAN environment |
Country Status (1)
| Country | Link |
|---|---|
| CN (1) | CN1996813B (en) |
Families Citing this family (4)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN101753973B (en) * | 2008-12-12 | 2013-01-02 | 华为技术有限公司 | Channel switching method, device and system |
| CN103503462B (en) * | 2011-12-06 | 2017-09-19 | 华为技术有限公司 | Real-time transcoding method and apparatus |
| US10390341B2 (en) | 2014-10-31 | 2019-08-20 | Realtek Semiconductor Corp. | Wireless communication system and associated wireless communication method |
| US10271352B2 (en) | 2016-07-19 | 2019-04-23 | Realtek Semiconductor Corp. | Wireless communication system and associated wireless communication method and wireless device having efficient polling mechanism in overlapping network environments |
Citations (2)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN1468001A (en) * | 2002-06-27 | 2004-01-14 | 上海汉唐科技有限公司 | Media flow self-adapting transmission method based on internet |
| CN1655547A (en) * | 2004-09-09 | 2005-08-17 | 上海川海信息科技有限公司 | A speed control method in stream media transmission system |
-
2006
- 2006-01-06 CN CN200610000213XA patent/CN1996813B/en not_active Expired - Fee Related
Patent Citations (2)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN1468001A (en) * | 2002-06-27 | 2004-01-14 | 上海汉唐科技有限公司 | Media flow self-adapting transmission method based on internet |
| CN1655547A (en) * | 2004-09-09 | 2005-08-17 | 上海川海信息科技有限公司 | A speed control method in stream media transmission system |
Also Published As
| Publication number | Publication date |
|---|---|
| CN1996813A (en) | 2007-07-11 |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| US7984179B1 (en) | Adaptive media transport management for continuous media stream over LAN/WAN environment | |
| US8988486B2 (en) | Adaptive video communication channel | |
| CN102946570B (en) | Transmission system and method for multi-stream streaming media of self-adaption network bandwidth | |
| US7639882B2 (en) | Moving picture distribution system, moving picture distribution device and method, recording medium, and program | |
| CN104735470A (en) | Streaming media data transmission method and device | |
| EP1883244A2 (en) | Apparatus and method for transmitting moving picture stream using bluetooth | |
| CN102202210B (en) | Method for mobile phone to play real-time monitoring video and mobile phone to play real-time monitoring video | |
| US20150110168A1 (en) | Video data transmission method and apparatus | |
| EP2827596A1 (en) | Transmitting and receiving method of multimedia video data and corresponding device | |
| CN110602522B (en) | Multi-path real-time live webRTC stream synthesis method | |
| CN106303611A (en) | A kind of method and system realizing film source propelling movement | |
| CN103002354A (en) | Method and system for eliminating network jitter of video data during transmission | |
| WO2015117355A1 (en) | Method and device for realizing multimedia broadcasting of terminal | |
| KR20050038646A (en) | Method of streaming multimedia data | |
| CN1996813B (en) | Self-adapted media transfer management of the continuous media stream used for LAN/WAN environment | |
| CN103024441B (en) | A kind of method of playing television program at mobile terminal | |
| CN114339445B (en) | Real-time video stream self-adaptive coordination system and method | |
| WO2022100528A1 (en) | Audio/video forwarding method and apparatus, terminals, and system | |
| EP2312826A2 (en) | Network device, information processing apparatus, stream switching method, information processing method, program, and content distribution system | |
| CN103918258A (en) | Reducing amount of data in video encoding | |
| CN101815073A (en) | Embedded Bluetooth-Ethernet server | |
| Haiyan et al. | Application of SVGA video real-time transmission technology in music education information communication | |
| Chen et al. | Study on relationship between network video packet loss and video quality | |
| WO2022206016A1 (en) | Data layering transport method, apparatus and system | |
| CN109104635A (en) | The method and system of instant delivery screen picture |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| C06 | Publication | ||
| PB01 | Publication | ||
| C10 | Entry into substantive examination | ||
| SE01 | Entry into force of request for substantive examination | ||
| C14 | Grant of patent or utility model | ||
| GR01 | Patent grant | ||
| CF01 | Termination of patent right due to non-payment of annual fee |
Granted publication date: 20120516 Termination date: 20150106 |
|
| EXPY | Termination of patent right or utility model |