CN1198459C - Network instant video signal transmission method and equipment - Google Patents
Network instant video signal transmission method and equipment Download PDFInfo
- Publication number
- CN1198459C CN1198459C CNB02141193XA CN02141193A CN1198459C CN 1198459 C CN1198459 C CN 1198459C CN B02141193X A CNB02141193X A CN B02141193XA CN 02141193 A CN02141193 A CN 02141193A CN 1198459 C CN1198459 C CN 1198459C
- Authority
- CN
- China
- Prior art keywords
- image
- frame
- skipping
- network
- video
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Expired - Fee Related
Links
Images
Abstract
The present invention relates to a network instant video signal transmission method and a device. The present invention dynamically adjusts the frame transmission rate (the number of frames transmitted per second) of video signal images mainly according to the rise and fall variation of a network frequency width, and implement in the mode of regular skip frames to maintain uniform and smooth image playing with fixed picture quality.
Description
Technical field
The invention relates to a kind of network instant video transmission method and device, refer to that especially a kind of motor-driven adjustment image transfer rate shows so that maintain the image quality and the uniformly smooth image that are fixing approximately with video data transmission changing condition with network bandwidth change.
Background technology
Press, the purposes of video is very extensive, and for example video conference, image monitoring system etc. relevantly are used in transmission technology on the network (network) with video, and compress technique known and commonly used has: MPEG, H.263... or the like.Mainly be with the video of image capturing devices such as video camera after video compression is handled, be converted to the specification of network again, make that video can be that media transmits by network, this measure, can make any one computer equipment that is connected with network all can obtain video image, and be not subjected to the restriction of entity video line, make the utilization aspect of video more become broad, especially be used in and save the suitable tool practicality in surveillance aspect and video broadcasting aspect from damage, yet the transmission quality of video is subjected to the influence of the network bandwidth easily and produces serious leakage lattice or mosaic phenomenon, such as, the bandwidth of Local Area Network is for along with behaviour in service changes, the user the more, available bandwidth is relatively narrower, meaning is the network bandwidth all earthquakes at any time, when the data transmission quantity surpassed bandwidth load, so-called traffic congestion phenomenon promptly appearred.Also can not exempt from influenced by the network data flow and see through the transmission quality that network carries out instant video.But, existing video compression technology all is to carry out instantaneous transmission with the fixing network bandwidth, with MPEG 2 standards is example, it is to take the image transfer rate of fixing, and as thirty image of per second (30fps), (refers to that especially available bandwidth narrows down) when running into bandwidth change, and can't expectably all images be sent out the time, promptly produce not specification leakage lattice phenomenon, cause the recipient to present the picture non-continuous event, can't satisfy the requirement of instant video.
Again, another problem of instant network video transmission is: because MPEG 2 partly compresses according to the difference that image is opened in front and back, so in the video transmission process, as the excessive occasion of image document amount before and after running into, easier of handling not as good as producing so-called mosaic phenomenon.
From the above, existing network instant video transmission speed is fixed, and under the defective that can't adjust along with bandwidth elasticity, needs to be further reviewed, and seek feasible solution.
Summary of the invention
Therefore, main purpose of the present invention provide a kind of with network bandwidth change and picture changing condition with motor-driven adjusting image transfer rate, and can keep the video image quality and guarantee the method that display frame is smooth-going.
For reaching the major technique means that aforementioned purpose takes is to make preceding method comprise the following steps:
The detecting wideband condition;
When the network bandwidth descends, make the image of video data do the frame-skipping of rule with a frame-skipping control device, and adjust its image transfer rate;
According to instant image transfer rate and wideband condition, when the network bandwidth rises, reduce frame-skipping ratio or cancellation frame-skipping control;
Described frame-skipping control device further comprises:
The step of one detecting image document amount is when the front and back varies between images is too big, promptly neglects the big image of this variable quantity, with the mistake of avoiding the flow spike to be derived; In the step of this detecting image document amount, also monitor the active volume of image buffer simultaneously, when the off-capacity of image buffer when inserting image document, neglect this image document;
And when the frame-skipping action produces, processing unit also writes down leakage frame per second, when leaking frame per second greater than a set point, see through painstakingly frame-skipping to reduce the data transmission quantity though promptly represent the network bandwidth, so still belong on the low side, so must strengthen the frequency of this frame-skipping action, till the leakage frame per second is reduced to a special value;
With preceding method when the network bandwidth changes, can be to do regular and frame-skipping uniformly to the image of video data with fixed frequency, make the image transfer rate do downgrading in various degree,, keep desirable instant video picture quality and smooth-going degree with when bandwidth changes according to different wideband condition.
It further can set the sample time of frame-skipping control device according to user's needs.
A kind of network instant video of the present invention transmission control unit is characterized in that, comprising:
One video memory is for the video data of temporary input;
One image processor, in order to handle the video image of video memory output, this image processor is to be made of a compression engine;
One switches switch, is to be located between video memory and the image processor, utilizes the whether frame-skipping of image that its switch sends with the control video memory;
One flow buffer is a compression data output of being located at image processor, and is connected with network through a network transceivers;
One processing unit, it controls aforementioned diverter switch, and receive the network bandwidth information that provides from network transceivers, image that the flow buffer provides flow information, image information, bit transfer rate that image processor provides, leak frame per second information, the last time information state of itself being noted down and user's set data, with the sample time of control its switch, make to switch to open to open and close, carry out rule and uniform frame-skipping step with fixed frequency.
This processing unit can be made of microprocessor.
This processing unit also receives user's set data, with the sample time of decision diverter switch.
Description of drawings
For making the auditor further understand aforementioned purpose and technical characterictic of the present invention, below in conjunction with accompanying drawing describe in detail as after, wherein:
Fig. 1 is a circuit block diagram of the present invention.
Fig. 2 is a compressed image schematic diagram of the present invention.
Fig. 3 is the another compressed image schematic diagram of the present invention.
Embodiment
As shown in Figure 1, be the hardware framework of a preferred embodiment of the present invention, it includes:
One video memory 10 is for the video data of temporary input;
One image processor 20, in present embodiment, it is made of a compression engine, compresses in order to the video image to video memory 10 outputs;
One switches switch 11, is to be located between video memory 10 outputs and the image processor 20, and the image that utilizes its switch to deliver to image processor 20 with control video memory 10 is frame-skipping (skip frames);
One flow buffer 30 is compression data outputs of being located at image processor 20, and the output of itself then sees through a network transceivers 31 and is connected with network;
One processing unit 40, can constitute by microprocessor, memory or logical circuit, except that connecting aforementioned diverter switch 11, connect aforesaid network transceivers 31, flow buffer 30, image processor 20 etc. again respectively, and receive its information that provides and set data WT (Weighting) (as: sets required picture rate (fps), according to aforementioned information and set data WT, whether the action of control its switch 11 automatically according to this, carries out the frame-skipping step; Wherein:
Aforementioned network transceiver (31) provides network bandwidth information (BWI, Bandwidth Info) and gives processing unit 40.
And the concrete function mode of aforementioned means is as described below:
Under the normality, diverter switch 11 between video memory 10 and the image processor 20 is for normally closed, when video memory 10 is delivered to image processor 20 with certain speed one by one with the image of video data, producing bit stream (BS, Bit Stream) after its compression delivers on the network through flow buffer 30, network transceivers 31.
At this moment, processing unit 40 receives and monitors the flow information (BI) of flow buffer 30 simultaneously, this flow buffer (BI) is the mode with first in first out (FIFO), the data that image processor 20 is sent here is kept in, be fed through network transceivers 31 then in regular turn, therefore, when the available buffer capacity of flow buffer (30) diminishes, promptly represent the network bandwidth narrow down (can't send out swimmingly), so sample time of conversion diverter switch 11, and make diverter switch 11 carry out switching motion with fixed frequency, make video data present rule and frame-skipping (skip frame) uniformly thus.And when the frame-skipping action produces, processing unit 40 also writes down and leaks frame per second (the SFR) (numerical value of non-aforementioned painstakingly frame-skipping, but the processing that is painstakingly produced beyond the frame-skipping is not as good as the leakage lattice quantity that is produced), when leaking frame per second (SFR) greater than a set point, see through painstakingly frame-skipping to reduce the data transmission quantity though promptly represent the network bandwidth, so still belong on the low side, so must strengthen the frequency of this frame-skipping action, up to leaking till frame per second (SFR) is reduced to a special value.
Also simultaneously reference image information (II) and flow information (BI) of processing unit 40 again, whether the former is too big in order to change between image before and after judging, when the front and back image change is too big, bit number after its compression heightens, under this situation, when learning the capacity step-down of flow buffer 30 by flow information (BI), then processing unit 40 promptly drives diverter switch 11 disconnections, to give up the big image of variable quantity, and get its next open image, avoid the flow spike of flow buffer 30 thus, do not relieve yet as the flow of flow buffer 30, promptly give up following image in regular turn, till the flow of flow buffer 30 relieves.
Moreover processing unit 40 is also according to user's set data WT itself, with the frame-skipping frequency of decision diverter switch 11.
Can disclose by following working curve diagram with aforesaid operating characteristic: at first as shown in Figure 2, the equidistant rectangular frame of arranging is an image, curve B WI represents the change curve of the network bandwidth, and the horizontal line of differing heights is represented different image transfer rates (fps) (vertical axis) respectively.
As shown in Figure 3, when the picture of transmission is a still image, Qu Yang bit transfer rate (BRI) is though be certain value each time, right image of being taken a sample also is subject to bandwidth, is example with the image transfer rate as if being set in 30fps, and be a unit interval (T) with per 15 images, N is expression step value (STEP) on the drawing, and the staircase curve in the drawing is the dynamic changing curve of expression image transfer rate of the present invention, by (BWI) curve leading portion (T1) as can be known, the 30fps that sets certainly can't be successfully only be slightly larger than intactly transmission under the situation of 20fps at this network bandwidth, so under the situation that flow buffer 30 has little time to relieve when holding next group bit stream (data) again (off-capacity of flow buffer 30), make diverter switch 11 at the pact of T1 in the cycle 3 image (images 4 of position uniformly-spaced, 8,14 places) produce leakage lattice phenomenon.In the T2 cycle, because aforementioned leakage frame per second (SFR) is recorded as 3, greater than one relatively mean value (present embodiment is 2.5) (the serve as reasons mean value of difference of time two picture rate of this example is determined, i.e. (20-15)/2=2.5), so make the present invention that picture rate is reduced to 20fps position standard (evenly neglecting 5 images in the cycle at T2), even the image 17 in the cycle, 20,23,26,29 positions are carried out painstakingly frame-skipping and are handled, so shown in the drawing relevant position, network has been reduced to below the 15fps, cause image 18,21,24,27,30 equipotentials are buied property and are given birth to totally 5 leakage lattice phenomenons (leaking frame per second is 5), according to aforementioned principles, this leaks scale value greater than relatively mean value is a lot of, so then further the image transfer rate is reduced to the value of 15fps in the T3 cycle, because this moment, the network bandwidth went up to the 20fps, make under the situation of this low transfer rate, can expectably make respective image send out and the inerrancy generation, therefore, leakage frame per second in the T4 cycle is zero or is lower than aforementioned relatively mean value, be with, even at T4 cycle image transfer rate rise single order (rise) to 20fps position standard, right this moment, network is reduced to again below the preceding rheme standard once again, causing leaking frame per second (SFR) increases, in like manner, it is corresponding reduction image transfer rate of the present invention, so constantly correspondingly adjust the data quantity that instant video was transmitted in the unit interval according to the variation of the network bandwidth, the consistent uniformity that keeps the picture frame frequency causes data to block and falls an image quality aggravation phenomenon that is caused because of irregular because of bandwidth avoiding.
Can find out concrete technology contents of the present invention and operation principle thereof by above-mentioned explanation, utilize preceding method, can be when the network bandwidth reduces, correspondingly video image being done inhomogeneity painstakingly frame-skipping handles, to reduce the data transmission quantity of unit interval, make it can be along with the network bandwidth changes, thus can be when bandwidth changes, avoid can't smooth and easy transmission problem, and the most important thing is that wherein the present invention still keeps suitable continuity for adopting the uniformity frame-skipping treatment step of equi-spaced apart before and after the image, so still maintain a fixing image quality, this measure, particularly effective for saving from damage on the surveillance of the static state that need on same picture, show a plurality of besels, though and there is the frame-skipping problem dynamic image aspect, so still do not lose continuity, in addition, cause the specific image of the excessive data quantity of flow buffer generating overflow mistake, can leak lattice equally and handle at meeting, to avoid the flow spike, effectively solve high data image processing not as good as the mosaic phenomenon that is presented.So really possessed significant practicality, novelty and progressive with these technology, and met the condition of patent of invention, so mention application in accordance with the law.
Claims (5)
1. a network instant video transmission method comprises the following steps:
The detecting wideband condition;
When the network bandwidth descends, make the image of video data do the frame-skipping of rule with a frame-skipping control device, and adjust its image transfer rate;
According to instant image transfer rate and wideband condition, when the network bandwidth rises, reduce frame-skipping ratio or cancellation frame-skipping control;
Described frame-skipping control device further comprises:
The step of one detecting image document amount is when the front and back varies between images is too big, promptly neglects the big image of this variable quantity, with the mistake of avoiding the flow spike to be derived; In the step of this detecting image document amount, also monitor the active volume of image buffer simultaneously, when the off-capacity of image buffer when inserting image document, neglect this image document;
And when the frame-skipping action produces, processing unit also writes down leakage frame per second, when leaking frame per second greater than a set point, see through painstakingly frame-skipping to reduce the data transmission quantity though promptly represent the network bandwidth, so still belong on the low side, so must strengthen the frequency of this frame-skipping action, till the leakage frame per second is reduced to a special value;
With preceding method when the network bandwidth changes, can be to do regular and frame-skipping uniformly to the image of video data with fixed frequency, make the image transfer rate do downgrading in various degree,, keep desirable instant video picture quality and smooth-going degree with when bandwidth changes according to different wideband condition.
2. network instant video transmission method as claimed in claim 1 is characterized in that, it further can set the sample time of frame-skipping control device according to user's needs.
3. a network instant video transmission control unit is characterized in that, comprising:
One video memory is for the video data of temporary input;
One image processor, in order to handle the video image of video memory output, this image processor is to be made of a compression engine;
One switches switch, is to be located between video memory and the image processor, utilizes the whether frame-skipping of image that its switch sends with the control video memory;
One flow buffer is a compression data output of being located at image processor, and is connected with network through a network transceivers;
One processing unit, it controls aforementioned diverter switch, and receive the network bandwidth information that provides from network transceivers, image that the flow buffer provides flow information, image information, bit transfer rate that image processor provides, leak frame per second information, the last time information state of itself being noted down and user's set data, with the sample time of control its switch, make to switch to open to open and close, carry out rule and uniform frame-skipping step to close fixed frequency.
4. network instant video transmission control unit as claimed in claim 3 is characterized in that this processing unit can be made of microprocessor.
5. network instant video transmission control unit as claimed in claim 4 is characterized in that this processing unit also receives user's set data, with the sample time of decision diverter switch.
Priority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CNB02141193XA CN1198459C (en) | 2002-07-08 | 2002-07-08 | Network instant video signal transmission method and equipment |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CNB02141193XA CN1198459C (en) | 2002-07-08 | 2002-07-08 | Network instant video signal transmission method and equipment |
Publications (2)
| Publication Number | Publication Date |
|---|---|
| CN1467995A CN1467995A (en) | 2004-01-14 |
| CN1198459C true CN1198459C (en) | 2005-04-20 |
Family
ID=34147739
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CNB02141193XA Expired - Fee Related CN1198459C (en) | 2002-07-08 | 2002-07-08 | Network instant video signal transmission method and equipment |
Country Status (1)
| Country | Link |
|---|---|
| CN (1) | CN1198459C (en) |
Families Citing this family (1)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| TWI530157B (en) | 2013-06-18 | 2016-04-11 | 財團法人資訊工業策進會 | Method and system for displaying multi-view images and non-transitory computer readable storage medium thereof |
-
2002
- 2002-07-08 CN CNB02141193XA patent/CN1198459C/en not_active Expired - Fee Related
Also Published As
| Publication number | Publication date |
|---|---|
| CN1467995A (en) | 2004-01-14 |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| CN1271854C (en) | Adaptive interleaving-removing method and equipment for dynamic image | |
| US20140233637A1 (en) | Managed degradation of a video stream | |
| US8374236B2 (en) | Method and apparatus for improving the average image refresh rate in a compressed video bitstream | |
| AU2005306791B2 (en) | Method and apparatus for controlling a video surveillance display | |
| CN109729437B (en) | Streaming media self-adaptive transmission method, terminal and system | |
| CN107666593B (en) | Video real-time transmission method under fluctuating network environment | |
| US7593580B2 (en) | Video encoding using parallel processors | |
| CN101511014A (en) | Method and apparatus for encoding video | |
| CN112866752A (en) | Video code stream self-adaptive network bandwidth method, device, equipment and medium | |
| CN109168041B (en) | Mobile terminal monitoring method and system | |
| WO2023174216A1 (en) | Video resolution adaptive adjustment method, apparatus and device, and storage medium | |
| WO2023159965A1 (en) | Visual perception-based rate control method and device | |
| WO2022183520A1 (en) | Method, system and apparatus for changing resolution | |
| CN1198459C (en) | Network instant video signal transmission method and equipment | |
| CN101217615A (en) | An image compression bit rate control method and device | |
| CN106131693A (en) | A kind of modular transmission of video Play System and method | |
| US20120113150A1 (en) | Multimedia communication apparatus and processing method for group media communication | |
| CN1207914C (en) | Image processor image transmitting method and program | |
| CN1688162A (en) | Coding method for monitoring image resolution and its apparatus | |
| CN1211877A (en) | MPEG-2 vedio-frequency decoder and its input buffer control method | |
| JP2015080102A (en) | Video processing apparatus and control method for video processing apparatus | |
| TW571590B (en) | Real-time network video transmission system and method | |
| US20240080452A1 (en) | Video encoder and video encoding method with real-time quality estimation | |
| CN2672997Y (en) | Digital display circuit for realizing visual frequency display | |
| CN116996710A (en) | Operation control system and method of artificial intelligent model based on video stream |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| C10 | Entry into substantive examination | ||
| SE01 | Entry into force of request for substantive examination | ||
| C06 | Publication | ||
| PB01 | Publication | ||
| C10 | Entry into substantive examination | ||
| SE01 | Entry into force of request for substantive examination | ||
| C14 | Grant of patent or utility model | ||
| GR01 | Patent grant | ||
| C19 | Lapse of patent right due to non-payment of the annual fee | ||
| CF01 | Termination of patent right due to non-payment of annual fee |