CN108965842A - A kind of online interaction live video image optimization algorithm based on low bandwidth - Google Patents
A kind of online interaction live video image optimization algorithm based on low bandwidth Download PDFInfo
- Publication number
- CN108965842A CN108965842A CN201810779627.XA CN201810779627A CN108965842A CN 108965842 A CN108965842 A CN 108965842A CN 201810779627 A CN201810779627 A CN 201810779627A CN 108965842 A CN108965842 A CN 108965842A
- Authority
- CN
- China
- Prior art keywords
- video
- frame
- low bandwidth
- motion vector
- optimization algorithm
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Pending
Links
Classifications
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N9/00—Details of colour television systems
- H04N9/64—Circuits for processing colour signals
- H04N9/646—Circuits for processing colour signals for image enhancement, e.g. vertical detail restoration, cross-colour elimination, contour correction, chrominance trapping filters
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N5/00—Details of television systems
- H04N5/14—Picture signal circuitry for video frequency region
Landscapes
- Engineering & Computer Science (AREA)
- Multimedia (AREA)
- Signal Processing (AREA)
- Compression Or Coding Systems Of Tv Signals (AREA)
Abstract
The invention discloses a kind of online interaction live video image optimization algorithm based on low bandwidth, including video is acquired, collect the interdynamic video of live streaming；Later by carrying out frame rate reduction processing to the interdynamic video of live streaming；Video correlated judgment is carried out to the video after progress frame rate reduction processing later；It will do it designated treatment after determining video and needing to carry out designated treatment later, the designated treatment includes de-jitter and Video segmentation processing；It carries out designated treatment and video is subjected to compression transmission later；Compression transmission is directly carried out to it after video does not need to be handled later；Finally the video received is presented using image interpolation；The present invention carries out a series of processing to collecting video by above-mentioned；By applying above-mentioned video optimized algorithm, it can effectively improve video pictures effect, reduce bandwidth traffic, enhance the experience of user, and saved bandwidth.
Description
Technical field
The invention belongs to image optimization field, it is related to a kind of online interaction direct seeding technique based on low bandwidth, specifically one
Online interaction live video image optimization algorithm of the kind based on low bandwidth.
Background technique
Network direct broadcasting for tradition live streaming, allows masses to have preferably by then passing through internet platform expansion
Active operation, that is to say, that have and preferably and more freely select space.Such as currently a popular ball match live streaming, sport are straight
It broadcasts, wedding live streaming, the live streamings such as opening live streaming are issued these signals on the internet, spectators in order to facilitate broad masses
It can easily select that route is broadcast live required for oneself.Any place for having network in the whole world can see the reality being broadcast live online
Condition live streaming.
And information-based platform is mainly run in network environment based on by mobile Internet when starting design, low
Under bandwidth environment, if handled using common video, transmission technology will cause transmission of video not smooth enough or transmission of video
The problems such as delay, in order to have a good video performance in the case where some network environments are poor；To solve drawbacks described above,
A solution is now provided.
Summary of the invention
The purpose of the present invention is to provide a kind of online interaction live video image optimization algorithm based on low bandwidth.
The purpose of the present invention can be achieved through the following technical solutions:
A kind of online interaction live video image optimization algorithm based on low bandwidth, the algorithm include the following steps:
Step 1: being acquired video, collects the interdynamic video of live streaming；
Step 2: frame rate reduction processing is carried out to the interdynamic video of live streaming；
Step 3: video correlated judgment is carried out to the video after progress frame rate reduction processing；
Step 4: designated treatment, the designated treatment packet be will do it after determining video and needing to carry out designated treatment
Include de-jitter and Video segmentation processing；It carries out designated treatment and video is subjected to compression transmission later；
Step 5: compression transmission is directly carried out to it after video does not need to be handled；
Step 6: the video received is presented using image interpolation；It is carried out during presenting using image interpolation
Carry out display processing.
Further, carrying out frame rate reduction processing in the process to the interdynamic video of live streaming in the step 2 reduces video frame value
To 10fps.
Further, the video compression technology in the step 4 or step 5 carries out encoding and decoding using H.264 algorithm；
H.264 the algorithm can conceptually be divided into two layers: video coding layer is responsible for efficient video frequency content expressing,
Network abstraction layer is responsible for that data are packaged and are transmitted in mode appropriate required by network；H.264 1/4 or 1/8 is supported
The motion vector of pixel precision；6 tap filters can be used to reduce high-frequency noise in 1/4 pixel precision, for 1/8 pixel
The filter of 8 increasingly complex taps can be used in the motion vector of precision；It is carrying out moving pre- timing, encoder also may be selected
" enhancing " interpolation filter improves the effect of prediction；H.264 there are two types of methods for middle entropy coding, and one is to the to be encoded of whole
Symbol use unified VLC, there are also one is using content-adaptive binary arithmetic coding；H.264 include in draft
For the tool that mistake is eliminated, transmitted in error code, the multiple environment of packet loss convenient for compression video, such as mobile channel or IP channel
The robustness of middle transmission.
Further, the dithering process includes motion estimation module, shake identification module and motion compensating module；
The motion estimation module is for quickly and effectively obtaining motion vector, and the motion estimation module will be for that will move arrow
Amount is transferred to shake identification module；The motion vector that the shake identification module is used to calculate motion estimation module is sentenced
Disconnected, the shake identification module starts motion compensating module when motion vector is more than certain threshold value；The motion compensating module
Original image frame is compensated by motion vector.
Further, it is as follows to obtain the step of motion vector for the motion estimation module:
S1: if live image is divided into sub-block；
S2: each piece is searched out in the position closed in frame image；
S3: calculating the relative displacement of spatial position between the two, and the relative displacement is motion vector.
Further, the step of original image frame compensates is as follows:
SS1: calculating the accumulated error between every frame,
SS2: accumulated error is judged；
SS3: when accumulated error be more than certain threshold value, then present frame is set as new reference frame, for subsequent frame
Rectification building-out.
Further, image interpolation process is handled using bicubic interpolation algorithm in the step 6.
Beneficial effects of the present invention: the present invention carries out frame rate reduction processing to collecting video by above-mentioned, enables the present invention
Enough that video is transmitted in low bandwidth, video frame value low cost bandwidth is few；Later by carrying out de-jitter and segmentation to video
Processing, carries out compression transmission for video later；Finally effectively shown using image interpolation method；It is excellent by the above-mentioned video of application
Change algorithm, can effectively improve video pictures effect, reduces bandwidth traffic, enhance the experience of user, and saved bandwidth；This
It invents simple and effective, and is easy to practical.
Detailed description of the invention
In order to facilitate the understanding of those skilled in the art, the present invention will be further described below with reference to the drawings.
Fig. 1 is flow diagram of the invention.
Specific embodiment
As shown in Figure 1, a kind of online interaction live video image optimization algorithm based on low bandwidth, which is characterized in that institute
Algorithm is stated to include the following steps:
Step 1: being acquired video, collects the interdynamic video of live streaming；
Step 2: frame rate reduction processing is carried out to the interdynamic video of live streaming；
Further, frame rate reduction processing is carried out to the interdynamic video of live streaming and video frame value is reduced to 10fps in the process.
Step 3: video correlated judgment is carried out to the video after progress frame rate reduction processing；
Step 4: designated treatment, the designated treatment packet be will do it after determining video and needing to carry out designated treatment
Include de-jitter and Video segmentation processing；It carries out designated treatment and video is subjected to compression transmission later；
Further, the dithering process includes motion estimation module, shake identification module and motion compensating module；
The motion estimation module obtains motion vector for quickly and effectively obtaining motion vector, the motion estimation module
The step of it is as follows:
S1: if live image is divided into sub-block；
S2: each piece is searched out in the position closed in frame image；
S3: calculating the relative displacement of spatial position between the two, and the relative displacement is motion vector.
The motion estimation module is used to motion vector being transferred to shake identification module；The shake identification module is used for
The motion vector calculated motion estimation module judges that the shake identification module is when motion vector is more than certain threshold value
Start motion compensating module；The motion compensating module compensates original image frame by motion vector；
Since every frame all inevitably introduces some errors, if taken no action to, with the accumulation of error, behind
Image will appear flaw, so needing to carry out original image frame compensation；The step of original image frame compensates is as follows:
SS1: calculating the accumulated error between every frame,
SS2: accumulated error is judged；
SS3: when accumulated error be more than certain threshold value, then present frame is set as new reference frame, for subsequent frame
Rectification building-out.
Step 5: compression transmission is directly carried out to it after video does not need to be handled；
Step 6: the video received is presented using image interpolation；It is carried out during presenting using image interpolation
Carry out display processing.
Further, the video compression technology in the step 4 or step 5 carries out encoding and decoding using H.264 algorithm；
H.264 as standard once and DPCM adds the hybrid coding mode of transition coding；But it is using " recurrence
Substantially compact design " is obtained without numerous options than H.263++ much better compression performance；It strengthens to various channels
Adaptability the processing to error code and packet loss is conducive to using the structure and grammer of " network friendliness "；Application target range compared with
Width, to meet the needs of different rates, different resolutions and different transmission or storage occasion；
H.264 algorithm can conceptually be divided into two layers: video coding layer is responsible for efficient video frequency content expressing, network
Extract layer is responsible for that data are packaged and are transmitted in mode appropriate required by network；H.264 1/4 or 1/8 pixel is supported
The motion vector of precision；6 tap filters can be used to reduce high-frequency noise in 1/4 pixel precision, for 1/8 pixel precision
Motion vector, the filter of 8 increasingly complex taps can be used；It is carrying out moving pre- timing, encoder also may be selected " to increase
Interpolation filter improves the effect of prediction by force "；H.264 there are two types of methods for middle entropy coding, and one is to the to be encoded of whole
Symbol uses unified VLC, and there are also one is the binary arithmetic codings using content-adaptive；H.264 include in draft
For the tool that mistake is eliminated, transmitted in error code, the multiple environment of packet loss convenient for compression video, in mobile channel or IP channel
The robustness of transmission.
Further, image interpolation process is handled using bicubic interpolation algorithm in the step 6.
A kind of online interaction live video image optimization algorithm based on low bandwidth, at work first adopts video
Collection, collects the interdynamic video of live streaming；Later by carrying out frame rate reduction processing to the interdynamic video of live streaming；Later to carry out drop frame at
Video after reason carries out video correlated judgment；It will do it specified place after determining video and needing to carry out designated treatment later
Reason, the designated treatment include de-jitter and Video segmentation processing；It carries out designated treatment and video is subjected to compression biography later
It is defeated；Compression transmission is directly carried out to it after video does not need to be handled later；Finally by the video received using figure
As interpolation is presented；Display processing is carried out using image interpolation during presenting.
The present invention, to video progress frame rate reduction processing is collected, allows the invention to transmit view in low bandwidth by above-mentioned
Frequently, video frame value low cost bandwidth is few；Later by carrying out de-jitter and dividing processing to video, video is carried out later
Compression transmission；Finally effectively shown using image interpolation method；By applying above-mentioned video optimized algorithm, can effectively improve
Video pictures effect reduces bandwidth traffic, enhances the experience of user, and saved bandwidth；The present invention is simple and effective, and is easy to
It is practical.
Above content is only to structure of the invention example and explanation, affiliated those skilled in the art couple
Described specific embodiment does various modifications or additions or is substituted in a similar manner, without departing from invention
Structure or beyond the scope defined by this claim, is within the scope of protection of the invention.
Claims (7)
1. a kind of online interaction live video image optimization algorithm based on low bandwidth, which is characterized in that under the algorithm includes
State step:
Step 1: being acquired video, collects the interdynamic video of live streaming；
Step 2: frame rate reduction processing is carried out to the interdynamic video of live streaming；
Step 3: video correlated judgment is carried out to the video after progress frame rate reduction processing；
Step 4: will do it designated treatment after determining video and needing to carry out designated treatment, and the designated treatment includes going
Dithering process and Video segmentation processing；It carries out designated treatment and video is subjected to compression transmission later；
Step 5: compression transmission is directly carried out to it after video does not need to be handled；
Step 6: the video received is presented using image interpolation；It is carried out during presenting using image interpolation
Display processing.
2. a kind of online interaction live video image optimization algorithm based on low bandwidth according to claim 1, feature
It is, frame rate reduction processing is carried out to the interdynamic video of live streaming in the step 2, video frame value is reduced to 10fps in the process.
3. a kind of online interaction live video image optimization algorithm based on low bandwidth according to claim 1, feature
It is, the video compression technology in the step 4 or step 5 carries out encoding and decoding using H.264 algorithm；
H.264 the algorithm can conceptually be divided into two layers: video coding layer is responsible for efficient video frequency content expressing, network
Extract layer is responsible for that data are packaged and are transmitted in mode appropriate required by network；H.264 1/4 or 1/8 pixel is supported
The motion vector of precision；6 tap filters can be used to reduce high-frequency noise in 1/4 pixel precision, for 1/8 pixel precision
Motion vector, the filter of 8 increasingly complex taps can be used；It is carrying out moving pre- timing, encoder also may be selected " to increase
Interpolation filter improves the effect of prediction by force "；H.264 there are two types of methods for middle entropy coding, and one is to the to be encoded of whole
Symbol uses unified VLC, and there are also one is the binary arithmetic codings using content-adaptive；H.264 include in draft
For the tool that mistake is eliminated, transmitted in error code, the multiple environment of packet loss convenient for compression video, in mobile channel or IP channel
The robustness of transmission.
4. a kind of online interaction live video image optimization algorithm based on low bandwidth according to claim 1, feature
It is, the dithering process includes motion estimation module, shake identification module and motion compensating module；
The motion estimation module is for quickly and effectively obtaining motion vector, and the motion estimation module is for passing motion vector
It is defeated to arrive shake identification module；The shake identification module is used for the motion vector that calculates motion estimation module and judges, institute
It states shake identification module and starts motion compensating module when motion vector is more than certain threshold value；The motion compensating module passes through fortune
Dynamic vector compensates original image frame.
5. a kind of online interaction live video image optimization algorithm based on low bandwidth according to claim 4, feature
It is, the step of motion estimation module obtains motion vector is as follows:
S1: if live image is divided into sub-block；
S2: each piece is searched out in the position closed in frame image；
S3: calculating the relative displacement of spatial position between the two, and the relative displacement is motion vector.
6. a kind of online interaction live video image optimization algorithm based on low bandwidth according to claim 1, feature
It is, the step of original image frame compensates is as follows:
SS1: calculating the accumulated error between every frame,
SS2: accumulated error is judged；
SS3: when accumulated error be more than certain threshold value, then present frame is set as new reference frame, the correction for subsequent frame
Compensation.
7. a kind of online interaction live video image optimization algorithm based on low bandwidth according to claim 1, feature
It is, image interpolation process is handled using bicubic interpolation algorithm in the step 6.
Priority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201810779627.XA CN108965842A (en) | 2018-07-16 | 2018-07-16 | A kind of online interaction live video image optimization algorithm based on low bandwidth |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201810779627.XA CN108965842A (en) | 2018-07-16 | 2018-07-16 | A kind of online interaction live video image optimization algorithm based on low bandwidth |
Publications (1)
| Publication Number | Publication Date |
|---|---|
| CN108965842A true CN108965842A (en) | 2018-12-07 |
Family
ID=64481323
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN201810779627.XA Pending CN108965842A (en) | 2018-07-16 | 2018-07-16 | A kind of online interaction live video image optimization algorithm based on low bandwidth |
Country Status (1)
| Country | Link |
|---|---|
| CN (1) | CN108965842A (en) |
Cited By (1)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN110278415A (en) * | 2019-07-02 | 2019-09-24 | 浙江大学 | A kind of web camera video quality improvements method |
Citations (4)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN1791221A (en) * | 2005-12-29 | 2006-06-21 | 北京中星微电子有限公司 | Method for realizing video code anti-shake based on dynamic image and coder |
| CN106101486A (en) * | 2016-06-16 | 2016-11-09 | 恒业智能信息技术（深圳）有限公司 | Method of video image processing and system |
| US9552623B1 (en) * | 2015-11-04 | 2017-01-24 | Pixelworks, Inc. | Variable frame rate interpolation |
| CN106375659A (en) * | 2016-06-06 | 2017-02-01 | 中国矿业大学 | Electronic image stabilization method based on multi-resolution gray projection |
-
2018
- 2018-07-16 CN CN201810779627.XA patent/CN108965842A/en active Pending
Patent Citations (4)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN1791221A (en) * | 2005-12-29 | 2006-06-21 | 北京中星微电子有限公司 | Method for realizing video code anti-shake based on dynamic image and coder |
| US9552623B1 (en) * | 2015-11-04 | 2017-01-24 | Pixelworks, Inc. | Variable frame rate interpolation |
| CN106375659A (en) * | 2016-06-06 | 2017-02-01 | 中国矿业大学 | Electronic image stabilization method based on multi-resolution gray projection |
| CN106101486A (en) * | 2016-06-16 | 2016-11-09 | 恒业智能信息技术（深圳）有限公司 | Method of video image processing and system |
Cited By (1)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN110278415A (en) * | 2019-07-02 | 2019-09-24 | 浙江大学 | A kind of web camera video quality improvements method |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| TWI586177B (en) | Adaptive bit rate control based on scenes | |
| US9521411B2 (en) | Method and apparatus for encoder assisted-frame rate up conversion (EA-FRUC) for video compression | |
| CN100515068C (en) | Static frame loss method in video playing | |
| CN102724492B (en) | Method and system for transmitting and playing video images | |
| KR101776809B1 (en) | Adaptive video decoding circuitry and techniques | |
| US20120201290A1 (en) | Method and system for media file compression | |
| CA2565670A1 (en) | Method and apparatus for motion compensated frame rate up conversion | |
| EP1774794A1 (en) | Method and apparatus for frame rate up conversion with multiple reference frames and variable block sizes | |
| CN1330493A (en) | Decoder with digital image stability function and image stability method | |
| US20110299604A1 (en) | Method and apparatus for adaptive video sharpening | |
| KR20100042632A (en) | Video indexing method, and video indexing device | |
| CN1226786A (en) | View offset estimation for stereo scopic video coding | |
| WO2017036070A1 (en) | Self-adaptive media service processing method and device therefor, encoder and decoder | |
| CN101816016A (en) | video coding with pixel-aligned directional adaptive interpolation filters | |
| CN104378635A (en) | Video region-of-interest (ROI) encoding method based on microphone array assistance | |
| CN109688407A (en) | Reference block selection method, device, electronic equipment and the storage medium of coding unit | |
| EP1035733A2 (en) | Method and arrangement for combining video pictures | |
| CN108965842A (en) | A kind of online interaction live video image optimization algorithm based on low bandwidth | |
| CN108810468A (en) | A kind of video frequency transmitter and method of optimization display effect | |
| CN107888931B (en) | Method for predicting error sensitivity by utilizing video statistical characteristics | |
| CN108810535B (en) | Adaptive robust video coding method based on millimeter wave system | |
| CN115942009A (en) | Remote video service handling method and device based on hybrid coding | |
| CN103596012B (en) | Interframe macro block type selecting method used in real-time AVS-based video frame rate transcoding | |
| CN101127873B (en) | Method and system for improving image quality of video phone | |
| Meessen et al. | WCAM: smart encoding for wireless surveillance |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| PB01 | Publication | ||
| PB01 | Publication | ||
| SE01 | Entry into force of request for substantive examination | ||
| SE01 | Entry into force of request for substantive examination | ||
| RJ01 | Rejection of invention patent application after publication |
Application publication date: 20181207 |
|
| RJ01 | Rejection of invention patent application after publication |