CN1859571A - Screen coding method under low code rate - Google Patents
Screen coding method under low code rate Download PDFInfo
- Publication number
- CN1859571A CN1859571A CN 200610027171 CN200610027171A CN1859571A CN 1859571 A CN1859571 A CN 1859571A CN 200610027171 CN200610027171 CN 200610027171 CN 200610027171 A CN200610027171 A CN 200610027171A CN 1859571 A CN1859571 A CN 1859571A
- Authority
- CN
- China
- Prior art keywords
- key frame
- frame
- screen
- coding
- low code
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Granted
Links
Images
Landscapes
- Compression Or Coding Systems Of Tv Signals (AREA)
- Compression, Expansion, Code Conversion, And Decoders (AREA)
Abstract
The present invention refers to low code rate screen encoding method, belonging to video coding decoding technology field. It contains collecting computer screen picture; uniformly dividing screen picture into plurality of image pieces; comparing with previous frame screen picture corresponded piece; according to comparative result determining whether to make space domain resolution ratio reducing and encoding to current frame, if encoding then adopting time domain self adaptation key frame interval method to determine encoding as key frame or non-key frame; respectively processing mouse messages and image data, adopting destructive and non destructive encoding adjoined encoding method to image data. The present invention is suitable for low code rate videoconference, tele education, and long-range control etc.
Description
Technical field
The present invention relates to the method in a kind of video coding and decoding technology field, specifically, what relate to is a kind of screen coding method under low code rate.
Background technology
In video conference, the telecommunication network teaching, all many-sides such as computer remote monitoring, the image of computer screen transmits the link that is absolutely necessary.One of topmost factor that influences the screen transmission quality is exactly the method for screen coding, especially under low code check, screen coding is had higher requirement.At present, at screen coding, following several method is arranged:
Method one: the collection on-screen data is a video data, utilizes conventional video encoder to encode.Traditional video encoder, comprise MPEG4 (dynamic image expert group formulate an ISO/IEC video encoding and decoding standard) and H.264 (video encoding and decoding standard that video joint working group formulates) and WME (video encoding and decoding standard of Microsoft's formulation) carry out encoding and decoding to video sequence good effect can be arranged, but screen is encoded, especially for the screen coding under the low code check, effect is not fine, above-mentioned video encoding and decoding standard complexity is than higher simultaneously, and CPU usage is than higher when realizing.
Method two: screen is regarded as static images, utilize existing static images coding techniques to encode.This method implements fairly simple, directly the on-screen data that collects as a width of cloth static images, adopt the coding techniques of static images, as JPEG, JPEG2000 etc. encode and are transferred to client.In this case, but client is received direct decoding after the data, does not rely on other view data.But the data volume that JPEG, JPEG2000 encode out is all bigger, so be not suitable for carrying out screen coding under low code check.
Method three: utilize the Windows Media Screen codec of Microsoft that screen is encoded.This method can to screen picture (as mouse move, dialog box and drop-down menu etc.) carry out the excellent reproduction of effect, its data rate can hang down and reach 15kbps, and screen resolution can be up to 1024 * 768.Yet following screen capture activity is difficult to compression: (1) dragged desktop with window; (2) scroll-up/down webpage; (3) the bigger image of Show Color change in depth.
Find through literature search prior art, United States Patent (USP) title: Adaptive entropy encoding/decoding for screen capture content (to the adaptive entropy encoding/decoding of screen capture content), the patent No. is: 7,016,547, this patent has proposed a kind of adaptive entropy coding that is used for screen coding, entropy decoding method.These patent characteristics are that coding side can adaptively selected coding mode (coding that counts, Run-Length Coding and Huffman coding), how to describe adaptively selected coding mode in detail, the coding that how to count, and Run-Length Coding and Huffman encode.But this patent does not have the complexity of considering screen content, factors such as the severe degree of adjacent screen change, and factors such as the severe degree of adjacent screen change, the data volume behind the coding is bigger, and occupied bandwidth is than higher.
Summary of the invention
The present invention is directed to the deficiencies in the prior art and defective, proposed a kind of screen coding method under low code rate, make it solve screen coding occupied bandwidth height in the past, the problem that the system resource occupancy is high.
The present invention is achieved by the following technical solutions, may further comprise the steps:
The screen picture of A, collecting computer;
B, present image evenly is divided into a plurality of image blocks, and compares with previous frame image corresponding blocks;
C, adopt spatial domain epigraph resolution dwindle and time-domain on self adaptation key frame method at interval, realize low code check sub-screen coding.According to the comparative result of step B, whether decision is carried out the spatial domain image resolution ratio to present frame and is dwindled and encode, if encode, adopts self adaptation key frame method at interval to determine that being encoded to key frame still is non-key frame;
D, the method that adopts lossy coding and lossless coding to combine to on-screen data are encoded;
E, mouse message is encoded separately;
In the steps A, to catch the running orbit of mouse.
In the steps A, the colour bits of the view data that collects are transferred to the low level look and preserve from high-order look.
Among the described step C, according to the comparative result of step B, whether decision is carried out the spatial domain image resolution ratio to present frame and is dwindled and encode, if encode, adopting self adaptation key frame method decision at interval to be encoded to key frame still is non-key frame, and concrete grammar is as follows:
(1) if the picture block of present frame is compared with the corresponding blocks of previous frame, do not change, then present frame is not encoded.If the time of not encoding surpasses one minute continuously, then key frame of forced coding.
(2) if the picture block of present frame is compared with the corresponding blocks of previous frame, have one or two pieces to change, it is smaller to be judged to be the image change amplitude, then present frame is carried out being encoded to non-key frame after spatial domain epigraph resolution is dwindled.
(3) if the picture block of present frame compare with the corresponding blocks of previous frame, there is the piece more than three or three to change, it is normal to be judged to be the image change amplitude, then earlier view data being carried out on the spatial domain resolution dwindles, then according to the residing moment point of present frame, this is compiled and just compiles for key frame is key frame, and this is compiled and just compiles for non-key frame is non-key frame.
(4) under the normal condition, every key frame of 20 seconds codings, if still image change satisfies situation (2) always, the non-key frame of continuous programming code surpasses 30 seconds, then key frame of forced coding as situation (3).
Among the step D, the method that adopts lossy coding and lossless coding to combine is encoded to on-screen data.At first view data is carried out motion prediction, reduce the inter frame image redundant information, find motion vector, at simple image such as window and literal, adopt the lossless coding mode then, both preserved picture original, the very high compression ratio of having got back.At images such as coloury scenery, personages, adopt lossy coding, significantly reduce data volume.Coding side is selected suitable coding method automatically according to the complexity of screen picture content, thereby obtains higher compression ratio and compression quality.
In the step e,, obtain mouse shape and mouse position respectively, note then and encode for mouse message.Owing to only when mouse changes, just write down the mouse shape, when moving, only writes down mouse mouse position, and therefore, the relative screen picture of mouse message can be ignored, but can reach good movement effects.The mouse absolute coding can improve the sample frequency of mouse to greatest extent, makes the operation of mouse look more smooth.
The present invention is primarily aimed at low code check screen coding down, according to the severe degree of screen change adopt spatial domain epigraph resolution dwindle and time-domain on self adaptation key frame method at interval, realize that low code check sub-screen encodes.If screen does not change, encoder is not just encoded so, if change very little then image resolution ratio is dwindled back coding, the method that adopts lossy compression method and lossless compress to combine is simultaneously encoded to on-screen data, mouse message is independent of on-screen data encodes.The present invention can save bandwidth, is convenient to low code check transmission, and can reduces the system resource occupancy.
Description of drawings
Fig. 1 is a flow chart of steps of the present invention.
Fig. 2 is a screen compression algorithm flow chart of the present invention.
Embodiment
Provide example with content of the present invention in conjunction with the accompanying drawings:
As shown in Figure 1, concrete implementation step is as follows:
At first, collecting computer screen picture data transfer the colour bits of the view data that collects the low level look to and preserve from high-order look.
Secondly, the even cutting of screen picture is a plurality of, and be that the corresponding blocks of unit and previous frame image compares with the piece, variation has taken place in total total several of record, according to the severe degree that changes, respectively in a different manner, adopt spatial domain epigraph resolution dwindle and time-domain on self adaptation key frame method at interval, carry out encoding process:
(1) if do not change, do not encode so, if but time of not encoding surpassed 1 minute, key frame of forced coding then.
(2), then present frame is carried out being encoded to non-key frame after the spatial domain image resolution ratio is dwindled if the piece that changes has only one or two image blocks.Even the residing moment point of present frame also will force to be encoded to non-key frame for compiling key frame time, to save bandwidth.Step (4) can be handled this situation of continuous appearance (2).
(3) if there is the piece more than three or three that variation has taken place, at first present frame being carried out the spatial domain image resolution ratio dwindles, decide according to the residing moment point of present frame then, if to this be encoded to the moment of key frame, so just be encoded to key frame, if to this be encoded to the moment of non-key frame, just be encoded to non-key frame.
(4) under normal image change situation, promptly as situation (3), encoder can be every key frame of 20 seconds codings, if but screen change is always very little, satisfy situation (2) always, so can be after 30 seconds at the non-key frame of continuous programming code, key frame of forced coding.
At last, according to above method, the method that adopts mouse message and screen picture data to handle respectively makes the motion of mouse can not increase the data volume of screen picture.Screen compression algorithm flow chart is seen Fig. 2.For on-screen data, the mode that adopts lossy coding to combine with lossless coding is encoded.At first adopt motion estimation technique efficiently, reduce the interframe redundant data, find motion vector, to simple image such as window and literal, adopt the lossless coding mode then, so both kept picture original, the very high compression ratio of having got back.To images such as coloury scenery, personages, adopt the lossy compression method coding, significantly reduce data volume.For mouse message, obtain mouse shape and mouse position respectively, note then and encode.Owing to only when mouse changes, just write down the mouse shape, only write down mouse position when mouse moves.Therefore, the relative screen picture of mouse message can be ignored, but can reach good movement effects.The mouse absolute coding can improve the sample frequency of mouse to greatest extent, makes the operation of mouse look more smooth.
The invention provides a kind of screen coding method under low code rate, coding back data volume is low, and occupied bandwidth is little, is easy to Network Transmission, and the picture quality height is low to the system resource occupancy simultaneously.
Claims (6)
1. a screen coding method under low code rate is characterized in that, may further comprise the steps:
The screen picture of A, collecting computer;
B, present image evenly is divided into a plurality of image blocks, and compares with previous frame image corresponding blocks;
C, adopt spatial domain epigraph resolution dwindle and time-domain on self adaptation key frame method at interval, realize low code check sub-screen coding;
D, the method that screen picture The data lossy coding and lossless coding are combined are encoded;
E, mouse message is encoded separately.
2. a kind of screen coding method under low code rate as claimed in claim 1 is characterized in that, in the steps A, will catch the running orbit and the shape of mouse.
3. a kind of screen coding method under low code rate as claimed in claim 1 is characterized in that, in the steps A, the colour bits of the view data that collects is transferred to the low level look and preserves from high-order look.
4. a kind of screen coding method under low code rate as claimed in claim 1, it is characterized in that, among the described step C, comparative result according to step B, whether decision is carried out the spatial domain image resolution ratio to present frame and is dwindled and encode, if encode, adopt the method at self adaptation key frame interval on the time-domain to determine that being encoded to key frame still is non-key frame.
5. a kind of screen coding method under low code rate as claimed in claim 4 is characterized in that, described step C, and the specific implementation method is as follows:
(1) if the picture block of present frame is compared with the corresponding blocks of previous frame, do not change, then present frame is not encoded, if the time of not encoding continuously surpasses one minute, key frame of forced coding then;
(2) if the picture block of present frame is compared with the corresponding blocks of previous frame, there are one or two pieces to change, then earlier present frame carried out spatial domain epigraph resolution and dwindle, be encoded to non-key frame then;
(3) if the picture block of present frame compare with the corresponding blocks of previous frame, there is the piece more than three or three to change, then earlier present frame being carried out spatial domain epigraph resolution dwindles, then according to the residing moment point of present frame, this is compiled and just compiles for key frame is key frame, and this is compiled and just compiles for non-key frame is non-key frame;
(4) under the normal condition, satisfy situation (3) then every key frame of 20 seconds codings, if but image change satisfies situation (2) always, and the non-key frame of continuous programming code surpasses 30 seconds, then key frame of forced coding.
6. a kind of screen coding method under low code rate as claimed in claim 1 is characterized in that, among the described step D, lossy coding mainly is at coloury personage, landscape image, and lossless coding mainly is the image at window and literal.
Priority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CNB2006100271719A CN100455020C (en) | 2006-06-01 | 2006-06-01 | Screen coding method under low code rate |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CNB2006100271719A CN100455020C (en) | 2006-06-01 | 2006-06-01 | Screen coding method under low code rate |
Publications (2)
| Publication Number | Publication Date |
|---|---|
| CN1859571A true CN1859571A (en) | 2006-11-08 |
| CN100455020C CN100455020C (en) | 2009-01-21 |
Family
ID=37298427
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CNB2006100271719A Expired - Fee Related CN100455020C (en) | 2006-06-01 | 2006-06-01 | Screen coding method under low code rate |
Country Status (1)
| Country | Link |
|---|---|
| CN (1) | CN100455020C (en) |
Cited By (10)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN101651827B (en) * | 2009-07-16 | 2012-06-13 | 上海交通大学 | Code rate control method of screen coding |
| CN103533356A (en) * | 2013-10-10 | 2014-01-22 | 深圳市智美达科技有限公司 | Video data transmission method and device |
| CN106303534A (en) * | 2015-06-08 | 2017-01-04 | 上海天荷电子信息有限公司 | Multiple index string and pixel string merge method for compressing image and the device of copy mode |
| CN106686384A (en) * | 2016-11-29 | 2017-05-17 | 苏睿 | Character block compression method, device, image compression method and device |
| CN107172376A (en) * | 2017-06-26 | 2017-09-15 | 北京奇艺世纪科技有限公司 | A kind of method for video coding and device based on Screen sharing |
| CN107181928A (en) * | 2017-07-21 | 2017-09-19 | 苏睿 | Conference system and data transmission method |
| CN107480437A (en) * | 2017-08-01 | 2017-12-15 | 西安万像电子科技有限公司 | Data transmission method and device |
| CN108462878A (en) * | 2018-04-09 | 2018-08-28 | 公安海警学院 | Instructional video compression algorithm based on key frame and indicator motion model |
| CN108810610A (en) * | 2017-05-05 | 2018-11-13 | 腾讯科技（深圳）有限公司 | screen sharing method and device |
| CN113810639A (en) * | 2021-09-28 | 2021-12-17 | 深圳万兴软件有限公司 | Method, device and related medium for recording mouse information and re-editing |
Family Cites Families (3)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| JP2002084540A (en) * | 2000-06-28 | 2002-03-22 | Canon Inc | Device and method for processing image, electronic camera and program |
| US7016547B1 (en) * | 2002-06-28 | 2006-03-21 | Microsoft Corporation | Adaptive entropy encoding/decoding for screen capture content |
| CN100420299C (en) * | 2004-12-24 | 2008-09-17 | 北京中星微电子有限公司 | A screen broadcasting method |
-
2006
- 2006-06-01 CN CNB2006100271719A patent/CN100455020C/en not_active Expired - Fee Related
Cited By (16)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN101651827B (en) * | 2009-07-16 | 2012-06-13 | 上海交通大学 | Code rate control method of screen coding |
| CN103533356A (en) * | 2013-10-10 | 2014-01-22 | 深圳市智美达科技有限公司 | Video data transmission method and device |
| CN106303534A (en) * | 2015-06-08 | 2017-01-04 | 上海天荷电子信息有限公司 | Multiple index string and pixel string merge method for compressing image and the device of copy mode |
| CN106303534B (en) * | 2015-06-08 | 2022-05-31 | 上海天荷电子信息有限公司 | Image compression method and device for multiple index string and pixel string fusion copy modes |
| CN106686384A (en) * | 2016-11-29 | 2017-05-17 | 苏睿 | Character block compression method, device, image compression method and device |
| CN106686384B (en) * | 2016-11-29 | 2019-05-24 | 西安万像电子科技有限公司 | The compression method and device and method for compressing image and device of character block |
| CN108810610A (en) * | 2017-05-05 | 2018-11-13 | 腾讯科技（深圳）有限公司 | screen sharing method and device |
| CN107172376A (en) * | 2017-06-26 | 2017-09-15 | 北京奇艺世纪科技有限公司 | A kind of method for video coding and device based on Screen sharing |
| CN107172376B (en) * | 2017-06-26 | 2020-04-21 | 北京奇艺世纪科技有限公司 | Video coding method and device based on screen sharing |
| CN107181928A (en) * | 2017-07-21 | 2017-09-19 | 苏睿 | Conference system and data transmission method |
| CN107480437A (en) * | 2017-08-01 | 2017-12-15 | 西安万像电子科技有限公司 | Data transmission method and device |
| CN107480437B (en) * | 2017-08-01 | 2020-09-18 | 西安万像电子科技有限公司 | Data transmission method and device |
| CN108462878A (en) * | 2018-04-09 | 2018-08-28 | 公安海警学院 | Instructional video compression algorithm based on key frame and indicator motion model |
| CN108462878B (en) * | 2018-04-09 | 2020-10-09 | 公安海警学院 | Teaching video compression algorithm based on key frame and indicator motion model |
| CN113810639A (en) * | 2021-09-28 | 2021-12-17 | 深圳万兴软件有限公司 | Method, device and related medium for recording mouse information and re-editing |
| CN113810639B (en) * | 2021-09-28 | 2023-09-29 | 深圳万兴软件有限公司 | Method, device and related medium for recording mouse information and re-editing |
Also Published As
| Publication number | Publication date |
|---|---|
| CN100455020C (en) | 2009-01-21 |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| CN1859571A (en) | Screen coding method under low code rate | |
| KR100746007B1 (en) | Method and apparatus for adaptively selecting context model of entrophy coding | |
| CN101189882B (en) | Method and apparatus for encoder assisted-frame rate up conversion (EA-FRUC) for video compression | |
| KR100667806B1 (en) | Method and apparatus for video encoding and decoding | |
| KR100679031B1 (en) | Method for encoding/decoding video based on multi-layer, and apparatus using the method | |
| Pan et al. | A low-complexity screen compression scheme for interactive screen sharing | |
| US7218790B2 (en) | Adaptive entropy encoding/decoding for screen capture content | |
| CN1170436C (en) | Compressed picture bit stream transcoding method | |
| CN1575601A (en) | Spatial scalable compression | |
| JP2007520149A (en) | Scalable video coding apparatus and method for providing scalability from an encoder unit | |
| KR20070100081A (en) | Method and apparatus for encoding and decoding fgs layers using weighting factor | |
| JP2006304307A5 (en) | ||
| CN1622618A (en) | A screen broadcasting method | |
| CN109905717A (en) | A kind of H.264/AVC Encoding Optimization based on Space-time domain down-sampling and reconstruction | |
| CN112188196A (en) | Method for rapid intra-frame prediction of general video coding based on texture | |
| CN1672421A (en) | Method and apparatus for performing multiple description motion compensation using hybrid predictive codes | |
| Yan et al. | A survey on the techniques for the transport of MPEG-4 video over wireless networks | |
| CN101360236B (en) | Wyner-ziv video encoding and decoding method | |
| Sodagar et al. | A new error resilience technique for image compression using arithmetic coding | |
| CN200962655Y (en) | A motive image compression system for mobile device | |
| CN1126376C (en) | Method for eliminating error in bit data flow and apparatus thereof | |
| Strukov et al. | Evaluation of video compression methods for network transmission on diverse data: a case study | |
| CN1396769A (en) | Compression method and system for moving image information | |
| KR20060127344A (en) | Computer screen image codec apparatus and method | |
| CN1688162A (en) | Coding method for monitoring image resolution and its apparatus |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| C06 | Publication | ||
| PB01 | Publication | ||
| C10 | Entry into substantive examination | ||
| SE01 | Entry into force of request for substantive examination | ||
| C14 | Grant of patent or utility model | ||
| GR01 | Patent grant | ||
| C17 | Cessation of patent right | ||
| CF01 | Termination of patent right due to non-payment of annual fee |
Granted publication date: 20090121 Termination date: 20130601 |