CN102710935A - Method for screen transmission between computer and mobile equipment through incremental mixed compressed encoding - Google Patents

Method for screen transmission between computer and mobile equipment through incremental mixed compressed encoding Download PDF

Info

Publication number
CN102710935A
CN102710935A CN2011103815886A CN201110381588A CN102710935A CN 102710935 A CN102710935 A CN 102710935A CN 2011103815886 A CN2011103815886 A CN 2011103815886A CN 201110381588 A CN201110381588 A CN 201110381588A CN 102710935 A CN102710935 A CN 102710935A
Authority
CN
China
Prior art keywords
data
incremental
pixel
screen frame
screen
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Pending
Application number
CN2011103815886A
Other languages
Chinese (zh)
Inventor
周永军
戴崇坚
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
HANGZHOU WANIN EDUCATION MULTIMEDIA TECHNOLOGY CO LTD
Original Assignee
HANGZHOU WANIN EDUCATION MULTIMEDIA TECHNOLOGY CO LTD
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by HANGZHOU WANIN EDUCATION MULTIMEDIA TECHNOLOGY CO LTD filed Critical HANGZHOU WANIN EDUCATION MULTIMEDIA TECHNOLOGY CO LTD
Priority to CN2011103815886A priority Critical patent/CN102710935A/en
Publication of CN102710935A publication Critical patent/CN102710935A/en
Pending legal-status Critical Current

Links

Images

Landscapes

  • Compression Or Coding Systems Of Tv Signals (AREA)

Abstract

The invention discloses a method for screen transmission between a computer and mobile equipment through incremental mixed compressed encoding. The method comprises the following steps of: acquiring screen data on the computer, and performing image encoding on the acquired screen data to form screen frame image data; performing incremental computation on the current screen frame image datum and the previous screen frame image datum by using an incremental computation method, and acquiring incremental data; performing mixed compressed encoding on the current screen frame image datum and the incremental data to form an incremental data packet; and comparing the size of the incremental data packet with the size of the current screen frame image datum, and transmitting the smaller one to the mobile equipment.

Description

Carry out the method that screen transmits through the increment MIXED COMPRESSION CODING between computer and mobile device
Technical field
The present invention is a kind of method of between computer and mobile device, carrying out screen transmission through the increment MIXED COMPRESSION CODING; Especially pass through the method for increment MIXED COMPRESSION CODING; Ensureing screen picture quality prerequisite decline low transmission data volume, belong to Computer Image Processing and network transmission technology field.
Background technology
In the existing screen transmission method on-screen data being handled mainly is two kinds of image mode and video modes.
Under the image mode, on-screen data is become image data frame to handle and transmit according to certain frequency collection.This mode advantage is that coded image data is supportive wide by equipment, makes things convenient for control transmission frame per second and data amount transmitted.The restriction of this mode is when requiring high image quality, needs high data volume, the pressure that brings coding to calculate and transmit, on the contrary the coded image data data volume is lower, brings decrease in image quality.This mode is because the restriction of frame per second is fit to handle the static relatively situation of screen content.
Under the video mode, on-screen data is carried out video coding and is transmitted according to the mode of video flowing, and this mode advantage is the situation that is fit to handle the screen content relative dynamic.The restriction of this mode is that stream encryption requires often to be difficult to the situation that is applicable to that the device processes ability is lower all than higher to calculation of equipments ability and transmittability.
Making rapid progress of science and technology, novel mobile device products such as smart mobile phone, panel computer continue to bring out, and compare with common computer, and these device hardware overall performances are lower, computing capability is relatively poor, screen size is less etc.When carrying out the screen transmission, need emphasis to solve the problem of aspects such as handling property, picture quality, transmitting synchronous property.
Summary of the invention
The object of the present invention is to provide between a kind of computer and mobile device and carry out the method that screen transmits through the increment MIXED COMPRESSION CODING; Said method is carried out image mode to on-screen data and is handled; Method through the increment hybrid coding; Ensure screen picture quality prerequisite decline low transmission data volume, solving the problem of contradiction between data quantity transmitted and transmission process.
For realizing the foregoing invention purpose, the present invention adopts following technical proposals to be achieved:
Carry out the method that screen transmits through the increment MIXED COMPRESSION CODING between a kind of computer and mobile device, comprising:
Step 1, the collecting computer on-screen data carries out image encoding to the on-screen data that collects and forms the screen frame view data; Method for encoding images be JPEG, JPEG2000, BMP, PNG etc. one or more but be not limited to, more excellent is selects hardware device can support to carry out that hardware compression calculates, and improves arithmetic speed; More excellent JPEG etc. belongs to the stationary image compression coding technology, and JPEG has that distortion is little, compression ratio is high, plurality of devices support hardware coding and the fast advantage of hardware decoding speed;
Step 2 is used the incremental computations method, and current screen frame image data and last screen frame view data are carried out incremental computations, obtains incremental data; Whether the incremental computations method is according to the mode of pixel column the screen frame view data to be divided into groups, identical through the corresponding grouped data of more last screen frame view data, judges whether to change, and the grouped data of all changes constitutes incremental data;
Step 3 is carried out MIXED COMPRESSION CODING with current screen frame image data and incremental data, obtains the incremental data bag; MIXED COMPRESSION CODING is according to the mode of pixel column the screen frame view data to be divided into groups; Be the basis with the current screen frame image data; Relatively incremental data and current screen frame image data carry out hybrid coding; Whole pixels in the incremental data are carried out compressed encoding; The compression sampling method is whether each pixel of comparison is identical with the pixel of the correspondence position of its previous row of being expert at, and relatively whether each pixel is identical with its previous pixel of being expert at;
Step 4, the size of incremental data bag and current screen frame image data relatively, the less mobile device end that is transferred to.
Aforesaid method, step 2 are in order to reduce method calculated data amount, the optimization step of the computational speed of increase method, and this step is optional.
It is a kind of packet mode more excellent under the current screen technical conditions that aforesaid method, the pixel column mode in said step 2, the step 4 are divided into groups, and also can take modes such as pixel column, block of pixels to divide into groups to realize.
Aforesaid method; In the MIXED COMPRESSION CODING in the said step 3; The compression sampling method is to have selected comprehensively relatively whether each pixel is identical with the pixel of the correspondence position of its previous row of being expert at for use; Each pixel and its previous pixel of being expert at identical these two kinds of sampling modes whether relatively, these two kinds of sampling modes are methods more excellent under the present Screen Technology, are not limited to select for use one or both or other sampling mode but compress sampling mode.
The present invention has following advantage with respect to existing method:
1, the present invention can give full play to the device hardware computing capability according to encode support situation adjustment of device hardware.The support equipment type is extensive, and especially lower to computing capabilitys such as smart mobile phone, panel computers, screen size small device has better supportive.
2, the increment MIXED COMPRESSION CODING method of the present invention's proposition, view data comparison and computational speed are fast, and the data representation compression ratio is high.
3, the incremental data of screen change and the smaller of on-screen data are only transmitted in the present invention, can reduce data processing and transmission quantity significantly; Change relatively under the less situation at screen content, laser propagation effect is desirable especially.
Description of drawings
Carry out the flow chart of the method for screen transmission between Fig. 1 computer of the present invention and mobile device through the increment MIXED COMPRESSION CODING;
Carry out the on-screen data sample figure of the method for screen transmission between Fig. 2 computer of the present invention and mobile device through the increment MIXED COMPRESSION CODING;
Pixel data presentation graphs under Fig. 3 colour code scheme RGB;
Carry out the pixel data presentation graphs of the method for screen transmission between Fig. 4 computer of the present invention and mobile device through the increment MIXED COMPRESSION CODING;
Carry out the MIXED COMPRESSION CODING computation sequence figure of the method for screen transmission between Fig. 5 computer of the present invention and mobile device through the increment MIXED COMPRESSION CODING;
Carry out the MIXED COMPRESSION CODING result data sample figure of the method for screen transmission between Fig. 6 computer of the present invention and mobile device through the increment MIXED COMPRESSION CODING.
 
Embodiment
Below in conjunction with accompanying drawing and embodiment technical scheme of the present invention is further specified, but execution mode of the present invention is not limited thereto.
Embodiment
As shown in Figure 1, carry out the method that screen transmits through the increment MIXED COMPRESSION CODING between computer of the present invention and mobile device, key step is following:
Step 1, the collecting computer on-screen data carries out image encoding to the on-screen data that collects and forms the screen frame view data.Common image conversion code processing method comprises:
JPEG etc. belong to the stationary image compression coding technology, and JPEG has that distortion is little, compression ratio is high, equipment end hardware encoding and the fast advantage of hardware decoding speed;
MPEG etc. belong to the moving picture experts group technology, and under the specific scene of screen picture, the distortion of MPEG is bigger, and, realize the Real Time Compression transmission, high to the cpu performance requirement of transmit leg;
Complete incremental mode (similar VNC), undistorted, under the little situation of screen change, amount of information is little, but under high-resolution, when screen change was big, increment information was big, and high to the calculation of equipments Capability Requirement.
The image of on-screen data not exclusively belongs to rest image and moving image.The image conversion coding of gathering on-screen data adopts the JPEG scheme.
Step 2 is used the incremental computations method, and current screen frame image data and last screen frame view data are carried out incremental computations, obtains incremental data; Whether the incremental computations method is according to the mode of pixel column the screen frame view data to be divided into groups, identical through the corresponding grouped data of more last screen frame view data, judges whether to change, and the grouped data of all changes constitutes incremental data.
On-screen data is divided according to order from top to bottom and is embarked on journey, and order from left to right is divided into row, and row and column is all since 0 counting.In the realization,,, after whole row of every row are relatively accomplished, continue relatively next line, all relatively accomplish until screen since the 0 row comparison of 0 row according to the subscript order of ranks.Simple for narrating, only with 13 row *, 16 row explanation technical processes, as shown in Figure 2, the incremental data scope of present frame and former frame is in the rectangular extent of the 8th row that are listed as the 5th row from the 7th of the 2nd row.
Step 3 is carried out MIXED COMPRESSION CODING with current screen frame image data and incremental data, obtains the incremental data bag; MIXED COMPRESSION CODING is according to the mode of pixel column the screen frame view data to be divided into groups; Be the basis with the current screen frame image data; Relatively incremental data and current screen frame image data carry out hybrid coding; Whole pixels in the incremental data are carried out compressed encoding; The compression sampling method is whether each pixel of comparison is identical with the pixel of the correspondence position of its previous row of being expert at, and relatively whether each pixel is identical with its previous pixel of being expert at.
The principle of computer color display display color is to adopt the principle of R (Red), G (Green), B (Blue) additive color mixture: through launching the electron beam of three kinds of varying strengths, make the inboard red, green, blue phosphor material that covers of screen luminous and produce color.The method for expressing of this color is called rgb color space and representes, it also is a kind of color space method for expressing with the most use in the Multimedia Computer Technology., the three primary colors component is mixed into black light when all being 0 (the most weak); And, the three primary colors component is mixed into white light when all being k (the strongest).The value of adjustment r, g, three coefficients of b can blend the various coloured light between black light and white light.
Under the image scheme of existing RGB24 position color representation method, employing be the fixed length method for expressing, each pixel will be represented with the 24bit data at least, 24 pixels as shown in Figure 3.According to the area of the row of 13 among Fig. 2 * 16 row, then need 4992 (13*16*24) bit data at least.
The increment MIXED COMPRESSION CODING is a kind of elongated data representation, and is as shown in Figure 4, and each pixel is represented with the elongated data bit of the flag bit of 2bit and optional 0-15bit.Selecting elongated data is that 15 reason is to compare 24 colors, has reduced data volume under 15 color modes, but has compared 24 not significantly distortions of color mode image.Pixel of 15 bit representations, 5 in these 15 are used for R, and 5 are used for G, and 5 are used for B, 15 pixels as shown in Figure 3.
Except that 15 colors; Can also select littler like 9 RGB (3+3+3), 12 RGB (4+4+4); Or bigger like 24 RGB (8+8+8), 18 (6+6+6), 21 (7+7+7) modes, but 9 colors can only show 512 kinds of colors, and image fault is serious; The amount of information of 24 modes has increased by 9 than 15 modes, and display effect does not have evident difference.
Under the situation as shown in Figure 2, the result is as shown in Figure 6 for the increment MIXED COMPRESSION CODING.
Visible from coding schedule, the size of data after the increment MIXED COMPRESSION CODING is 431 (13*16*2+15) bit.
Coding computation sequence is as shown in Figure 5.After obtaining region of variation, to the zone that the changes calculating of encoding.The computing rule of each pixel be at first with present frame move ahead same column relatively, identically then encode 00, the different continuation; With present frame go together the prostatitis relatively, identically then encode 01, the different continuation; With former frame go together same column relatively, identically then encode 10, different coding 11 adds 15 color data in addition.
Specify calculation of coding process below for example:
1 by step 2, and incremental range is the 8th row that are listed as the 5th row from the 4th of the 2nd row, and then each pixel coder of every row except that 2 to 5 row is 00 (no change);
The pixel coder 00 (identical) of 2 the 2nd row the 4th row with the same column that moves ahead of present frame;
The pixel coder 10 (identical) of 3 the 2nd row the 5th row with the same column of going together of former frame;
The pixel coder 01 (identical) of 4 the 2nd row the 6th row with the prostatitis of going together of present frame;
The pixel coder 11 of 5 the 3rd row the 6th row adds 15 color data (being discontented with the 3 kinds of situation that are enough to).
 
Step 4, the size of incremental data bag and current screen frame image data relatively, the less mobile device end that is transferred to.Under increment MIXED COMPRESSION CODING situation, increment is mixing compressed can be increased along with the increase of the image change area of representing according to the bag size.When the image change area of expression surpasses certain proportion; The incremental data bag situation also bigger than screen frame view data might appear, (like the computer tangent screen time, the variation fully of screen possibly occur); For optimizing transmission; Before transmits data packets, need relatively incremental data bag and frame image data, the transmission smaller saves bandwidth.

Claims (8)

1. one kind is carried out the method that screen transmits through the increment MIXED COMPRESSION CODING between computer and mobile device, it is characterized in that, comprising:
Step 1, the collecting computer on-screen data carries out image encoding to the on-screen data that collects and forms the screen frame view data;
Step 2 is used the incremental computations method, and current screen frame image data and last screen frame view data are carried out incremental computations, obtains incremental data;
Step 3 is carried out MIXED COMPRESSION CODING with current screen frame image data and incremental data, obtains the incremental data bag;
Step 4, the size of incremental data bag and current screen frame image data relatively, the less mobile device end that is transferred to.
2. the method for claim 1; It is characterized in that: the method for encoding images in the said step 1 be JPEG, JPEG2000, BMP, PNG etc. one or more but be not limited to; More excellent is to select hardware device can support to carry out hardware compression to calculate, and improves arithmetic speed.
3. the method for claim 1; It is characterized in that: the incremental computations method in the said step 2 is according to the mode of pixel column the screen frame view data to be divided into groups; Whether the corresponding grouped data through more last screen frame view data is identical; Judge whether to change, the grouped data of all changes constitutes incremental data.
4. the method for claim 1, it is characterized in that: the MIXED COMPRESSION CODING in the said step 3 is according to the mode of pixel column the screen frame view data to be divided into groups; Be the basis with the current screen frame image data; Relatively incremental data and current screen frame image data carry out hybrid coding; Whole pixels in the incremental data are carried out compressed encoding; The compression sampling method is whether each pixel of comparison is identical with the pixel of the correspondence position of its previous row of being expert at, and relatively whether each pixel is identical with its previous pixel of being expert at.
5. the method for claim 1 is characterized in that: said step 2 is in order to reduce method calculated data amount, the optimization step of the computational speed of increase method, and this step is optional.
6. the method for claim 1, it is characterized in that: it is a kind of packet mode more excellent under the current screen technical conditions that the pixel column mode in said step 2, the step 4 is divided into groups, and also can take modes such as pixel column, block of pixels to divide into groups to realize.
7. the method for claim 1; It is characterized in that: in the MIXED COMPRESSION CODING in the said step 3; The compression sampling method is to have selected comprehensively relatively whether each pixel is identical with the pixel of the correspondence position of its previous row of being expert at for use; Each pixel and its previous pixel of being expert at identical these two kinds of sampling modes whether relatively; These two kinds of sampling modes are methods more excellent under the present Screen Technology, but the compression sampling mode is not limited to select for use one or both or other sampling mode.
8. the method shown in claim 1; It is characterized in that: the elongated data method that in the MIXED COMPRESSION CODING in the said step 3 pixel The data 2bit sign is added the elongated data of 0-15bit representes that the combination of flag bit length and elongated data bit length is not limited thereto.
CN2011103815886A 2011-11-28 2011-11-28 Method for screen transmission between computer and mobile equipment through incremental mixed compressed encoding Pending CN102710935A (en)

Priority Applications (1)

Application Number Priority Date Filing Date Title
CN2011103815886A CN102710935A (en) 2011-11-28 2011-11-28 Method for screen transmission between computer and mobile equipment through incremental mixed compressed encoding

Applications Claiming Priority (1)

Application Number Priority Date Filing Date Title
CN2011103815886A CN102710935A (en) 2011-11-28 2011-11-28 Method for screen transmission between computer and mobile equipment through incremental mixed compressed encoding

Publications (1)

Publication Number Publication Date
CN102710935A true CN102710935A (en) 2012-10-03

Family

ID=46903472

Family Applications (1)

Application Number Title Priority Date Filing Date
CN2011103815886A Pending CN102710935A (en) 2011-11-28 2011-11-28 Method for screen transmission between computer and mobile equipment through incremental mixed compressed encoding

Country Status (1)

Country Link
CN (1) CN102710935A (en)

Cited By (5)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN103150132A (en) * 2013-02-21 2013-06-12 海信集团有限公司 Screen transmission method and electronic equipment
CN105959796A (en) * 2016-04-29 2016-09-21 海尔优家智能科技(北京)有限公司 Communication method and device based on image increment information
CN106803863A (en) * 2016-12-20 2017-06-06 深圳市金立通信设备有限公司 A kind of image sharing method and terminal
CN107665128A (en) * 2017-09-13 2018-02-06 深信服科技股份有限公司 Image processing method, system, server and readable storage medium storing program for executing
CN109218748A (en) * 2017-06-30 2019-01-15 京东方科技集团股份有限公司 Video transmission method, device and computer readable storage medium

Citations (5)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
EP1871116A2 (en) * 2006-06-22 2007-12-26 Samsung Electronics Co., Ltd. Compression of video encoding parameters
CN101404768A (en) * 2008-10-07 2009-04-08 广东威创视讯科技股份有限公司 Image-processing method
CN101459854A (en) * 2007-12-13 2009-06-17 鸿富锦精密工业(深圳)有限公司 Encoding/decoding apparatus for picture compression and encoding/decoding method therefor
CN101977312A (en) * 2002-10-01 2011-02-16 阿沃森特公司 Video compression encoder
US20110216829A1 (en) * 2010-03-02 2011-09-08 Qualcomm Incorporated Enabling delta compression and modification of motion estimation and metadata for rendering images to a remote display

Patent Citations (5)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN101977312A (en) * 2002-10-01 2011-02-16 阿沃森特公司 Video compression encoder
EP1871116A2 (en) * 2006-06-22 2007-12-26 Samsung Electronics Co., Ltd. Compression of video encoding parameters
CN101459854A (en) * 2007-12-13 2009-06-17 鸿富锦精密工业(深圳)有限公司 Encoding/decoding apparatus for picture compression and encoding/decoding method therefor
CN101404768A (en) * 2008-10-07 2009-04-08 广东威创视讯科技股份有限公司 Image-processing method
US20110216829A1 (en) * 2010-03-02 2011-09-08 Qualcomm Incorporated Enabling delta compression and modification of motion estimation and metadata for rendering images to a remote display

Cited By (9)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN103150132A (en) * 2013-02-21 2013-06-12 海信集团有限公司 Screen transmission method and electronic equipment
CN103150132B (en) * 2013-02-21 2016-01-13 海信集团有限公司 A kind of biography screen method and electronic equipment
CN105959796A (en) * 2016-04-29 2016-09-21 海尔优家智能科技(北京)有限公司 Communication method and device based on image increment information
CN105959796B (en) * 2016-04-29 2019-06-04 海尔优家智能科技(北京)有限公司 A kind of communication means and device based on image increment information
CN106803863A (en) * 2016-12-20 2017-06-06 深圳市金立通信设备有限公司 A kind of image sharing method and terminal
CN109218748A (en) * 2017-06-30 2019-01-15 京东方科技集团股份有限公司 Video transmission method, device and computer readable storage medium
CN109218748B (en) * 2017-06-30 2020-11-27 京东方科技集团股份有限公司 Video transmission method, device and computer readable storage medium
US11412274B2 (en) 2017-06-30 2022-08-09 Boe Technology Group Co., Ltd. Video transmission method and apparatus, and computer-readable storage medium thereof
CN107665128A (en) * 2017-09-13 2018-02-06 深信服科技股份有限公司 Image processing method, system, server and readable storage medium storing program for executing

Similar Documents

Publication Publication Date Title
CN105191304B (en) Image encoding method and device and relevant picture decoding method and device according to pixel data execution position flat scanning coding
CN104205845B (en) LM patterns with unified bit wide multiplier
CN102761738B (en) Method for compressing image and device based on mixing colourity sample rate
US20020196970A1 (en) Image compression apparatus, image decompression apparatus, image compression method, image decompression method, computer program product, and recording medium
CN103636204A (en) Selective lossless-lossy compression of image data based on bit budget
CN104969549A (en) Mixed mode for frame buffer compression
CN102710935A (en) Method for screen transmission between computer and mobile equipment through incremental mixed compressed encoding
CN104025561A (en) Image compression method and image processing apparatus
CN108271024A (en) Image coding, coding/decoding method and device
US20160269728A1 (en) Coding structure
US8731060B2 (en) Video encoding system and method
CN104581177A (en) Image compression method and device combining block matching with string matching
CN107431812A (en) For showing the complex region detection of stream compression
CN102231836B (en) Graphics interchange format (GIF) file processing method and device for digital television system
CN106031168B (en) Self-adaptive processing with the video flowing for reducing color-resolution
US20020044692A1 (en) Apparatus and method for optimized compression of interlaced motion images
CN102045580B (en) Method and system for processing video
CN108702520A (en) Device and method for the entropy coding based on vector for showing stream compression
CN101923455A (en) Method for displaying and analyzing digital image in YUV format
CN105519108B (en) The weight predicting method and device of quantization matrix coding
CN111246208B (en) Video processing method and device and electronic equipment
CN102231834A (en) Animated portable network graphics (APNG) file processing method and device for digital television system
US10200697B2 (en) Display stream compression pixel format extensions using subpixel packing
CN101536329A (en) Apparatus and method for uncompressed, wireless transmission of video
JP3401762B2 (en) Image compression encoding / decoding method, image compression encoding / decoding device, image compression encoding / transmission method, image compression encoding / transmission system, and recording medium recording image compression encoding / decoding program

Legal Events

Date Code Title Description
C06 Publication
PB01 Publication
C10 Entry into substantive examination
SE01 Entry into force of request for substantive examination
RJ01 Rejection of invention patent application after publication
RJ01 Rejection of invention patent application after publication

Application publication date: 20121003