Summary of the invention
Main purpose of the present invention provides a kind of remote desktop image transfer method and system, is intended to obtain the better optimize effect.
The invention discloses a kind of remote desktop image transfer method, may further comprise the steps:
Step S01, compression end carry out piecemeal according to the piecemeal rule with the present frame of desktop picture; And set up hierarchical index; According to said hierarchical index; The modified-image piece that detects the relative image block buffer memory of image block of said present frame reaches not modified-image piece, the back label with said not modified-image piece of said modified-image piece compression is encapsulated obtain view data, and said view data is sent to the decompress(ion) end;
After step S02, said decompress(ion) termination are received said view data, divide in the said view data corresponding said modified-image piece and not behind the label of modified-image piece, said view data is reverted to corresponding image block according to said piecemeal formula area; Merge said image block, show said desktop picture.
Preferably, said step S01 specifically may further comprise the steps:
According to said piecemeal rule, be some said image blocks with the present frame cutting of said desktop picture;
Generate finger image according to said image block, and set up the hierarchical index of said image block;
Utilize said finger image and hierarchical index, begin successively to search for and judge whether said image block can find in said image block buffer memory by the top layer index;
If not, then said image block is the modified-image piece, and said modified-image piece is compressed, and obtains packed data;
If then said image block is modified-image piece not, write down the image tag of said not modified-image piece;
Encapsulate said packed data and said image tag, obtain the said view data after the encapsulation and said view data sent to said decompress(ion) end.
Preferably, said step S02 specifically may further comprise the steps:
After receiving the said view data of said compression end transmission, divide said packed data and said image tag according to said piecemeal formula area;
Recover said not modified-image piece according to said hierarchical index and said image tag, and the said packed data of decompress(ion) recovers said modified-image piece;
Merge said modified-image piece and reach not modified-image piece, show said desktop picture, simultaneously said piecemeal result of buffer memory and said hierarchical index.
Preferably, said hierarchical index adopts the index entry of stratification that said image block is organized, said index entry level represent the ascending of said image block from low to high respectively, and the said index entry of top layer is represented whole said image block.
Preferably, said piecemeal rule keeps synchronously and can switch according to concrete application scenarios at said compression end and said decompress(ion) end; Said piecemeal rule comprises that employing Image Edge-Detection and edge compensation carry out the random length image block.
Preferably, said piecemeal rule specifically comprises according to the step that concrete application scenarios switches:
Utilize the said piecemeal result and the hierarchical index of buffer memory, the modified-image piece that detects the relative image block buffer memory of said present frame reaches not modified-image piece, and testing result is transmitted;
Judge whether the remote desktop connection stops;
If not, then collect present image information and judge whether current scene satisfies piecemeal rule switching condition;
If satisfy,, switch to new piecemeal rule then according to said present image information;
Utilize said new piecemeal rule that said present frame is carried out piecemeal, and replace existing said piecemeal result and hierarchical index.
The present invention also discloses a kind of remote desktop image delivering system, comprising:
Compression end; Be used for the present frame of desktop picture being carried out piecemeal according to said piecemeal rule; And set up hierarchical index, according to said hierarchical index, the modified-image piece that detects the relative image block buffer memory of image block of said present frame reaches not modified-image piece; Said modified-image piece compression back encapsulated with the label of said not modified-image piece obtain view data, and said view data is sent to the decompress(ion) end;
Said decompress(ion) end, be used to receive said view data after, according to said piecemeal rule, distinguish said modified-image piece corresponding in the said view data and not behind the label of modified-image piece, said view data reverted to corresponding image block; Merge said image block, show said desktop picture.
Preferably, said compression end specifically comprises:
The image block module is used for according to said piecemeal rule, is some image blocks with the present frame cutting of said desktop picture;
Hierarchical index is set up module, is used for generating finger image according to said image block, and sets up the hierarchical index of said image block;
The image change identification module is used to utilize said finger image and hierarchical index, is begun successively to search for and judged whether said image block can find in said image block buffer memory by the top layer index; If then said image block is modified-image piece not; If not, then said image block is the modified-image piece;
Image processing module is used for when said image block is the modified-image piece, and said modified-image piece is compressed, and obtains packed data; When image block does not take place, write down the image tag of said not modified-image piece at said image block;
The view data output module is used to encapsulate said packed data and said image tag, obtains the said view data after the encapsulation and said view data sent to said decompress(ion) end.
Preferably, said decompress(ion) end specifically comprises:
The image area sub-module after being used to receive the said view data of said compression end transmission, divides said packed data and said image tag according to said piecemeal formula area;
Image-restoration module be used for recovering said not modified-image piece according to said hierarchical index and said image tag, and the said packed data of decompress(ion) is recovered said modified-image piece;
Image display is used to merge said modified-image piece and reaches not modified-image piece, shows said desktop picture, simultaneously said piecemeal result of buffer memory and said hierarchical index.
Preferably, said hierarchical index adopts the index entry of stratification that said image block is organized, said index entry level represent the ascending of said image block from low to high respectively, and the said index entry of top layer is represented whole said image block.
Preferably, said compression end also comprises:
The piecemeal rule is provided with module, is used for keeping said piecemeal regular and synchronized and can switching said piecemeal rule according to concrete application scenarios in said compression end and said decompress(ion) end; Said piecemeal rule comprises that employing Image Edge-Detection and edge compensation carry out the random length image block.
Preferably, said piecemeal rule is provided with module and specifically comprises:
The image block detecting unit is used to utilize the said piecemeal result and the hierarchical index of buffer memory, detects the modified-image piece of the relative image block buffer memory of said present frame and modified-image piece not, and testing result is transmitted;
The image information collector unit is used to judge whether the remote desktop connection stops, and when said remote desktop connection does not stop, collects present image information and judge also whether current scene satisfies piecemeal rule switching condition;
Piecemeal rule switch unit is used for when current scene satisfies piecemeal rule switching condition, according to said present image information, switches to new piecemeal rule;
Hierarchical index replacement unit is used to utilize said new piecemeal rule that said present frame is carried out piecemeal, and replaces existing said piecemeal result and hierarchical index.
The present invention is through being some image blocks according to the piecemeal rule with the desktop picture cutting in compression end, and the modified-image piece that detects the relative image block buffer memory of image block of present frame reaches not modified-image piece, and image block is carried out sending to the decompress(ion) end after the handled; The decompress(ion) end is distinguished the modified-image piece and is reached not modified-image piece from the view data that receives; And view data reverted to corresponding image block; The image restored piece is merged the back show that this desktop picture and whole process compression end and decompress(ion) end keep the method for piecemeal regular and synchronized, have the beneficial effect that reduces data amount transmitted, improves the image compression rate, improved systematic function; Promote user experience, obtained the optimization effect of better remote desktop image transmission.
Embodiment
Further specify technical scheme of the present invention below in conjunction with Figure of description and specific embodiment.Should be appreciated that specific embodiment described herein only in order to explanation the present invention, and be not used in qualification the present invention.Remote desktop described in the embodiment of the invention is a kind of patterned remote-access technology; Can be so that the computer of user's remote control network other end; The desktop picture of controlled terminal can be presented on user's the display device, makes the user obtain to operate the same experience of local device; Corresponding in a preferred embodiment, compression end is the controlled computer of telecommunication network, and the decompress(ion) end is the computer that shows at user side.The subsequent implementation example repeats no more to the implication of remote desktop, compression end and decompress(ion) end.
With reference to Fig. 1, Fig. 1 is remote desktop image transfer method one an embodiment schematic flow sheet of the present invention; As shown in Figure 1, remote desktop image transfer method of the present invention may further comprise the steps:
Step S01, compression end carry out piecemeal according to the piecemeal rule with the present frame of desktop picture; And set up hierarchical index; According to hierarchical index; The modified-image piece that detects the relative image block buffer memory of image block of said present frame reaches not modified-image piece, the back label with said not modified-image piece of said modified-image piece compression is encapsulated obtain view data, and said view data is sent to the decompress(ion) end;
With reference to Fig. 2, Fig. 2 is the sketch map of compression end image processing framework described in the remote desktop image transfer method of the present invention; As shown in Figure 2, compression end at first according to certain piecemeal rule, is some image blocks with current desktop picture cutting, and sets up hierarchical index; Detect the modified-image piece and the modified-image piece not of the relative image block buffer memory of image block of present frame according to said hierarchical index.Said image block buffer memory is preserved the image block of recent appearance, and the image block that the N frame occurred before can tracing back to, said image block are buffered in compression end and the decompress(ion) end keeps synchronously; Said N value can be provided with as the case may be, and N is the positive integer greater than 1.Said modified-image piece reaches the not definition of modified-image piece: according to said hierarchical index, whether the image block that detects present frame can find in the image block buffer memory; If then define image block that present frame finds and be modified-image piece not in the image block buffer memory; If not, then defining the image block that present frame do not find in the image block buffer memory is the modified-image piece.The described modified-image piece of the following embodiment of the present invention reaches not, and the modified-image piece all adopts above-mentioned define method, follow-up will repeating no more.
Image block for changing will compress through compression module, and will compress afterwards that data and unchanged image block label encapsulate by certain format, form final dateout and be transferred to the decompress(ion) end.In a preferred embodiment, said piecemeal rule keeps synchronously and can switch according to concrete application scenarios at said compression end and said decompress(ion) end, and said piecemeal rule comprises and adopts Image Edge-Detection and edge compensation to carry out the random length image block; Said hierarchical index adopts the index entry of stratification that said image block is organized; Less image block represented in the low level index; A plurality of low level index will be integrated in the high-level index; Make high-level index can represent bigger image block, and the said index entry of top layer is represented whole said image block.
After step S02, said decompress(ion) termination are received said view data, divide in the said view data corresponding said modified-image piece and not behind the label of modified-image piece, said view data is reverted to corresponding image block according to said piecemeal formula area; Merge said image block, show said desktop picture.
With reference to Fig. 3, Fig. 3 is the framework of decompress(ion) end image processing described in a remote desktop image transfer method of the present invention sketch map; As shown in Figure 3, after the decompress(ion) termination is received the view data that compression end sends, at first distinguish the not image tag of modified-image piece and the packed data of modified-image piece according to above-mentioned piecemeal rule; Then, utilize this image tag and hierarchical index that unchanged image block is recovered, and utilize the relevant decompression module packed data that the modified-image piece is corresponding of decompress(ion) end to carry out decompress(ion); At last, merge not modified-image piece and modified-image piece, show final desktop picture.Simultaneously, hierarchical index and the piecemeal result with this use carries out buffer memory.
Present embodiment is through being some image blocks in compression end with the desktop picture cutting; And structure hierarchical index; The modified-image piece that utilizes hierarchical index to detect the relative image block buffer memory of image block of present frame reaches not modified-image piece; Said modified-image piece compression back encapsulated with the label of said not modified-image piece obtain view data, and said view data is sent to the decompress(ion) end; The decompress(ion) petiolarea divides the modified-image piece to reach not modified-image piece; And view data reverted to corresponding image block; Above-mentioned image block is merged the back show that desktop picture and whole process compression end and decompress(ion) end keep the method for piecemeal regular and synchronized; Have the beneficial effect of optimizing the transmission of remote desktop image, reduced data amount transmitted, improved the image compression rate.
With reference to Fig. 4, Fig. 4 is the one embodiment schematic flow sheet of compression end image processing described in the remote desktop image transfer method of the present invention; As shown in Figure 4, in the remote desktop image transfer method of the present invention, compression end is carried out image processing and may further comprise the steps:
Step S11, according to said piecemeal rule, be some said image blocks with the present frame cutting of said desktop picture;
According to piecemeal rule, be several image blocks with the present frame cutting of desktop picture.Wherein, the piecemeal technology can be that the grid splitting scheme also can be that random length is divided perhaps both mixing piecemeal schemes, and is not limited to specific piecemeal rule.With reference to Fig. 5, Fig. 5 is image block one an embodiment window sketch map in the remote desktop image transfer method of the present invention; Be depicted as like Fig. 5 a and adopt the grid splitting scheme that the present frame of desktop picture is carried out piecemeal, be depicted as like Fig. 5 b and adopt the random length image block that the present frame of desktop picture is carried out piecemeal.The described piecemeal rule of the embodiment of the invention comprises the image block technology to the Table-top type window body characteristics.The image block technology of employing Table-top type window body characteristics is carried out the image block processed steps and is: adopt technique of image edge detection, extract the forms edge; The employing straight-line detection is technological, detects the roughly framework of forms; Utilize the compensation technique at edge, repair the discontinuous forms edge that causes because of few part edge disappearance; Described Image Edge-Detection is a kind of Feature Extraction Technology of image, can detect to change tangible point in the image, can be according to changing the foundation of significantly putting as image segmentation in detected this image.Straight-line detection is a kind of technology of recognition image cathetus.Combining image rim detection and straight-line detection technology are discerned forms, and as the foundation of image block, mainly are the most rectangular forms of forms of considering computer graphic user interface.Can detect current forms that changing (like the user just at the input frame of input character) and static not variation forms more accurately based on the piecemeal rule of the piecemeal of forms characteristic technology, thereby acquisition does not better change the segment testing result.
Step S12, generate finger image, and set up the hierarchical index of said image block according to said image block;
Generate finger image according to above-mentioned image block, finger image has multiple use, such as the memory location and the checking image piece of positioning image piece no change etc. is arranged.Image block to being partitioned into is set up hierarchical index, and last layer index will be represented the more images piece than lower floor index, and the monoblock image will be represented in the index of final top layer.The effect of hierarchical index is please with reference to Fig. 6, and Fig. 6 is the one embodiment window sketch map of desktop picture hierarchical index described in the remote desktop image transfer method of the present invention; As shown in Figure 6, hierarchical index adopts the index entry of stratification that said image block is organized, the index entry level represent the ascending of said image block from low to high respectively; The index entry of low level is represented less image block, and the index entry of a plurality of low levels will be integrated in the high-level index, makes high-level index entry can represent bigger image block, and the index entry of final top layer will be represented the entire image piece.
Step S13, utilize said finger image and hierarchical index, begin successively to search for and judge whether said image block can find in said image block buffer memory by the top layer index; If not, then said image block is the modified-image piece, execution in step S14; If then said image block is modified-image piece not, execution in step S15;
Step S14, said modified-image piece is compressed, obtain packed data;
The image tag of step S15, the said not modified-image piece of record;
Utilize image block and hierarchical index technology, begin successively to search for, judge whether the image block of the present frame of search can find in said image block buffer memory by the top layer index.If the image block of search can not find in the image block buffer memory, explain that this image block is the modified-image piece, then this modified-image piece is compressed, obtain packed data; If the image block of search can find, explain that this image block is modified-image piece not, then writes down the image tag of said not modified-image piece in the image block buffer memory.Said image tag is the unique identification of said image block, the respectively corresponding pictures different label of each image block.
The example of change detected image block such as Fig. 7 and shown in Figure 8, Fig. 7 discern the image block one example structure sketch map that changes in the remote desktop image transfer method of the present invention; Fig. 8 is the one example structure sketch map of hierarchical index described in the remote desktop image transfer method of the present invention; Like Fig. 7 and shown in Figure 8, the image block that changes is represented with the black image piece, the image block of white image piece for not changing.Particularly; In a preferred embodiment; As shown in Figure 8; The modified-image piece of finding is " 1-1 ", " 1-2 ", " 1-3 ", " 2-3 ", " 2-4 ", and unchanged image block is " 1-4 " and " 2-2 ", and therefore the data of transmission are: image block " 1-4 " and " 2-2 " label in the image block buffer memory and the modified-image piece after overcompression.Along with the data volume scale increases, it will be more obvious that this programme adopts the high compression rate advantage of hierarchical index.
Step S16, encapsulation said packed data and said image tag obtain the said view data after the encapsulation and said view data are sent to said decompress(ion) end.
After through compression algorithm the image block that changes being compressed, encapsulate with unchanged image block label and to obtain total view data, this view data is exported to the decompress(ion) end.
Present embodiment is some image blocks through utilize the piecemeal rule in compression end with the desktop picture cutting; The hierarchical index that utilize to make up detects the modified-image piece of present frame and modified-image piece not; And image block carried out sending to after the handled method of decompress(ion) end, the beneficial effect with obvious minimizing volume of transmitted data.
With reference to Fig. 9, Fig. 9 is decompress(ion) end image processing one an embodiment schematic flow sheet in the remote desktop image transfer method of the present invention; As shown in Figure 9, decompress(ion) end image processing may further comprise the steps in the remote desktop image transfer method of the present invention:
After the said view data that step S21, the said compression end of reception are sent, divide said packed data and said image tag according to said piecemeal formula area;
The piecemeal rule that is adopted at the decompress(ion) end is consistent with the piecemeal rule of compression end, and in remote desktop image transfer method of the present invention, the piecemeal rule keeps synchronously at decompress(ion) end and compression end; In order to make the piecemeal of the clear and definite current use of decompress(ion) end regular, compression end is transferred to the decompress(ion) end with the head that the corresponding label of current piecemeal rule is placed on packed data.The decompress(ion) termination is utilized packed data and image tag in current piecemeal result and the hierarchical index differentiate between images data after receiving the view data of compression end transmission.
Step S22, recover said not modified-image piece, and the said packed data of decompress(ion) recovers said modified-image piece according to said hierarchical index and said image tag;
According to hierarchical index and image tag, the view data of not modified-image piece corresponding in the view data is reverted to not modified-image piece, the packed data in the view data is reverted to corresponding modified-image piece.Because the piecemeal of decompress(ion) end rule and hierarchical index and compression end keep synchronously, therefore, identical piecemeal rule must be consistent to the piecemeal result of phase diagram picture frame, also is correct certainly according to identical piecemeal rule image restored piece then.
Step S23, the said modified-image piece of merging reach not modified-image piece, show said desktop picture, simultaneously said piecemeal result of buffer memory and said hierarchical index.
With the modified-image piece and not the modified-image piece merge, and show at the desktop picture of user side with remote desktop transmission; Simultaneously, this piecemeal result and hierarchical index are carried out buffer memory, as the reference of under same scene, carrying out the transmission of remote desktop image next time.The piecemeal of next frame image will be continued to use piecemeal result and the hierarchical index that has obtained, and be replaced until the piecemeal rule.
Present embodiment divides the modified-image piece to reach not modified-image piece through the decompress(ion) petiolarea; And view data reverted to corresponding image block; Above-mentioned image block is merged the back show that desktop picture and whole process compression end and decompress(ion) end keep the method for piecemeal regular and synchronized; Have the beneficial effect that correctly, intactly recovers the remote desktop image, improved systematic function, promoted user experience.
With reference to Figure 10, Figure 10 is that the rule of piecemeal described in the remote desktop image transfer method of the present invention is switched an embodiment schematic flow sheet according to concrete application scenarios; Shown in figure 10, in the remote desktop image transfer method of the present invention, the regular switching according to concrete application scenarios may further comprise the steps piecemeal:
Step S31, utilize the said piecemeal result and the hierarchical index of buffer memory, detect the modified-image piece of the relative image block buffer memory of said present frame and modified-image piece not, and testing result is transmitted;
Different piecemeal rules adapt to no application scenarios, and remote desktop image transfer method of the present invention can carry out the switching of piecemeal rule according to different application scenes; Adopt compression end and decompress(ion) end both-end synchronization mechanism simultaneously, make both-end that consistent hierarchical index arranged, guarantee that the decompress(ion) end can correctly recover image block.Utilize the piecemeal result of buffer memory and the modified-image piece of the relative image block buffer memory of hierarchical index detection present frame to reach not modified-image piece, and testing result is transferred to next flow process of compression end.
Step S32, judge that remote desktop connects and whether stop; If then whole transmission course finishes; If not, execution in step S33 then;
Step S33, collection present image information also judge whether current scene satisfies piecemeal rule switching condition; If, execution in step S34 then; If not, execution in step S35 then;
Step S34, according to said present image information, switch to new piecemeal rule;
Step S35, the current piecemeal rule of maintenance;
Before carrying out the judgement whether the piecemeal rule need switch, need guarantee that remote desktop still connects keeping.Stop if remote desktop connects, then whole transmission course finishes; If the remote desktop connection is then collected present image information still continuing, and judge whether current scene satisfies the switching condition of piecemeal rule; Said switching condition can be that maximum or the network delay that CPU (Central Processing Unit, the central processing unit) occupation rate of compression effectiveness fall flat, equipment has reached preset occupation rate exceeded preset delay maximum etc.If current scene satisfies piecemeal rule switching condition,, current piecemeal rule is switched to suitable new piecemeal rule then according to present image information.If current scene do not satisfy the piecemeal rule, the piecemeal rule before promptly still is applicable to the current application scene, then continues to use current piecemeal rule, preserves current piecemeal result and hierarchical index; Because it is very considerable carrying out the computing cost that the branch block operations brought continually.
Step S36, utilize said new piecemeal rule that said present frame is carried out piecemeal, and replace existing said piecemeal result and hierarchical index.
After current scene satisfied piecemeal rule switching condition and switches to new piecemeal rule, the new piecemeal rule of compression end utilization was carried out piecemeal to present frame, and replaces existing piecemeal result and hierarchical index.After compression end is switched the piecemeal rule, need let decompress(ion) end and its piecemeal rule keep synchronously.For the piecemeal rule that the decompress(ion) end clearly need be switched, in a preferred embodiment, compression end is transferred to the decompress(ion) end with the head that the corresponding label of current new piecemeal rule is placed on packed data.
Present embodiment utilizes new piecemeal rule that present frame is carried out piecemeal through after satisfying piecemeal rule switching condition in current scene and switching to new piecemeal rule; When not satisfying piecemeal rule switching condition, continue to adopt the method for former piecemeal rule, have the beneficial effect that intelligently adopts different piecemeal rules according to the different application scene, greatly saved computing cost simultaneously.
With reference to Figure 11, Figure 11 is remote desktop image delivering system one an example structure sketch map of the present invention; Shown in figure 11, remote desktop image delivering system of the present invention comprises:
Compression end 01; Be used for the present frame of desktop picture being carried out piecemeal according to said piecemeal rule; And set up hierarchical index, according to hierarchical index, the modified-image piece that detects the relative image block buffer memory of image block of said present frame reaches not modified-image piece; Said modified-image piece compression back encapsulated with the label of said not modified-image piece obtain view data, and said view data is sent to the decompress(ion) end;
With reference to the 01 image processing framework sketch map of compression end described in Fig. 2 remote desktop image transfer method of the present invention, compression end 01 at first according to certain piecemeal rule, is some image blocks with current desktop picture cutting, and sets up hierarchical index; Detect the modified-image piece of present frame and modified-image piece not according to said hierarchical index.Image block for changing will compress through compression module, and will compress afterwards that data and unchanged image block label encapsulate by certain format, form final dateout and be transferred to decompress(ion) end 02.In a preferred embodiment, said piecemeal rule keeps synchronously and can switch according to concrete application scenarios at said compression end 01 and said decompress(ion) end 02, and said piecemeal rule comprises and adopts Image Edge-Detection and edge compensation to carry out the random length image block; Said hierarchical index adopts the index entry of stratification that said image block is organized; Less image block represented in the low level index; A plurality of low level index will be integrated in the high-level index; Make high-level index can represent bigger image block, and the said index entry of top layer is represented whole said image block.
Decompress(ion) end 02, be used to receive said view data after, according to said piecemeal rule, distinguish said modified-image piece corresponding in the said view data and not behind the label of modified-image piece, said view data reverted to corresponding image block; Merge said image block, show said desktop picture.
With reference to the 02 image processing framework sketch map of decompress(ion) end described in Fig. 3 remote desktop image transfer method of the present invention; After decompress(ion) end 02 receives the view data that compression end 01 sends, at first distinguish the not image tag of modified-image piece and the packed data of modified-image piece according to above-mentioned piecemeal rule; Then, utilize this image tag and hierarchical index that unchanged image block is recovered, and utilize the relevant decompression module packed data that the modified-image piece is corresponding of decompress(ion) end 02 to carry out decompress(ion); At last, merge not modified-image piece and modified-image piece, show final desktop picture.Simultaneously, hierarchical index and the piecemeal result with this use carries out buffer memory.
Present embodiment is through being some image blocks in compression end with the desktop picture cutting, and whether the relative image block buffer memory of detection present frame changes and image block is carried out sending to the decompress(ion) end after the handled; The decompress(ion) petiolarea divides the modified-image piece to reach not modified-image piece; And view data reverted to corresponding image block; Above-mentioned image block is merged the back show that desktop picture and whole process compression end and decompress(ion) end keep the piecemeal regular and synchronized; Have the beneficial effect of optimizing the transmission of remote desktop image, reduced data amount transmitted, improved the image compression rate.
With reference to Figure 12, Figure 12 is the first example structure sketch map of compression end described in the remote desktop image delivering system of the present invention; Present embodiment only further describes compression end 01, and related other modules of remote desktop image delivering system of the present invention repeat no more at this please with reference to the specific descriptions of the foregoing description.
Shown in figure 12, in the remote desktop image delivering system of the present invention, compression end 01 specifically comprises:
Image block module 011 is used for according to said piecemeal rule, is some image blocks with the present frame cutting of said desktop picture;
According to the piecemeal rule, image block module 011 is several image blocks with the present frame cutting of desktop picture.Wherein, the piecemeal technology can be that the grid splitting scheme also can be that random length is divided perhaps both mixing piecemeal schemes, and is not limited to specific piecemeal rule.With reference to image block one embodiment window sketch map in Fig. 5 remote desktop image transfer method of the present invention; Shown in Fig. 5 a, image block module 011 adopts the grid splitting scheme that the present frame of desktop picture is carried out piecemeal, and shown in Fig. 5 b, image block module 011 adopts the random length image block that the present frame of desktop picture is carried out piecemeal.The described piecemeal rule of the embodiment of the invention comprises the image block technology to the Table-top type window body characteristics.With reference to obtaining forms edge one embodiment window sketch map through Image Edge-Detection and straight-line detection in Fig. 6 remote desktop image transfer method of the present invention; Image block module 011 adopts the image block technology of Table-top type window body characteristics to carry out the image block processed steps: adopt technique of image edge detection, extract the forms edge; The employing straight-line detection is technological, detects the roughly framework of forms; Utilize the compensation technique at edge, repair the discontinuous forms edge that causes because of few part edge disappearance; Image block module 011 please obtains piecemeal effect one embodiment window sketch map with reference to passing through edge compensation in Fig. 7 remote desktop image transfer method of the present invention through the piecemeal effect that edge compensation obtains.Image block module 011 combining image rim detection and straight-line detection technology are discerned forms, and as the foundation of image block, mainly are the most rectangular forms of forms of considering computer graphic user interface.Can detect current forms that changing (like the user just at the input frame of input character) and static not variation forms more accurately based on the piecemeal rule of the piecemeal of forms characteristic technology, thereby acquisition does not better change the segment testing result.
Hierarchical index is set up module 012, is used for generating finger image according to said image block, and sets up the hierarchical index of said image block;
Hierarchical index is set up the image block that module 012 obtains according to image block module 011 and is generated finger image, and finger image has multiple use, such as the memory location and the checking image piece of positioning image piece no change etc. is arranged.Hierarchical index is set up 012 pair of image block that is partitioned into of module and is set up hierarchical index, and last layer index will be represented the more images piece than lower floor index, and the monoblock image will be represented in the index of final top layer.The effect of hierarchical index is please with reference to the one embodiment window sketch map of desktop picture hierarchical index described in Fig. 6 remote desktop image transfer method of the present invention; Hierarchical index adopts the index entry of stratification that said image block is organized, the index entry level represent the ascending of said image block from low to high respectively; The index entry of low level is represented less image block, and the index entry of a plurality of low levels will be integrated in the high-level index, makes high-level index entry can represent bigger image block, and the index entry of final top layer will be represented the entire image piece.
Image change identification module 013 is used to utilize said finger image and hierarchical index, is begun successively to search for and judged whether said image block can find in said image block buffer memory by the top layer index; If then said image block is modified-image piece not; If not, then said image block is the modified-image piece;
Image change identification module 013 utilizes image block and hierarchical index technology, is begun successively to search for by the top layer index, judges whether whether the image block that searches can find in said image block buffer memory; If can in the image block buffer memory, find, explain that then this image block is modified-image piece not; If can not in the image block buffer memory, find, explain that then this image block is the modified-image piece.The example of image change identification module 013 change detected image block such as Fig. 7 and shown in Figure 8, the image block that changes represent with the black image piece, the image block of white image piece for not changing.Particularly; In a preferred embodiment; As shown in Figure 8; The modified-image piece of finding is " 1-1 ", " 1-2 ", " 1-3 ", " 2-3 ", " 2-4 ", and unchanged image block is " 1-4 " and " 2-2 ", and therefore the data of transmission are: the label of image block " 1-4 " and " 2-2 " correspondence in the image block buffer memory and the modified-image piece after overcompression.Along with the data volume scale increases, it will be more obvious that this programme adopts the high compression rate advantage of hierarchical index.
Image processing module 014 is used for when said image block is the modified-image piece, and said modified-image piece is compressed, and obtains packed data; When not sending out the modified-image piece, write down the image tag of said not modified-image piece at said image block;
If image change identification module 013 detects the modified-image piece, then image processing module 014 compresses this modified-image piece, obtains packed data; If image change identification module 013 detects not modified-image piece, then image processing module 014 writes down the image tag of said not modified-image piece.Said image tag is the unique identification of said image block, the respectively corresponding pictures different label of each image block.
View data output module 015 is used to encapsulate said packed data and said image tag, obtains the said view data after the encapsulation and said view data sent to said decompress(ion) end.
The image tag of the packed data that view data output module 015 obtains image processing module 014 through lossless compression algorithm and the not modified-image piece of record encapsulates together, obtains total view data, and this view data is exported to decompress(ion) end 02.
Present embodiment is some image blocks through utilize the piecemeal rule in compression end with the desktop picture cutting, and makes up hierarchical index, utilizes hierarchical index to detect the situation of the image block of present frame at the image block buffer memory, for modified-image piece not, need only transmit its label; For the modified-image piece, send to the decompress(ion) end after then it being compressed the back and the label of modified-image piece does not encapsulate through compression algorithm, have the beneficial effect of obvious minimizing volume of transmitted data.
With reference to Figure 13, Figure 13 is the one example structure sketch map of decompress(ion) end described in the remote desktop image delivering system of the present invention; Present embodiment only further describes decompress(ion) end 02, and related other modules of remote desktop image delivering system of the present invention repeat no more at this please with reference to the specific descriptions of related embodiment.
Shown in figure 13, in the remote desktop image delivering system of the present invention, decompress(ion) end 02 specifically comprises:
Image area sub-module 021 after being used to receive the said view data of said compression end transmission, divides said packed data and said image tag according to said piecemeal formula area;
The piecemeal rule that is adopted at decompress(ion) end 02 is consistent with the piecemeal rule of compression end 01, and in remote desktop image transfer method of the present invention, the piecemeal rule keeps synchronously in decompress(ion) end 02 and compression end 01; In order to make the piecemeal of decompress(ion) end 02 clear and definite current use regular, compression end 01 is transferred to the decompress(ion) end with the head that the corresponding label of current piecemeal rule is placed on packed data.The image area sub-module 021 of decompress(ion) end 02 utilizes packed data and image tag in current piecemeal result and the hierarchical index differentiate between images data after receiving the view data of compression end 01 transmission.
Image-restoration module 022 be used for recovering said not modified-image piece according to said hierarchical index and said image tag, and the said packed data of decompress(ion) is recovered said modified-image piece;
According to hierarchical index and image tag, image-restoration module 022 reverts to not modified-image piece with the view data of not modified-image piece corresponding in the view data, and the packed data in the view data is reverted to corresponding modified-image piece.Because the piecemeal of decompress(ion) end 02 rule and hierarchical index and compression end 01 keep synchronously; Therefore; Identical piecemeal rule must be consistent to the piecemeal result of phase diagram picture frame, and then image-restoration module 022 also is correct according to identical piecemeal rule image restored piece certainly.
Image display 023 is used to merge said modified-image piece and reaches not modified-image piece, shows said desktop picture, simultaneously said piecemeal result of buffer memory and said hierarchical index.
Image display 023 with the modified-image piece and not the modified-image piece merge, and show at the desktop picture of user side with remote desktop transmission; Simultaneously, image display 023 is carried out buffer memory with this piecemeal result and hierarchical index, as the reference of under same scene, carrying out the transmission of remote desktop image next time.The piecemeal of next frame image will be continued to use piecemeal result and the hierarchical index that has obtained, and be replaced until the piecemeal rule.
Present embodiment divides the modified-image piece to reach not modified-image piece through the decompress(ion) petiolarea; And view data reverted to corresponding image block; Above-mentioned image block is merged the back show that desktop picture and whole process compression end and decompress(ion) end keep the piecemeal regular and synchronized; Have the beneficial effect that correctly, intactly recovers the remote desktop image, improved systematic function, promoted user experience.
With reference to Figure 14, Figure 14 is the second example structure sketch map of compression end described in the remote desktop image delivering system of the present invention; The difference of present embodiment and said compression end first embodiment is only to have increased the piecemeal rule module 016 is set; Present embodiment only is provided with module 016 to the piecemeal rule and specifically describes, and related other modules of remote desktop image delivering system of the present invention repeat no more at this please with reference to the specific descriptions of related embodiment.
Shown in figure 14, in the remote desktop image delivering system of the present invention, compression end 01 also comprises:
The piecemeal rule is provided with module 016, is used for keeping said piecemeal regular and synchronized and can switching said piecemeal rule according to concrete application scenarios in said compression end and said decompress(ion) end; Said piecemeal rule comprises that employing Image Edge-Detection and edge compensation carry out the random length image block.
Different piecemeal rules adapt to no application scenarios, and the piecemeal rule is provided with module 016 is carried out the piecemeal rule according to different application scenes switching; Adopt compression end 01 and decompress(ion) end 02 both-end synchronization mechanism simultaneously, make both-end that consistent hierarchical index arranged, guarantee that decompress(ion) end 02 can correctly recover image block.
With reference to piecemeal rule described in Figure 15 remote desktop image delivering system of the present invention module one example structure sketch map is set, piecemeal rule of the present invention is provided with module 016 and specifically comprises:
Image block detecting unit 161 is used to utilize the said piecemeal result and the hierarchical index of buffer memory, detects the modified-image piece of the relative image block buffer memory of said present frame and modified-image piece not, and testing result is transferred to said compression end;
Image block detecting unit 161 utilizes the piecemeal result of buffer memory and the modified-image piece of the relative image block buffer memory of hierarchical index detection present frame to reach not modified-image piece, and testing result is transferred to image information collector unit 162.
Image information collector unit 162 is used to judge whether the remote desktop connection stops, and when said remote desktop connection does not stop, collects present image information and judge also whether current scene satisfies piecemeal rule switching condition;
Image information collector unit 162 need guarantee that remote desktop still connected keeping before carrying out the judgement whether the piecemeal rule need switch.Stop if remote desktop connects, then whole transmission course finishes; Continuing if remote desktop connects still, then image information collector unit 162 is collected present image information, and judges whether current scene satisfies the switching condition of piecemeal rule; Said switching condition can be that maximum or the network delay that the CPU occupation rate of compression effectiveness fall flat, equipment has reached preset occupation rate exceeded preset delay maximum etc.
Piecemeal rule switch unit 163 is used for when current scene satisfies piecemeal rule switching condition, according to said present image information, switches to new piecemeal rule;
If the current scene of judging image information collector unit 162 satisfies piecemeal rule switching condition, then piecemeal rule switch unit 163 switches to suitable new piecemeal rule according to present image information with current piecemeal rule.If current scene does not satisfy the piecemeal rule; Piecemeal rule promptly still is applicable to the current application scene; Then piecemeal rule switch unit 163 does not carry out the switching of piecemeal rule, and compression end 01 continues to use current piecemeal rule, and preserves current piecemeal result and hierarchical index; Because it is very considerable carrying out the computing cost that the branch block operations brought continually.
Hierarchical index replacement unit 164 is used to utilize said new piecemeal rule that said present frame is carried out piecemeal, and replaces existing said piecemeal result and hierarchical index.
After piecemeal rule switch unit 163 judged that current scene satisfies piecemeal rule switching condition and switches to new piecemeal rule, hierarchical index replacement unit 164 utilized new piecemeal rule that present frame is carried out piecemeal, and replaces existing piecemeal result and hierarchical index.
After compression end 01 utilizes the piecemeal rule that module 016 switching piecemeal rule is set, need let decompress(ion) end 02 and its piecemeal rule keep synchronously.For the piecemeal rule that decompress(ion) end 02 clearly need be switched, in a preferred embodiment, compression end 01 is transferred to decompress(ion) end 02 with the head that the corresponding label of current new piecemeal rule is placed on packed data.
Present embodiment utilizes new piecemeal rule that present frame is carried out piecemeal through after satisfying piecemeal rule switching condition in current scene and switching to new piecemeal rule; When not satisfying piecemeal rule switching condition, continue to adopt former piecemeal rule, have the beneficial effect that intelligently adopts different piecemeal rules according to the different application scene, greatly saved computing cost simultaneously.
The above is merely the preferred embodiments of the present invention; Be not so limit its claim; Every equivalent structure or equivalent flow process conversion that utilizes specification of the present invention and accompanying drawing content to be done; Directly or indirectly be used in other relevant technical fields, all in like manner be included in the scope of patent protection of the present invention.