CN1635466A - Remote server host computer frame monitoring system and method thereof - Google Patents

Remote server host computer frame monitoring system and method thereof Download PDF

Info

Publication number
CN1635466A
CN1635466A CN 200310124390 CN200310124390A CN1635466A CN 1635466 A CN1635466 A CN 1635466A CN 200310124390 CN200310124390 CN 200310124390 CN 200310124390 A CN200310124390 A CN 200310124390A CN 1635466 A CN1635466 A CN 1635466A
Authority
CN
China
Prior art keywords
xor
image
picture
pixel
screen picture
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Granted
Application number
CN 200310124390
Other languages
Chinese (zh)
Other versions
CN1303518C (en
Inventor
刘文涵
陈玄同
李翼嵩
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
Inventec Corp
Original Assignee
Inventec Corp
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Inventec Corp filed Critical Inventec Corp
Priority to CNB2003101243905A priority Critical patent/CN1303518C/en
Publication of CN1635466A publication Critical patent/CN1635466A/en
Application granted granted Critical
Publication of CN1303518C publication Critical patent/CN1303518C/en
Expired - Fee Related legal-status Critical Current
Anticipated expiration legal-status Critical

Links

Abstract

This invention relates to remote servo host picture monitoring system and its method, which collects and sends the screen images of the servo to eh console and processes the XOR computation on the caught images and sends them after compression. The console receives the images and displays them after decompression and total XOR computation to allow the servo screen image real time send to the console.

Description

Remote servo host picture monitoring system and method thereof
Technical field
The present invention relates to image processing system and method in a kind of Long-distance Control, particularly a kind of remote servo host picture monitoring system and method thereof.
Background technology
Remote servo host picture monitoring (Console Redirection) can be apparent in the screen-picture of server end on the computer screen of distance supervisor, allows the supvr as in the server previous action, makes things convenient for the supvr to carry out the work of telemanagement.
The monitoring of employing remote servo host picture, the keeper just can carry out telemanagement to server.Control desk (Console) is redirected and need not to be equipped with independent display and keyboard into every station server.This advantage is calculated in the installation (as the HPCC device) particularly useful in high density, because the keeper can be at many remote consoles of a monitoring position.Common host picture monitoring (ConsoleRedirection) need be sent to the control you in real time with the screen picture of server end, to guarantee the image unanimity on both sides.Because the screen picture of server end changes, therefore good remote servo host picture monitoring will guarantee to control the screen picture that you can obtain server end as soon as possible, reduce the distortion of image simultaneously as far as possible.
The key of remote servo host picture monitoring is the acquisition of screen picture and the compression and the decompression of screen picture data, often acquisition is whole on image acquisition for known tele-control system, perhaps utilizes the event response zone of operating system (as Windows) to capture.Because image is a continually varying, above-mentioned two kinds of methods all can collect repeated content between two width of cloth figure, though it is relatively good to utilize the event response zone of operating system to intercept, but still can collect repeated content, and can be subjected to the restriction of operating system, do not possess versatility.Some other image collection technology, as MEPG4, but it is long to gather the aftertreatment time, and has distortion, therefore can't satisfy real-time and undistorted requirement.Compression and decompression this point for the screen picture data, it is main that what pursue is higher compressibility and compression and decompression speed faster, known remote servo host picture monitoring often by choose certain compression and decompression algorithm such as RLE, JPEG waits and realizes.The compressibility of RLE algorithm is smaller, and improved RLE method is more time-consuming again, and the compression of JPEG method exists image fault more serious, is not suitable for literal, figure that computer system shows.
Therefore how guaranteeing to control the image that you can obtain server end as soon as possible, reduce the distortion of image simultaneously as far as possible, thereby satisfy real-time and undistorted requirement, is problem demanding prompt solution in the current tele-control system.
Summary of the invention
In view of this, the present invention is for addressing the above problem a kind of remote servo host picture monitoring system and the method thereof of proposing, main purpose is: satisfies screen picture in the remote servo host picture monitor procedure and shows real-time, quick, undistorted requirement, thus convenient remote monitoring.
Institute thinks and achieves the above object, the invention provides a kind of remote servo host picture monitoring system, be sent to this control you in real time in order to screen picture with this server end, comprise: a server end, in order to respond the request of this control you, and gather and its screen picture of transmission, and one control you, mainly be in order to send the request of obtaining its screen picture to this service end, and the screen picture that will come from this service end transmission shows in real time in this locality, wherein this server end comprises: the screen acquisition module, in order to this screen picture of acquisition current server end; The XOR module, it carries out complete XOR in order to this screen picture piece image preceding with it that will collect; Compression module, it is in order to capable interior, in the ranks and oblique compression with the image behind this XOR; Sending module is put into transmit queue in order to the image after will compressing and is sent; Wherein this control you comprises: receiver module, in order to receive the view data that this server end sends; This view data that decompression module, decompress(ion) receive; The XOR module is carried out complete XOR with the image behind this decompress(ion) and this ground piece image; Display module is in order to show the image behind this XOR.
In addition, the invention provides a kind of remote servo host picture method for supervising, be sent to this control you in real time, at first control you and send the request of obtaining its screen picture to this service end in order to screen picture with this server end; Server end responds the request of this control you then, and gathers and its screen picture of transmission, comprising: a screen picture that captures this server end; This screen picture piece image preceding with it carried out complete XOR (XOR) computing; Image behind this XOR is capable interior, in the ranks and oblique compression; And the image after will compressing is put into transmission row is sent; Then this control desk termination is received from this service end and is sent and next screen picture, and it is shown in real time in this locality, comprising: this image of reception server end; This image that receives decompresses; With the image after this decompression and on it piece image carry out complete XOR; And show image behind this XOR.
According to remote servo host picture monitoring system proposed by the invention and method thereof, can only collect the content of variation, adopt the compression method can be below the compressibility to 10%, and do not have distortion most computer screen content (mainly being figure and literal).Simultaneously, adopt XOR only to need a clock period just can finish, so processing speed is than very fast.
Relevant detailed content of the present invention and technology, conjunction with figs. is described as follows now.
Description of drawings
Fig. 1 is the module rack composition of remote servo host picture monitoring system proposed by the invention;
Fig. 2 is the main process figure of remote servo host picture method for supervising proposed by the invention;
Fig. 3 is that server end of the present invention is gathered and the process flow diagram that sends its screen picture;
Fig. 4 is that control desk of the present invention receives the also process flow diagram of display image;
Fig. 5 is Long-distance Control realization flow figure;
Fig. 6 is an image acquisition synoptic diagram of the present invention;
Fig. 7 is a compression of images synoptic diagram of the present invention;
Fig. 8 is the present invention shows Windows server end screen by window application a synoptic diagram; And
Fig. 9 is the present invention shows Windows Sever end screen by IE a synoptic diagram.
Wherein, drawing reference numeral is described as follows:
110 server ends
111 screen acquisition modules
112 XOR modules
113 compression modules
114 sending modules
120 control yous
121 receiver modules
122 decompression module
123 XOR modules
124 display modules
Step 210 control you sends the request of obtaining its screen picture to service end
Step 220 server end is responded the request of control you, and gathers and send its screen picture
Step 230 control desk termination is received from service end and is sent and next screen picture, and it is shown in real time in this locality
Step 221 acquisition server end one screen picture
Step 222 is carried out complete XOR with this screen picture piece image preceding with it
The image of step 223 after with this XOR is capable interior, in the ranks and oblique compression
Image after step 224 will be compressed is put into transmission row is sent
The image of step 231 reception server end
The image that step 232 decompresses and receives
Image after step 233 will decompress and on it piece image carry out the complete XOR of secondary
Step 234 shows the image behind the XOR
Step 510 server end image acquisition
Step 520 server end compression of images
Step 530 Network Transmission
Step 540 control you decompresses
Step 550 control you image shows
610 server end images acquired
620 server end image buffers
630 control you image buffers
640 control you images show
All pixels in the step 710 traversing graph picture
Step 720 judges whether to be first row
Step 731 is done compression in the row
Step 741 is done compression in the ranks
Step 742 is done oblique compression in the ranks
Embodiment
The present invention is a kind of remote servo host picture monitoring system and method thereof, at first sees also Fig. 1, and this figure is the module rack composition of remote servo host picture monitoring system proposed by the invention.Wherein, server end 110 is in order to responding the request of this control you, and gathers and its screen picture of transmission, comprises screen acquisition module 111, XOR module 112, compression module 113 and sending module 114.Below the control desk end is elaborated:
(1) the screen acquisition module 111, in order to this screen picture of acquisition current server end;
(2) the XOR module 112, and it carries out complete XOR in order to this screen picture piece image preceding with it that will collect, and described complete XOR carries out XOR with all preceding with it piece image same position of each pixel pixel of present image;
(3) compression module 113, and it is in order to capable interior, in the ranks and oblique compression with the image behind this XOR; And
(4) sending module 114, put into transmission in order to the image after will compressing row are sent.
Control you 120, mainly be in order to send the request of obtaining its screen picture to this service end, and the screen picture that will come from this service end transmission shows in real time in this locality, comprise receiver module 121, decompression module 122, XOR module 123 and display module 124 are elaborated to it respectively below:
(1) receiver module 121, in order to receive the view data that this server end sends;
(2) decompression module 122, this view data that decompress(ion) receives;
(3) the XOR module 123, and the image behind this decompress(ion) and this ground piece image are carried out complete XOR; And
(4) display module 124, in order to the image behind this XOR is shown.
Then, by Fig. 2 flow process of the present invention is described, this figure is the main process figure of remote servo host picture method for supervising proposed by the invention, be described as follows: at first control you and send the request (step 210) of obtaining its screen picture to this service end, server end responds the request of this control you then, and gather and its screen picture (step 220) of transmission, the control desk termination is received from this service end and is sent and next screen picture, and it is shown (step 230) in real time in this locality.
See also Fig. 3, wherein above-mentioned server end collection further comprises a screen picture (step 221) that captures this server end with the process that sends its screen picture, this screen picture piece image preceding with it carried out complete XOR (step 222), image behind this XOR is capable interior, in the ranks and oblique compression (step 223), the image after this compression is put into transmission row are sent (step 224).
See also Fig. 4, wherein the process of control desk reception and display image more comprises this image (step 231) of reception server end, this image (step 232) that receives decompresses, with the image after this decompression and on it piece image carry out complete XOR (step 233), show the image (step 234) behind this XOR.
Usually the host picture monitoring need be sent to the control you in real time with the image of server end, guarantees both sides image unanimity, because the image of server end changes, therefore will guarantee to control the image that you can obtain server end as soon as possible.This process sees also Fig. 5, this figure is the process flow diagram of Long-distance Control, as shown in the figure, server end is images acquired (step 510) at first, image is compressed (step 520) at server end then, through (step 530) after the Network Transmission, image decompresses (step 540) at the control you, at last the image that decompresses is shown (step 550).
Because the screen picture physical data amount that server end captured is bigger, if directly transmission then can cause taking problems such as the network bandwidth is excessive, real-time is poor, excessive occupied system resources, poor stability, therefore need after overcompression, just can send it to the control you, and the control you could correctly show screen picture after correspondingly also the screen picture data that receive will being decompressed.
See also Fig. 6, this figure is the synoptic diagram of image acquisition of the present invention.Comprise that four zones are respectively: server end images acquired 610, server end image buffer 620, control you image buffer 630, and control you image shows 640.As shown in the figure, first width of cloth image of the present invention is without any acquisition process, directly be put into server end image buffer 620, after overcompression by some transmission medium to control you, after the control desk termination is received view data, decompressed data shows in 640 at control you image to display it to image buffer 630 then.The later image of second width of cloth then all will carry out XOR completely by piece image preceding with it.With second width of cloth image is example, server end captures after second width of cloth image, itself and first width of cloth image are carried out XOR completely, and promptly the pixel that each pixel all will piece image same position preceding with it is carried out XOR, then the result behind the XOR is put into buffer zone.Because XOR has following characteristic:
1?XOR?1=0
0?XOR?0=0
1?XOR?0=1
100111011110101101?XOR?100111011110101101=0000000000000000
100111011110100000?XOR?100111011110101101=0000000000001101
Therefore, be 0 (black) behind the identical pixel XOR in two width of cloth images, behind the different pixel XORs a new value, like this, through behind the XOR, so long as the pixel of non-black is exactly the different parts of two width of cloth images.This XOR only needs a clock period just can finish, so processing speed is than very fast.
Image with the computing gained compresses then.Image can be realized very high data compression rate through after the XOR.Because generally speaking screen picture always a part but not whole screen change, after current screen image and a last screen picture carried out XOR, the gained screen bitmap not place value of changing unit is 0, and the place value of changing unit is 1, when the screen picture variation range hour, a large amount of place values of the screen picture bitmap that is then captured will be 0, compressibility is except that outside the Pass having with compression algorithm simultaneously, also relevant with data itself to be compressed, the part that color is identical during compression can be compressed to very little, therefore most of pixel for changing is compressed it like this and will be obtained more desirable compression effectiveness, thereby reduced transmission quantity.
Because bigger with adjacent position pixel equal probabilities, the pixel of normal picture 95% or more can be with identical with delegation or lastrow adjacent position pixel, thus the present invention utilize these characteristics go in and in the ranks compress.Compressibility can be controlled in 10%.See also Fig. 7, this figure is the synoptic diagram of compression process of the present invention.All pixels (step 710) in system's traversing graph picture judge that then whether current line is first row (step 720), if be first row, then does compression (step 731) in the row.Compression is that pixel consecutive identical in the delegation is compressed in the row, writes down the value of first pixel and continuous number.If not first row, judge then whether current pixel is identical with its previous pixel, if identical, then do compression (step 731) in the row; And then judge current pixel whether with directly over pixel identical, if identical then do compression (step 741) in the ranks, compression in the ranks only record continuously with directly over the identical number of pixel; Judge whether current pixel is identical with the oblique upper pixel, if identical then do oblique compression (step 742) in the ranks, the number identical with the oblique upper pixel continuously only write down in oblique in the ranks compression again.In addition, the traversal to pixel is carried out whole this screen picture in the past backward one by one in above-mentioned compression process.
Image through overcompression sends to the control you by network again, and the control you decompresses to it, and decompression is the inverse process of compression, and the image after the decompression can return to the result behind the server end XOR.Because XOR has reversibility, the image behind the XOR is carried out the XOR second time again after, will obtain original image again.The XOR principle that adopts is:
A?XOR?B=C
C?XOR?A=B
At the control you, obtain server end XOR result's image after, as long as again present image and local last piece image are carried out the XOR second time, just can obtain the latest image of server end.Again the image that obtains is shown at last.As shown in Figure 8, can use program control demonstration Windows Sever end by Windows, can also be by IE browser display Windows Sever end, as shown in Figure 9.
Though the present invention discloses as above with aforesaid preferred embodiment; yet they are not in order to limit the present invention; so any those of ordinary skill in the art; without departing from the spirit and scope of the present invention; when can doing a little change and retouching, so protection scope of the present invention is when looking appended being as the criterion that claim defined.

Claims (10)

1, a kind of remote servo host picture monitoring system is sent to this control you in real time in order to the screen picture with this server end, comprising:
One server end in order to responding the request of this control you, and is gathered and its screen picture of transmission, comprising:
One screen acquisition module is in order to this screen picture of acquisition current server end;
One XOR module, it carries out complete XOR in order to this screen picture piece image preceding with it that will collect;
One compression module, it is in order to capable interior, in the ranks and oblique compression with the image behind this XOR; And
One sending module is put into transmission in order to the image after will compressing row is sent; And
One control you in order to sending the request of obtaining its screen picture to this service end, and will send and the screen picture that comes shows in real time in this locality from this service end, comprise:
One receiver module is in order to receive the view data that this server end sends;
This view data that one decompression module, decompress(ion) receive;
One XOR module is carried out complete XOR with the image behind this decompress(ion) and this ground piece image; And
One display module is in order to show the image behind this XOR.
2, remote servo host picture monitoring system as claimed in claim 1, wherein said XOR module is not carried out XOR to this screen picture of first width of cloth.
3, remote servo host picture monitoring system as claimed in claim 1, wherein said complete XOR carries out XOR with all preceding with it piece image same position of each pixel pixel of present image.
4, remote servo host picture monitoring system as claimed in claim 1 to the traversal of pixel, is carried out whole this screen picture in the wherein said compression process in the past backward one by one.
5, consecutive identical pixel in this row is compressed in compression in the remote servo host picture monitoring system as claimed in claim 1, wherein said row, writes down its first pixel value and continuous number; Described packed record in the ranks continuously with directly over the identical number of pixel; Described oblique packed record in the ranks is the number identical with the oblique upper pixel continuously.
6, a kind of remote servo host picture method for supervising, in order to the screen picture of this server end real-time be sent to this control you, comprise the steps:
This control you sends the request of obtaining its screen picture to this service end;
This server end responds the request of this control you, and gathers and its screen picture of transmission, comprising:
Capture a screen picture of this server end;
This screen picture piece image preceding with it carried out complete XOR;
Image behind this XOR is capable interior, in the ranks and oblique compression; And
Image after this compression is put into transmission to be sent row; And
This control desk termination is received from this service end and is sent and next screen picture, and it is shown in real time in this locality, comprising:
This image of reception server end;
This image that receives decompresses;
With the image after this decompression and on it piece image carry out the complete XOR of secondary; And
Show the image behind this XOR.
7, remote servo host picture method for supervising as claimed in claim 6, wherein said step of carrying out complete XOR is not if this screen picture of first width of cloth is then done XOR.
8, remote servo host picture method for supervising as claimed in claim 6, wherein said complete XOR carries out XOR with all preceding with it piece image same position of each pixel pixel of present image.
9, remote servo host picture method for supervising as claimed in claim 6, the traversal to pixel in the wherein said compression process is carried out whole this screen picture in the past backward one by one.
10, consecutive identical pixel in this row is compressed in compression in the remote servo host picture method for supervising as claimed in claim 6, wherein said row, writes down its first pixel value and continuous number; Described packed record in the ranks continuously with directly over the identical number of pixel; Described oblique packed record in the ranks is the number identical with the oblique upper pixel continuously.
CNB2003101243905A 2003-12-30 2003-12-30 Remote server host computer frame monitoring system and method thereof Expired - Fee Related CN1303518C (en)

Priority Applications (1)

Application Number Priority Date Filing Date Title
CNB2003101243905A CN1303518C (en) 2003-12-30 2003-12-30 Remote server host computer frame monitoring system and method thereof

Applications Claiming Priority (1)

Application Number Priority Date Filing Date Title
CNB2003101243905A CN1303518C (en) 2003-12-30 2003-12-30 Remote server host computer frame monitoring system and method thereof

Publications (2)

Publication Number Publication Date
CN1635466A true CN1635466A (en) 2005-07-06
CN1303518C CN1303518C (en) 2007-03-07

Family

ID=34845002

Family Applications (1)

Application Number Title Priority Date Filing Date
CNB2003101243905A Expired - Fee Related CN1303518C (en) 2003-12-30 2003-12-30 Remote server host computer frame monitoring system and method thereof

Country Status (1)

Country Link
CN (1) CN1303518C (en)

Cited By (7)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN101384987B (en) * 2006-02-20 2012-05-23 皇家飞利浦电子股份有限公司 A method of deriving a graphical representation of domain-specific display objects on an external display
CN101651827B (en) * 2009-07-16 2012-06-13 上海交通大学 Code rate control method of screen coding
CN102664939A (en) * 2012-04-13 2012-09-12 江苏诚迈科技有限公司 Method and device for mobile terminal of screen mirror image
CN104202380A (en) * 2014-08-26 2014-12-10 四川亿信信用评估有限公司 Remote computer control method based on smartphone
CN104202381A (en) * 2014-08-26 2014-12-10 四川亿信信用评估有限公司 Remote computer control system based on smartphone
CN105100639A (en) * 2015-07-20 2015-11-25 京东方科技集团股份有限公司 Display method and display apparatus
CN108021347A (en) * 2017-12-29 2018-05-11 航天科工智慧产业发展有限公司 A kind of method of Android terminal Screen sharing

Family Cites Families (1)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US6664969B1 (en) * 1999-11-12 2003-12-16 Hewlett-Packard Development Company, L.P. Operating system independent method and apparatus for graphical remote access

Cited By (8)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN101384987B (en) * 2006-02-20 2012-05-23 皇家飞利浦电子股份有限公司 A method of deriving a graphical representation of domain-specific display objects on an external display
CN101651827B (en) * 2009-07-16 2012-06-13 上海交通大学 Code rate control method of screen coding
CN102664939A (en) * 2012-04-13 2012-09-12 江苏诚迈科技有限公司 Method and device for mobile terminal of screen mirror image
CN104202380A (en) * 2014-08-26 2014-12-10 四川亿信信用评估有限公司 Remote computer control method based on smartphone
CN104202381A (en) * 2014-08-26 2014-12-10 四川亿信信用评估有限公司 Remote computer control system based on smartphone
CN105100639A (en) * 2015-07-20 2015-11-25 京东方科技集团股份有限公司 Display method and display apparatus
CN105100639B (en) * 2015-07-20 2017-11-24 京东方科技集团股份有限公司 A kind of display methods and display device
CN108021347A (en) * 2017-12-29 2018-05-11 航天科工智慧产业发展有限公司 A kind of method of Android terminal Screen sharing

Also Published As

Publication number Publication date
CN1303518C (en) 2007-03-07

Similar Documents

Publication Publication Date Title
CN1303518C (en) Remote server host computer frame monitoring system and method thereof
US7684483B2 (en) Method and apparatus for digitizing and compressing remote video signals
CN1455372A (en) Screen sharing and synchronous recording method based on IP network
CN101035344A (en) Motion detection method and system applied at the mobile monitoring terminal
CN102984494A (en) Video communication method and device
CN1783787A (en) Monitoring control system and method
US20050105608A1 (en) Method and apparatus for caching, compressing and transmitting video signals
US7835596B2 (en) Componentized application sharing
CN1592362A (en) Network camera
CN1622618A (en) A screen broadcasting method
CN103501310B (en) The control method that a kind of computer desktop based on videophone is shared
CN1976429A (en) Video frequency transmitting system and method based on PC and high-resolution video signal collecting card
CN1921622A (en) Video monitoring equipment and device
CN104618473A (en) Virtual machine desktop display method and device
WO2018103359A1 (en) Video processing method and system
CN106851053A (en) A kind of director method based on internet, terminal and system
CN1750653A (en) Network camera device with local storage function
CN101719985A (en) Method and device for collecting and processing images
CN1812410A (en) File transfer management systems and methods
CN1474289A (en) Method for displaying synchronously content of host on client machine
CN1207914C (en) Image processor image transmitting method and program
CN1286037C (en) Projecting method and system
Kim et al. An energy-efficient compression scheme for wireless multimedia sensor networks
WO2018032696A1 (en) Method and system for desktop screenshot control
CN110868614B (en) SPICE protocol-based difference image display system in video card transparent transmission environment

Legal Events

Date Code Title Description
PB01 Publication
C06 Publication
SE01 Entry into force of request for substantive examination
C10 Entry into substantive examination
GR01 Patent grant
C14 Grant of patent or utility model
CF01 Termination of patent right due to non-payment of annual fee

Granted publication date: 20070307

Termination date: 20101230

C17 Cessation of patent right