CN100368984C

CN100368984C - Image transfer using drawing command hooking

Info

Publication number: CN100368984C
Application number: CNB200510076764XA
Authority: CN
Inventors: 市枝博行
Original assignee: Seiko Epson Corp
Current assignee: Seiko Epson Corp
Priority date: 2004-06-11
Filing date: 2005-06-10
Publication date: 2008-02-13
Anticipated expiration: 2025-06-10
Also published as: JP2005352795A; CN1707423A; JP3826941B2

Abstract

A hook processing module (400) hooks and preempts a specific drawing command issued by an application program (122) , and draws an image in an image data storage area (106b) within the RAM (106) according to the acquired drawing command. VNC server (130) acquires the image from the image data storage area (106b), and transfers the acquired image to a projector via a network.

Description

Utilize the image supply device and the method for the hook of drawing command

Technical field

The present invention relates to comprise via the image supply device of network connection and the image display system of image display device.

Background technology

A kind of as the projector of Projection Display image, people have proposed the projector (below be also referred to as " networked projection's machine ") (for example international pamphlet that discloses No. 01/093583) of the image can Projection Display supplied with from personal computer via network.In addition, in order to supply with image from personal computer to such networked projection's machine via network, utilized the technology that is called VNC (Virtual NetworkComputing, virtual network is calculated).

Yet, utilizing under the situation of VNC, temporary transient VRAM (frame memory) in computing machine obtains image and sends projector to via network from RAM thereafter to RAM (system storage) transmitted image.Owing to need the considerable time from VRAM to the transmission of the view data of RAM, so there is the situation that can not obtain sufficient transfer rate on the whole.Such problem has more than and is limited to machine system of networked projection, usually has common problem supplying with the system that image makes its demonstration to image display device from image supply device via network.

Summary of the invention

The object of the invention is to provide the technology that improves via the transfer rate of network when the image display device transmitted image that makes.

The image supply device of a kind of mode of the present invention (aspect) is to be used for supplying with the image supply device that image makes its demonstration via network to image display device, it is characterized in that possessing:

Can send the application program of the drawing command of image;

Be used to handle the module of describing of the drawing command that sends by above-mentioned application program;

Hook is also obtained the specific drawing command that is sent by above-mentioned application program and the hook processing module of using the image memory region rendering image according to the specific transmission of the drawing command of obtaining in general-purpose storage in advance; And

Obtain image and the image that the image of obtaining sends above-mentioned image display device to is transmitted processing module with image memory region from above-mentioned transmission via above-mentioned network.

According to this image supply device, because when having sent specific drawing command, replace describing module and hook processing module hook and obtain this drawing command, describe the image in the general-purpose storage, so compare to the situation of RAM (general-purpose storage) transmitted image from VRAM with existing, can improve the whole speed of handling that transmits.

The method of another kind of mode of the present invention, be to supply with the method that image makes its demonstration to image display device via network, it is characterized in that, comprising: (a) according to the operation of the specific transmission of the specific drawing command that sends by application program in general-purpose storage with the image memory region rendering image; And (b) obtain image with image memory region and the image of obtaining is sent to the operation of above-mentioned image display device via above-mentioned network from above-mentioned transmission.

According to this method and since when sent specific drawing command in general-purpose storage rendering image, so compare to the situation of RAM (general-purpose storage) transmitted image from VRAM, can improve speed that transmit to handle integral body with existing.

The present invention also can possess following further feature.

Also can be that above-mentioned hook processing module has expression as writing function above-mentioned general-purpose storage in according to the region of variation information of the region of variation in the zone of above-mentioned drawing command rendering image in above-mentioned transmission in image memory region;

Above-mentioned image transmits processing module, obtains with reference to the above-mentioned region of variation information in the above-mentioned general-purpose storage of being stored in to be stored in above-mentioned transmission and to send above-mentioned image display device with above-mentioned region of variation information via above-mentioned network with the image section in the above-mentioned image change zone of image memory region and with the image section of obtaining.

According to this structure, because region of variation information also writes in the general-purpose storage by the hook processing module, compare so describe the situation that module writes region of variation information with use, what can make region of variation information writes the processing high speed.In addition, because image transmits image section and region of variation information that processing module transmits region of variation,, can reduce the data volume of transmission, thereby can improve transfer rate so the situation of the view data all with transmitting picture is compared.

In addition, also can be, above-mentioned image transmits processing module, has by being stored in above-mentioned transmission to send the function that screen displayed that above-mentioned image display device makes above-mentioned image display device has been amplified the 2nd image of above-mentioned the 1st image with the 1st image of image memory region to via above-mentioned network;

Above-mentioned hook processing module, have transit area information is write function in the above-mentioned general-purpose storage, this transit area information comprises that expression is as the region of variation information of the region of variation in the zone of describing above-mentioned the 1st image in above-mentioned transmission in image memory region according to above-mentioned drawing command and the dimension information of representing above-mentioned the 2nd size of images in the picture of above-mentioned image display device;

Above-mentioned image transmits processing module, obtains the above-mentioned transit area information that is stored in the above-mentioned general-purpose storage, and with it with sending above-mentioned image display device with above-mentioned the 1st image that image memory region obtains to via above-mentioned network from above-mentioned transmission.

According to this structure,,, can reduce the data volume of transmission, thereby can improve transfer rate so compare with the situation that transmits the 2nd image after amplifying owing to transmit preceding the 1st image and the transit area information (region of variation information and dimension information) of amplifying.

In addition, above-mentioned image transmits processing module and also can constitute, when above-mentioned image transmits the processing module starting, above-mentioned hook processing module is loaded in the above-mentioned application program, and when above-mentioned image transmits the execution end of processing module, from above-mentioned application program, unloads above-mentioned hook processing module.

According to this formation, because a hook processing module job when carrying out image transmission processing, so can prevent that the hook processing module is carried out the hook processing of not expecting when not needing hook to handle.

According to another embodiment of the present invention, above-mentioned hook processing module, at least comprise above-mentioned image and transmit processing module obtains the appointment of treatment of picture from above-mentioned transmission with image memory region image and transmit when handling carrying out, to transmit with processing until above-mentioned image and finish not begin to carry out the processing corresponding and wait for above-mentioned drawing command.

According to this structure, because hook processing module, transmit image that processing module carries out by image and transmit when handling carrying out, finish not begin to carry out the processing corresponding and wait for until this processing with drawing command, thus can prevent to transmit with the image in the image memory region before transmission because describing again of carrying out of hook processing module and problem that quilt is changed.

In addition, also can be, above-mentioned image transmits processing module, in above-mentioned image transmits with processing execution the transmission sign in the above-mentioned general-purpose storage is set at the ON state, and after above-mentioned image transmits with the processing end above-mentioned transmission sign is set at the OFF state;

Above-mentioned hook processing module does not begin to carry out the processing corresponding with above-mentioned drawing command and waits for until above-mentioned transmission sign OFF when above-mentioned transmission is masked as ON.

According to this structure, can adjust the processing timing that image transmits processing module and hook processing module easily.

Above-mentioned image transmits processing module,

(i) transmit with in handling at above-mentioned image, obtain with reference to the above-mentioned region of variation information in the above-mentioned general-purpose storage of being stored in and be stored in above-mentioned transmission with the image section in the above-mentioned image change zone of image memory region,

(ii) send the image section of obtaining to above-mentioned image display device with above-mentioned region of variation information via above-mentioned network.

According to another kind of mode of the present invention, it is characterized in that: above-mentioned hook processing module, have with expression as after above-mentioned transmission writes the function in the above-mentioned general-purpose storage and has handled above-mentioned specific drawing command according to the 1st region of variation information of the 1st region of variation in the zone of above-mentioned specific drawing command rendering image in image memory region with the above-mentioned function of describing module of this drawing command supply;

The above-mentioned module of describing has according to the function of the drawing command rendering image in frame memory that receives from above-mentioned application program or above-mentioned hook processing module and will represent that conduct writes function in the above-mentioned general-purpose storage according to the 2nd region of variation information of the 2nd region of variation in the zone of above-mentioned drawing command rendering image above-mentioned frame memory;

Above-mentioned image transmits processing module,

(i) with reference to the above-mentioned the 1st and the 2nd region of variation information that is stored in the above-mentioned general-purpose storage, from above-mentioned frame memory obtain with above-mentioned the 2nd region of variation be not included in regional suitable image section in above-mentioned the 1st region of variation,

(ii) will the image section suitable not to obtain from above-mentioned frame memory but obtain with image memory region from above-mentioned transmission with above-mentioned the 1st region of variation,

(iii) with the image section obtained with expression as the above-mentioned the 1st and the 2nd region of variation and the frame updating area information in frame updating zone send above-mentioned image display device to via above-mentioned network.

According to this structure, though the zone that is not included in the 2nd region of variation in the 1st region of variation is the zone that the hook processing module is not described, owing to this regional image is obtained from frame memory, so can have no loss ground transmitted image.

Above-mentioned image transmits processing module,

(ii) will with above-mentioned the 2nd region of variation in to be also contained in regional suitable image section in above-mentioned the 1st region of variation be not to obtain from above-mentioned frame memory but obtain with image memory region from above-mentioned transmission,

(iii) send the image section obtained and expression to above-mentioned image display device with the frame updating area information in the identical frame updating zone of above-mentioned the 2nd region of variation via above-mentioned network.

In this structure, though the zone that is not included in the 2nd region of variation in the 1st region of variation is the zone that the hook processing module is not described, owing to this regional image is obtained from frame memory, so can have no loss ground transmitted image.

In addition, also can be, above-mentioned image transmits processing module, obtain from above-mentioned frame memory with above-mentioned the 2nd region of variation be not included in the regional suitable image section in above-mentioned the 1st region of variation and write above-mentioned transmission with image memory region after, obtain the image section suitable with image memory region from above-mentioned transmission with above-mentioned frame updating zone.

According to this structure,, become simple so handle owing to finally via the network transmitted image time, can obtain image with image memory region from 1 transmission.

According to another kind of mode of the present invention, it is characterized in that:

Above-mentioned hook processing module, have with expression as after above-mentioned transmission writes the function in the above-mentioned general-purpose storage and has handled above-mentioned specific drawing command according to the 1st region of variation information of the 1st region of variation in the zone of above-mentioned specific drawing command rendering image in image memory region with the above-mentioned function of describing module of this drawing command supply;

Above-mentioned image transmits processing module,

(i) above-mentioned the 1st region of variation that exists during the transmission in will be between the antephase of appointment is handled is set as the resume zone, the transmission record information in this resume zone of expression write in the above-mentioned general-purpose storage,

(ii) with reference to the above-mentioned the 1st and the 2nd region of variation information and the above-mentioned transmission record information that are stored in the above-mentioned general-purpose storage, from above-mentioned frame memory obtain with above-mentioned the 2nd region of variation be not included in regional suitable image section in any one of above-mentioned the 1st region of variation and above-mentioned resume zone

(iii) image section that will be suitable with above-mentioned the 1st region of variation and with above-mentioned the 2nd region of variation in be not included in above-mentioned the 1st region of variation but be included in regional suitable image section in the above-mentioned resume zone, not to obtain from above-mentioned frame memory but obtain with image memory region from above-mentioned transmission

(iv) with the image section obtained with expression as the above-mentioned the 1st and the 2nd region of variation and the frame updating area information in frame updating zone send above-mentioned image display device to via above-mentioned network.

According to this structure, though the zone that is not included in the 2nd region of variation in the 1st zone and any one of resume zone is the zone that the hook processing module is not described, because this image obtains from frame memory, so transmitted image with can having no loss.And then, because image section that will be suitable with the 1st region of variation and with the 2nd region of variation in not to be included in the 1st region of variation but to be included in regional suitable image section in the resume zone be not to obtain from frame memory but obtain with image memory region from transmission, so can shorten the needed time of obtaining of these image sections.

Above-mentioned image transmits processing module,

(iii) be not from above-mentioned frame memory obtain but from above-mentioned transmission with image memory region obtain with above-mentioned the 2nd region of variation be included in regional suitable image section among at least one side in above-mentioned the 1st region of variation and above-mentioned resume zone,

The frame updating area information in (iv) that the image section obtained is identical with above-mentioned the 2nd region of variation with expression frame updating zone sends above-mentioned image display device to via above-mentioned network together.

In this structure, though the zone that is not included in the 2nd region of variation in any one of the 1st region of variation and resume zone is the zone that the hook processing module is not described, because this image obtains from frame memory, so can have no loss ground transmitted image.And then, since be not from frame memory obtain but from transmit with image memory region obtain with the 2nd region of variation be not included in regional suitable image section among at least one side in the 1st region of variation and resume zone, so can shorten the needed time of obtaining of these image sections.

In addition, also can be, above-mentioned image transmits processing module, obtain from above-mentioned frame memory with above-mentioned the 2nd region of variation be not included in the regional suitable image section in any one of above-mentioned the 1st region of variation and resume zone and write above-mentioned transmission with image memory region after, obtain the image section suitable with image memory region from above-mentioned transmission with above-mentioned frame updating zone.

According to another kind of mode of the present invention, it is characterized in that: the above-mentioned module of describing has the function according to the drawing command rendering image in frame memory that receives from above-mentioned application program or above-mentioned hook processing module;

Above-mentioned image transmits processing module to have,

When carrying out the describing of image, obtain and transmit by above-mentioned hook processing module be depicted in above-mentioned transmission with the common transfer mode of the image of image memory region and

Above-mentioned image describe obtain and transmit the transfer mode again of describing the image of module plotting in above-mentioned frame memory by above-mentioned after stopping.

According to this structure, since have image describe obtain and transmit by the transfer mode again of describing the image of module plotting in frame memory after stopping, even, also can transmit high-quality image describing to stop the back so in common transfer mode, transmitted under the situation of the poor slightly image of picture quality.

In addition, also can be, above-mentioned hook processing module has expression as writing function above-mentioned general-purpose storage in according to the 1st region of variation information of the 1st region of variation in the zone of above-mentioned specific drawing command rendering image in above-mentioned transmission in image memory region;

Above-mentioned image transmits processing module,

In above-mentioned common transfer mode, above-mentioned the 1st region of variation that transmit to finish is set as transit area again, with represent this again the information of transit area again of transit area write in the above-mentioned general-purpose storage,

In above-mentioned transfer mode again, obtain and the suitable image section of at least a portion of transmission and above-mentioned transit area again from above-mentioned frame memory.

According to this structure, even be depicted in by the hook processing module according to specific drawing command transmit with the image in the image memory region and according to identical drawing command by the situation of describing to there are differences between the image of module plotting in frame memory under, also can after describing to stop, correctly transmitting the image in the frame memory.

In addition, also can be, the image section suitable with at least a portion of above-mentioned transit area again be with above-mentioned transit area again in the regional suitable image section of specified size;

Above-mentioned image transmits processing module, in above-mentioned transfer mode again, transmit with above-mentioned transit area again in specified size regional suitable image section and from above-mentioned transit area again, delete the zone of above-mentioned specified size.

According to this structure, because with the mode in the zone of each specified size transmitted image again, handle the needed time so can shorten 1 time transmission again.In addition, owing in the process that the transmission of transfer mode is more for several times handled, when having begun to describe, can promptly return common transfer mode, the overtreating ground that is undertaken by common transfer mode is postponed.

Also can be that the above-mentioned module of describing further has expression is write function in the above-mentioned general-purpose storage as the 2nd region of variation information of the 2nd region of variation in the zone of rendering image in above-mentioned frame memory;

Above-mentioned image transmits processing module, in above-mentioned common transfer mode,

(i) with reference to the above-mentioned the 1st and the 2nd region of variation information that is stored in the above-mentioned general-purpose storage, from above-mentioned frame memory, obtain with above-mentioned the 2nd region of variation in be not included in regional suitable image section in above-mentioned the 1st region of variation,

(ii) not to obtain from above-mentioned frame memory but obtain and the suitable image section of above-mentioned the 1st region of variation with image memory region from above-mentioned transmission,

Though the zone that is not included in the 2nd region of variation in the 1st region of variation is the zone that the hook processing module is not described, owing to this regional image is obtained from frame memory, so can have no loss ground transmitted image.

Also can be, above-mentioned transfer mode again, be included in from above-mentioned image describe stop to begin through the full frame of the image of obtaining and transmit the full frame zone in the above-mentioned frame memory after during appointment transfer mode again.

According to this structure, at the image of describing to transmit reliably after stopping the full frame zone in the frame memory of image.

Also can be, above-mentioned image transmits processing module, at above-mentioned full frame again in the transfer mode, with above-mentioned full frame area dividing is a plurality of zonings of specified size, by transmitting the transmission that the image that transmits 1 zoning in turn selecting in the processing from above-mentioned a plurality of zonings is finished the image in above-mentioned full frame zone at per 1 time.

According to this structure, because with the mode of the zoning of each specified size transmitted image again, handle the needed time so can shorten to transmit for 1 time.In addition, owing to again in the transfer mode, in the process of handling through the transmission of repeatedly carrying out, when having begun to describe, can promptly return common transfer mode, so the overtreating ground that is undertaken by common transfer mode is postponed at full frame.

Also can be that above-mentioned image transmits processing module, also has:

The image that will in above-mentioned common transfer mode, transmit, the function of utilizing the compression method from a plurality of compression methods that comprise the 2nd compression method that the 1st compression method that image deterioration is big relatively and image deterioration are relatively little, selected to compress;

Will be in above-mentioned common transfer mode login function as the transit area again in the zone of the image that in above-mentioned transfer mode again, transmits with the zone of above-mentioned the 1st compression method compression and the image that transmits; And

In above-mentioned transfer mode again, the image in the above-mentioned transit area is again carried out the function of compression of images and transmission with above-mentioned the 2nd compression method.

According to this structure, because little compress mode compression and being transmitted in the common transfer mode in transfer mode again, so can transmit high-quality image describing to stop the back with big compression method compression of image deterioration and the image that transmits with image deterioration.

In addition, the present invention can realize in various manners, for example, can enough image display systems, image supply device and image display device, the hook processing module of utilizing on image supply device and the image of composing images display system transmit processing module, image supply method, be used to realize that the computer program of these methods or device, the variety of way that stores the medium etc. of these computer programs realize.

Below by the explanation of preferred embodiment shown in the drawings above-mentioned and other purpose, feature, mode and advantage of the present invention as can be seen.

Description of drawings

Fig. 1 is the key diagram of expression as the structure of the image display system of one embodiment of the present of invention.

Fig. 2 is the block scheme of the inner structure of expression computing machine and projector.

Fig. 3 is the key diagram of hierarchy of the software and hardware of the computing machine of expression in the comparative example.

Fig. 4 is the region of variation information of expression among the embodiment 1 and the key diagram of the example in image data storage zone.

Fig. 5 is the key diagram of the structure of expression frame updating message.

Fig. 6 is the key diagram of hierarchy of the software and hardware of the computing machine of expression among the embodiment 1.

Fig. 7 is hook (hook) processing module of expression among the embodiment 1 and the process flow diagram of the action of VNC server.

Fig. 8 is the key diagram of the relation in a plurality of region of variation of expression and frame updating zone.

Fig. 9 is the key diagram of expression as the structure of the image display system of embodiments of the invention 2.

Figure 10 is the region of variation information of expression among the embodiment 2 and the key diagram of the example in image data storage zone.

Figure 11 is the key diagram of structure of the frame updating message of expression embodiment 2.

Figure 12 is the key diagram of the action of expression embodiment 2.

Figure 13 is the region of variation information of expression among the embodiment 3 and the key diagram of the example in image data storage zone.

Figure 14 is the key diagram of hierarchy of the software and hardware of the computing machine of expression among the embodiment 3.

Figure 15 is the hook processing module of expression among the embodiment 3 and the process flow diagram of the action of VNC server.

Figure 16 is a plurality of region of variation of expression among the embodiment 3 and the key diagram of the relation in frame updating zone.

Figure 17 is a key diagram of representing not utilize the example of the problem when transmitting sign 106c.

Figure 18 is the key diagram of hierarchy of the software and hardware of the computing machine of expression among the embodiment 4.

Figure 19 is the hook processing module of expression among the embodiment 4 and the process flow diagram of the action of VNC server.

Figure 20 is the process flow diagram of the detailed step of the step S20 among the expression embodiment 4.

Figure 21 is the region of variation of expression among the embodiment 4 and the key diagram of the relation in frame updating zone.

Figure 22 is the key diagram of content of the optimal treatment in expression frame updating zone.

Figure 23 is the process flow diagram of the detailed step of the step S22 among the expression embodiment 4.

Figure 24 is the key diagram that is illustrated in the relation in region of variation among the embodiment 5 and frame updating zone.

Figure 25 is the key diagram of hierarchy of the software and hardware of the computing machine of expression among the embodiment 6.

Figure 26 is the key diagram of the example of 2 region of variation information A 1, A2 and transmission record information HA1 among the expression embodiment 6.

Figure 27 is the hook processing module of expression among the embodiment 6 and the process flow diagram of the action of VNC server.

Figure 28 is the process flow diagram of the detailed step of the step S20 among the expression embodiment 6.

Figure 29 is the region of variation of expression among the embodiment 6 and the key diagram of the relation in frame updating zone.

Figure 30 is the key diagram of content of the optimal treatment in expression frame updating zone.

Figure 31 is the process flow diagram of the detailed step of the step S22 among the expression embodiment 6.

Figure 32 is the key diagram of the relation in the region of variation of moment t1 of expression embodiment 6 and resume zone and frame updating zone.

Figure 33 is the key diagram of another example of 2 region of variation information A 1, A2 and transmission record information HA1 among the expression embodiment 6.

Figure 34 is the moment t10 of expression embodiment 6 and the key diagram in the frame updating zone of moment t11.

Figure 35 is the region of variation of expression among the embodiment 7 and the key diagram of the relation in frame updating zone.

Figure 36 is the key diagram of another example of 2 region of variation information A 1, A2 and transmission record information HA1 among the expression embodiment 7.

Figure 37 is the moment t20 of expression embodiment 7 and the key diagram in the frame updating zone of moment t21.

Figure 38 is the key diagram of hierarchy of the software and hardware of the computing machine of expression among the embodiment 8.

Figure 39 is 2 region of variation information A 1 of expression, A2 and the key diagram of the example of transit area information RS again.

Figure 40 is the hook processing module of expression among the embodiment 8 and the process flow diagram of the action of VNC server.

Figure 41 is the process flow diagram of the detailed step of the step S20 among the expression embodiment 8.

Figure 42 is the constantly region of variation and the key diagram of the relation in transit area and frame updating zone again of t100 of expression.

Figure 43 is the key diagram of content of the optimal treatment in expression frame updating zone.

Figure 44 is the process flow diagram of the detailed step of the step S22 among the expression embodiment 8.

Figure 45 is the process flow diagram of the detailed step of the step S24 among the expression embodiment 8.

Figure 46 is the process flow diagram of the detailed step of expression step S314.

Figure 47 is a key diagram of representing to transmit again the content of processing.

Figure 48 is the process flow diagram of the detailed step of the step S20 (the frame updating zone is determined to handle) among the expression embodiment 9.

Figure 49 is the process flow diagram of the detailed step of the step S314a (transmit and handle) among the expression embodiment 9.

Figure 50 is the key diagram of the content of expression step S414, S416 (full frame transmits processing again).

Figure 51 is the process flow diagram of the detailed step of the step S24 (view data conversion process) among the expression embodiment 10.

Figure 52 is region of variation RA1, RA2 and the again key diagram of an example of the relation of transit area RRS of expression among the embodiment 10.

Embodiment

Below, embodiments of the present invention are described in the following order.

A. embodiment 1

B. embodiment 2

C. embodiment 3

D. embodiment 4

E. embodiment 5

F. embodiment 6

G. embodiment 7

H. embodiment 8

I. embodiment 9

J. embodiment 10

K. variation

A. embodiment 1

Fig. 1 is the key diagram of expression as the structure of the image display system of one embodiment of the present of invention.The image display system 10 of present embodiment possesses personal computer 100 as image supply device, as the projector 200 of image display device and the network 300 that connects computing machine 100 and projector 200.Computing machine 100 is supplied with images via network 300 to projector 200, has to make projector's 200 projected images be presented at function on the projection display picture 70.

Fig. 2 is the block scheme of the inner structure of expression computing machine 100 and projector 200.Computing machine 100 possesses: the display device 118 of CPU102, ROM104, the RAM16 as general-purpose storage (being also referred to as " system storage "), hard disk drive 108, the input part 110 that is made of keyboard or indicating device etc., network interface portion 112, the VRAM114 as frame memory, graphics controller 116, LCD etc., connect the bus 120 of these each key elements.

The various computer programs that comprise application program 112, Graphics Device Interface (GDI:GraphicsDevice Interface) 124, display driver 126, projector's driver 128, transmit the VNC server 130 of processing module as image in RAM106, have been stored.In addition, GDI124, display driver 126, projector's driver 128 are brought into play function as the part of operating system.In addition, in the present embodiment, the Windows (registered trademark) that supposes to be provided by Microsoft is as operating system.Mode on the medium that various computer programs like this can read with the computing machine that is stored in floppy disk and CD-ROM etc. provides.

Projector 200 possesses: CPU202, ROM204, RAM206, the input part 210 that comprises various action buttons, network interface portion 212, image processing part 214, comprise illuminator and liquid crystal panel and projection optical system Projection Division 216, be connected the bus 218 of these each key elements.The various computer programs that comprise Flame Image Process driver 228, VNC CLIENT PROGRAM 230 have been stored in the ROM204 kind.

Below before the function of the computing machine 100 of explanation among the embodiment 1, the function of the existing computing machine of VNC server is used in the example explanation at first as a comparison.

Fig. 3 is the key diagram of hierarchy of the software and hardware of the computing machine of expression in the comparative example.Application program 122 and VNC server 130 belong to application layer (being also referred to as " user application layer ").GDI124 and display driver 126 and projector's driver 128 belong to core layer.In addition, RAM106, network interface portion 112, VRAM114, graphics controller 116, the display device 118 as general-purpose storage belongs to hardware layer.

In embodiment 1, for using the situation of demonstration program (for example PowerPoint of Microsoft) to describe as application program 122.

Application program 122 is sent the various requests of describing for GDI124.GID124 is the computer program described of unified management to display device (display device 118 of computing machine 100 or projector 200) or printing equipment (not shown) etc.As known, GDI124 for various application programs provide be called " GDI function " describe relevant application programming interfaces (API:ApplicationProgram Interface: application programming interfaces).In addition, so-called API typically refers to and is used for the set that application program is utilized the formality of the various functions that operating system has.

Application program 122 is sent the image displaying request of the demonstration chart that for example is included in the demonstration document for GDI124.Usually, in describing to ask, also comprise the information relevant (that is, specify image is outputed to the information that display device still outputs to printing equipment) with the output destination of image.

In addition, replace GDI124 also can use other general describing API.So-called " general describing API " expression is for the shared API of a plurality of application programs.

GDI124, display driver 126, projector's driver 128 all as carry out according to drawing command describe to handle describe module performance function.Specifically, GDI124 receives the request of describing of sending from application program 122, describe to ask to verify the output destination of image according to this,, then transmit the request described for display driver 126 and projector's driver 128 respectively if this output destination is a display device.

Display driver 126 is according to the request of the describing delineate in VRAM114 that obtains.In addition, as known,, have more than the integral body that is limited to the face of describing, also parts that are used to the face of describing as describing request more.When the drawing command of a part that receives the face of describing, display driver 126 only describes to become the image section in the zone (being also referred to as " region of variation ") of rendered object in VRAM114.Graphics controller 116 is according to image represented data (that is, data bitmap) in VRAM114, display image on display device 118.On the other hand, projector's driver 128 writes the position in the rendered object zone (being region of variation) in the expression VRAM114 and the region of variation information 106a of size in the RAM106 according to the request of describing that receives from GDI124.

Fig. 4 (A), (B) are the key diagrams of the example of interior region of variation information 106a of expression RAM106 and image data storage zone 106b.At this, suppose image with projective representation of projector as Fig. 4 (A) to the example that changes like that shown in Fig. 4 (B).As described later, the view data that memory by using VNC server 130 transmits from VRAM114 in the 106b of image data storage zone.Preferably image data storage zone 106b has the identical data capacity with VRAM114 (frame memory).

Region of variation Ra is the zone by the drawing command image represented part of change during image from Fig. 4 (A) to Fig. 4 (B).The region of variation information 106a relevant with this region of variation Ra comprises the x coordinate Xa of reference point (normally upper left point) of region of variation Ra and width W a and the height H a of y coordinate Ya, region of variation Ra.In addition, the coordinate of reference point (Xa, Ya) is the data of the position of expression region of variation Ra, and width W a and height H a are the data of the size of expression region of variation Ra.

VNC server 130 is with reference to the region of variation information 106a in the RAM106, and the view data of region of variation Ra is sent to image data storage zone 106b in the RAM106 from VRAM114.This image data memory zone 106b for example is the memory area of the size that equates with the display resolution of computing machine 100 or projector 200.VNC server 130 is further read region of variation Ra from the 106b of image data memory zone view data, generation comprises the region of variation information 106a of region of variation Ra and the frame updating message of view data.

Fig. 5 is the key diagram of the structure of expression frame updating message.This frame updating message is followed the structure of the frame buffer renewal " Framebuffer Update " of VNC agreement regulation.Frame updating message has the message header of the kind of representing message and represents the parameter portion of the parameter of information.

In message header, comprise the type of message (1 byte) of the kind of representing message and the region of variation number (2 byte) of quantity of expression region of variation.The data value of the type of message of expression frame updating message is " 0 ".The data value of region of variation number is set at " 1 " usually.But, under the situation that region of variation information 106a relevant with a plurality of region of variation in RAM106 keeps because of being untreated, also can comprise the information relevant (region of variation information and view data) mode and constitute frame updating message with frame updating message with these a plurality of region of variation.The region of variation information that also will be included in the frame updating message is called " frame updating area information ".In addition, so-called type of message data and region of variation logarithmic data are distinguished by the byte of padding of 1 byte.

Coded format (4 byte) when the view data that comprises the width (2 byte) of the x coordinate (2 byte) of the reference point of region of variation and y coordinate (2 byte), region of variation and height (2 byte), region of variation in parameter portion transmits, the view data (n byte) of region of variation.Use the predetermined form of jpeg format (data value " 7 ") etc. as coded format.

VNC server 130 is sent to projector 200 via the frame updating message that network interface portion 112 will generate like this.

Like this, in comparative example shown in Figure 3,, the view data in the RAM106 is sent to projector 200 at first being stored in after view data among the VRAM114 is sent to RAM106 as general-purpose storage.Therefore, need the long duration, thereby the situation of sufficient transfer rate can occur to obtain in order to be sent to RAM106 from VRAM114.

Fig. 6 is the key diagram of hierarchy of the software and hardware of the computing machine of expression among the embodiment 1.Be that with comparative example difference shown in Figure 3 appended hook processing module 400 between application program 122 and GDI124, other structure is identical with Fig. 3.The specific drawing command that hook processing module 400 application programs 122 are sent carries out hook (hook) and obtains in advance, carries out processing described later.Other drawing command is handled by GDI124 by common mode.In addition, preferably hook processing module 400 constitutes each application-specific in the mode of the corresponding suitable certain illustrative order of a hook and application program 122.

In addition, though hook processing module 400 also can be thought a kind of API that describes to use, be different from such general the describing API of GDI124.That is, constitute in the mode of typically only handling specific drawing command, constitute on this point different in the mode of handling all drawing commands at GDI124 with respect to hook processing module 400.

Hook processing module 400 for example is loaded (packing into) in application program 122 as DLL (dynamic link routine library).Usually, application program is moved with " processing " such unit.In addition, in the execution of application program, in this is handled, load a plurality of modules (GDI32.DLL or Kernel32.DLL etc.), utilize the function in these modules to carry out exercises by application program." loadings " of so-called hook processing module 400 is illustrated in the interior module 400 of having loaded the hook program of processing of application program 122.

When loading hook processing module 400, the function address of the specific drawing command that sends from application program 122 is replaced by the address that is used to carry out another function that is loaded in the standalone feature in the hook processing module 400.In the function of this standalone feature, carry out change information and view data to RAM write processing (back narration), thereafter, carry out common GDI function.When unloading hook processing module 400, after the function address of replacing in the time will loading restored, unloading was loaded in the hook processing module 400 in handling.

In addition, hook processing module 400 can at any time be loaded in the application program 122 as required, perhaps unloading.But, preferably loading hook processing module 400 in the specific application program 122 (being demonstration program in the present embodiment) in action when VNC server 130 starting, the mode of unloading hook processing module 400 constitutes VNC server 130 during this external end VNC server 130.Like this, because can be, so hook drawing command and produce the result who does not expect can avoid on computing machine 100, not have execution (unstart) VNC server 130 time only in 400 actions of VNC server 130 implementation period chien shih hook processing module.In addition, in this manual, started the processing of VNC server 130 in " carrying out VNC server 130 on the computing machine 100 " this section textual representation.

Fig. 7 is the hook processing module 400 of expression among the embodiment 1 and the process flow diagram of the action of VNC server 130.Step S10～S16 is carried out by hook processing module 400, and step S20～S26 is carried out termly by VNC server 130.

When application program 122 has been sent specific drawing command, hook processing module 400 is this drawing command of hook in step S10, replaces GDI124 and obtains this drawing command.In addition, preferably the drawing command of 400 hooks of hook processing module is not whole drawing command, and only is defined as limited specific drawing command.Its reason is because the drawing command that application program 122 is sent has a lot, so if its all order of hook can make processing speed reduce on the contrary, tend to carry out the desired possibility of describing.

In step S12, carry out according to the drawing command login region of variation information processing that obtains.Specifically, hook processing module 400 obtains the position and the size in the zone of describing (the region of variation Ra of Fig. 4 (B)) according to drawing command, and execution will be represented write direct processing among the RAM106 of the region of variation information 106a of this region of variation.

In step S14, carry out region of variation Ra view data write processing.Specifically, hook processing module 400 is launched view data in the region of variation Ra according to drawing command, and execution is with write direct the processing among the image data storage zone 106b in the RAM106 of this view data.

In step S16, hook processing module 400 is called common GDI function execution according to the drawing command of obtaining and is described to handle in step S10.In addition, display driver 126 is the same with comparative example shown in Figure 3 with driver 128 (Fig. 6) of projector, according to the drawing command execution processing separately that receives from GDI124.But in the present embodiment, VNC server 130 constitutes the region of variation information that is generated by projector's driver 128 of not using.In Fig. 6, represent this meaning at the front and back of the projector's driver 128 with dashed lines arrow that draws.

On the other hand, VNC server 130 definite zone (being called " frame updating zone ") that should be sent to the view data of projector 200 in step S20.Specifically, VNC server 130 is obtained the region of variation information 106a (Fig. 4 (B)) in the RAM106, and region of variation Ra is determined as the frame updating zone.But.When in RAM106, having relevant with a plurality of region of variation untreated region of variation information 106a, will be equivalent to a plurality of region of variation definite as the frame updating zone with the zone zone.

Fig. 8 is the key diagram of the relation in a plurality of region of variation of expression and frame updating zone.Wherein, shown in Fig. 8 (A), consider to exist the situation of overlapped 2 region of variation R1, R2.At this moment, at first shown in Fig. 8 (B), with the mutual nonoverlapping adjacent rectangular area R11～R13 of becoming of region of variation R1, R2 with Region Segmentation.Then, the set of these rectangular areas R11～R13 is adopted as the frame updating zone.If use such frame updating region R 11～R13, then owing to avoiding repeating to transmit the view data of region of variation R1, R2 lap, so can reduce the data conveying capacity.In addition, when a plurality of region of variation phase non-overlapping copies, their former states ground is used as the frame updating zone.

In step S22, in the 106b of the image data memory zone of RAM106, obtain the view data of the image section suitable with the frame updating zone.Then, in step S24, according to predetermined this view data of coded format conversion.In step S26, generation comprises the view data of such conversion and the frame updating message (Fig. 5) of region of variation information, and is sent to projector 200 via network interface portion 112.

When the network interface portion 212 (Fig. 2) of projector 200 has received the communication data of supplying with via network 300, then take out the frame updating message that is included in this communication data, pass to VNC CLIENT PROGRAM 230.The view data that VNC CLIENT PROGRAM 230 will be included in the frame updating message passes to Flame Image Process driver 228.Flame Image Process driver 228 is according to this view data control image processing part 214, by view data is launched.Its result, as shown in Figure 1, projector 200 can be on projection display picture 70 display image.

Like this, in embodiment 1,400 pairs of specific drawing commands of hook processing module carry out hook and in advance obtaining, and carry out the write direct processing of RAM106 of the view data of region of variation.Its result can save in comparative example shown in Figure 3 from VRAM114 the needed time of the transmission of the view data of RAM106.Its result has the advantage that can accelerate the transfer rate when projector's 200 transmitted image data fully.

In addition, normally used personal computer is with respect to transmitting and can carry out extremely at high speed to the data of VRAM114 from RAM106 mostly, and transmits the architecture that can only carry out with the speed that is several times lower than to the data of RAM106 from VRAM114.In embodiment 1, owing to can reduce transmitting to the data of RAM of low speed from VRAM, so can be reduced to the needed time of 200 transmitted image data significantly to projector.

B. embodiment 2

Fig. 9 is the key diagram of expression as the structure of the image display system of embodiments of the invention 2.In embodiment 2, the situation of using the motion video playback programs (for example Windows Media Player of Microsoft) that can carry out motion video playback (Replay) is described as application program.The feature of embodiment 2 is to set different sizes for the size of images of actual displayed on projection display picture 70 be sent to the picture size of projector 200 via network 300.

The structure of the hard disk of embodiment 2 and the structure of software and Fig. 2 and embodiment 1 shown in Figure 6 is identical.Embodiment 2 has following 3 points with the difference of embodiment 1.

(1) in embodiment 2, used the hook processing module 400 of the specific drawing command that is suitable for hook motion video playback programs.

(2) the region of variation information that is stored in the RAM106 is different with view data.

(3) the structure difference of frame updating message.

Figure 10 represents the example of region of variation information 106a among the embodiment 2 and image data storage zone 106b.At this, suppose to use the motion video playback programs motion video of in the motion video zone, resetting.The image in the motion video zone in the drawing command delineate storage area 106b that hook processing module 400 is sent with designated time intervals successively according to driven image replaying program.

The user is presented in computing machine 100 and the projector 200 it by the motion video that can zoom in or out of the amplification/minification at indicating image on the application program 122.But even under the situation of motion video that zooms in or out, hook processing module 400 also continues the processing that image data storage zone 106b in RAM106 writes full-sized view data.

Region of variation information 106a among the embodiment 2 is image type, amplification/picture traverse after dwindling and the information of height of having appended region of variation Ra (motion video zone) outside the content of the region of variation information of embodiment shown in Figure 51.Wherein, so-called " image type " is that the image of expression region of variation Ra is to amplify or the parameter of dwindling when showing.For example, on the picture of computing machine 100 and projector 200, value with image type when motion video zooms in or out situation about showing than life size (being the size of the Ra of region of variation) under is set at " 1 ", when to wait value that shows under the situation about showing image type to be set at " 0 ".The width of the image after amplifying/dwindling and the zoom in or out size of images in when demonstration of expression highly.For example, be amplified under 2 times the situation width after amplifying/dwindling and be highly respectively the width W a of region of variation Ra and 2 times of height H a.

In addition, the information of appending in the region of variation information 106a of embodiment 2 (image type, amplification/after dwindling width and height) is the dimension information that is illustrated in the picture size of Projection Display in the projector 200.Promptly, the dimension information of the picture size after region of variation information, the expression that the region of variation information 106a of embodiment 2 comprises the position of expression region of variation Ra and size amplified/dwindled can think to represent to be sent to the display image area position of projector 200 and the information of size.Therefore, the region of variation information of embodiment 2 can be called " transit area information ".

Figure 11 is the key diagram of structure that is sent to the frame updating message of projector 200 among the expression embodiment 2 from VNC server 130.This frame updating message is to have appended the width of image of the image type of region of variation Ra, amplification/after dwindling and the information of height in the content of the frame updating message of embodiment shown in Figure 51.

Projector 200 receives this frame updating message, with width after amplifying/dwindling and the size of highly representing motion video is presented on the projection display picture 70.At this moment, when the image type in being included in frame updating message represents to wait times image (data value " 0 "), in the display-memory that is deployed in the projector with being included in view data former state in the frame updating message.On the other hand, when image type is represented amplification/downscaled images (data value " 1 "), the view data that is included in the frame updating message is zoomed in or out to the width and the height of appointment, be deployed in the display-memory.The image processing part 214 of projector 200 drives Projection Division 216 according to the view data of launching (that is, data bitmap) in display-memory, can be by Projection Division 216 Projection Display images.

Figure 12 (A), (B) are the key diagrams of action of the image display system of expression embodiment 2.In embodiment 2, shown in Figure 12 (A), when showing motion video MVn in the display frame 60 at computing machine 100, the view data MV-D of each frame of this motion video MVn sends via network 300, shows this motion video MVn on the projection display picture 70 of projector 200.And, shown in Figure 12 (B),, the user in display frame 60, makes when amplifying motion video MVs and showing when setting magnification, and on the projection display picture 70 of projector 200, also show and amplify motion video MVs.At this moment, the view data of each frame of the amplification motion video MVs that sends via network 300 from computing machine 100 is not the view data of having amplified the view data MV-D of each frame, but the view data MV-D of each frame before amplifying.Its result lacks than the situation that transmits the view data after the amplification via the actual data volumes that transmit of network 300 and to get final product, thereby can restrain the increase of Internet traffic, can improve response significantly.Its result amplifying under the situation that shows motion video, can prevent from excessively to reduce the frame number of motion video, thereby can show motion video glossily.

C. embodiment 3

Figure 13 (A)～(C) is the key diagram of the example of interior region of variation information 106a of the RAM106 of hypothesis among the expression embodiment 3 and image data storage zone 106b.Whole apparatus structure is identical with the structure illustrated in figures 1 and 2 of explanation in embodiment 1.At this, suppose image such example that in turn is moved to the left shown in Figure 13 (A)～Figure 13 (C) of face.The mobile use of such image for example realizes in the pre-prepd animation effect of demonstration program.In comparative example (Fig. 3), in the 106b of image data storage zone, stored the view data of utilizing VNC server 130 to transmit from VRAM114.

The zone that region of variation Ra shown in Figure 13 (B) is an image when Figure 13 (A) moves to the state of Figure 13 (B) by drawing command image represented part.The region of variation information 106a relevant with this region of variation Ra comprises the x coordinate Xa of reference point (normally upper left point) of region of variation Ra and width W a and the height H a of y coordinate Ya, region of variation Ra.In addition, the coordinate of reference point (Xa, Ya) is the data of the position of expression region of variation Ra, and width W a and height H a are the data of the size of expression region of variation Ra.

The zone that region of variation Rb shown in Figure 13 (C) is an image when Figure 13 (B) moves to the state of Figure 13 (C) by drawing command image represented part.The region of variation information 106a of this region of variation Rb also is made of data Xb, the Yb of the position of representing region of variation Rb and data W b, the Hb of expression size.

For example, under the state of the moment t2 shown in Figure 13 (B), VNC server 130 is sent to image data storage zone 106b RAM106 in the view data of region of variation Ra from VRAM114 with reference to the region of variation information 106a in the RAM106.This image data memory zone 106b for example is the memory area of the size that equates with the display resolution of computing machine 100 or projector 200.The view data that VNC server 130 is further read region of variation Ra from image data storage zone 106b, generation comprises the region of variation information 106a of region of variation Ra and the frame updating message of view data.Moment t3 at Figure 13 (C) also carries out same processing.

The frame updating message that VNC server 130 will generate like this is sent to projector 200 via network interface portion 112.

Like this, in comparative example shown in Figure 3,, the view data in RAM106 is sent to projector 200 will temporarily being stored in after view data among the VRAM114 is sent to RAM106 as general-purpose storage.Therefore, need considerable time in order to be sent to RAM106, thereby can have the situation that can't obtain sufficient transfer rate from VRAM114.

Figure 14 is the key diagram of the software and hardware hierarchy of the computing machine among the expression embodiment 3.Be that with comparative example difference shown in Figure 3 appended hook processing module 400 between application program 122 and GDI124, set and transmitted sign 106c, other structure is identical with Fig. 3 in RAM106.Be to have appended with the difference of embodiment 1 shown in Figure 6 and transmit sign 106c, other structure is identical with embodiment 1.

Figure 15 is the hook processing module 400 of expression among the embodiment 3 and the process flow diagram of the action of VNC server 130.Step S100～S140 is carried out by hook processing module 400, and step S200～S250 is carried out termly by VNC server 130.The step S100 of hook processing module, S120, S130, S140 are the processing roughly the same with step S10, S12, S14, the S16 of Fig. 7, have appended step S110 in Figure 15.The step S210 of VNC server, S220, S230, S250 are the processing roughly the same with step S20, S22, S24, the S26 of Fig. 7, have appended step S200, S240 in Figure 15.

Hook processing module 400, when when application program 122 is sent specific drawing command, this drawing command of hook in step S100 replaces GDI124 to obtain this drawing command.

In step S110, judge whether the transmission sign 106c (Figure 14) in the RAM106 is in the OFF state.This transmission sign 106c transmits with processing at the image that VNC server 130 is carried out appointments (to be set at the sign of ON state among the step S210 that narrates later～S230).When transmitting sign 106c and be in the ON state, hook processing module 400 becomes the OFF state and waits for until transmitting sign 106c.In this was waited for, hook processing module 400 was that unit confirms to transmit sign 106c with per set time.When transmission sign 106c becomes the OFF state, then begin to move to the processing of step S120.

In step S120, carry out according to the drawing command login region of variation information processing that obtains.Specifically, hook processing module 400 obtains the position and the size in the zone of describing (for example region of variation Ra of Figure 13 (B)) according to drawing command, and execution will be represented the write direct processing of RAM106 of the region of variation information 106a of this region of variation.

In step S130, carry out region of variation view data write processing.Specifically, at the moment t2 shown in Figure 13 (B), hook processing module 400 is launched view data in the region of variation Ra according to drawing command, and execution is with the write direct processing of the image data storage zone 106b in the RAM106 of this view data.

In step S140, hook processing module 400 is called common GDI function execution according to the drawing command of obtaining at step S100 and is described to handle.In addition, display driver 126 is the same with comparative example shown in Figure 3 with driver 128 (Figure 14) of projector, according to the drawing command execution processing separately that receives from GDI124.But in embodiment 3, VNC server 130 constitutes the region of variation information that is generated by projector's driver 128 of not using.In Figure 14, represent this meaning at projector's driver 128 front and back with dashed lines arrow that draws.

On the other hand, VNC server 130 at first will transmit sign 106c and switch to the ON state in step S200, the processing of the step S210～S230 of the following explanation of beginning (being called " image transmits with handling ").

VNC server 130 is definite zone (being called " frame updating zone ") that should be sent to the view data of projector 200 in step S210.Specifically, for example at the state of the moment t2 of Figure 13 (B), VNC server 130 is obtained the region of variation information 106a in the RAM106, and region of variation Ra is determined as the frame updating zone.But,, will be equivalent to a plurality of region of variation definite as the frame updating zone with the zone zone when in RAM106, existing under the situation of the untreated region of variation information 106a relevant with a plurality of region of variation.

Figure 16 is the key diagram of the relation in a plurality of region of variation of expression and frame updating zone.Wherein, shown in Figure 16 (A), consider to exist the situation of overlapped 2 region of variation R1, R2.At this moment, at first shown in Figure 16 (B), with the mutual nonoverlapping adjacent rectangular area R11～R13 of becoming of region of variation R1, R2 with Region Segmentation.Then, the set of these rectangular areas R11～R13 is adopted as the frame updating zone.If use such frame updating region R 11～R13, then owing to avoiding repeating to transmit the view data of region of variation R1, R2 lap, so can reduce the data conveying capacity.In addition, under the mutual nonoverlapping situation of a plurality of region of variation, their former states ground is used as the frame updating zone.

In step S220, in the 106b of the image data storage zone of RAM106, obtain the view data of the image section suitable with the image update zone.Then, in step S230, according to predefined this view data of coded format conversion.

After the image among step S210～S230 transmits with the processing end, in step S240, VNC server 130 will transmit sign 106c and switch to the OFF state.Then, in step S250, generation comprises the view data of conversion and the frame updating message (Fig. 5) of region of variation information, is sent to projector 200 via network interface portion 112.

Transmit with during handling at image by VNC server 130 execution in step S210～S230, keep the ON state owing to transmit sign 106c, (step S120～S140) is in the state of wait so hook processing module 400 can not be carried out the processing corresponding with drawing command.About this advantage back narration.

In the step of Figure 15, use to transmit the reasons are as follows of processing that sign 106c coordinates hook processing module 400 and VNC server 130.Figure 17 represents not utilize the example of the problem when transmitting sign 106c.At this, suppose that VNC server 130 obtains the region of variation information 106a (information of region of variation Ra) of the moment t2 shown in Figure 13 (B), VNC server 130 from image data storage zone 106b obtain view data before by hook processing module 400 image image memory region 106b in be rewritten as the state of image shown in Figure 13 (C) thereafter.When hook processing module 400 and VNC server 130 are non-synchronously carried out respectively and handled when not utilizing transmission sign 106c, can produce such problem.Though VNC server 130 is obtained the view data of region of variation Ra from image data storage zone 106b, and the view data in this moment image data storage zone 106b is rewritten shown in Figure 13 (C).Therefore, the image of being obtained by VNC server 130 that is sent to projector 200 and is presented on the projection display picture 70 becomes image shown in Figure 17.The former image that should show of region of variation information 106a according to moment t2 is the image shown in Figure 13 (B) as can be seen, and the image of Figure 17 is undesired image.

Like this, when not utilizing transmission sign 106c, because non-synchronously (independently of each other promptly) execution processing of hook processing module 400 and VNC server 130, so the problem of the image section different may occur having transmitted with the former image section that should transmit.To this, according to treatment step shown in Figure 15, during VNC server 130 carries out image transmit with processing, transmit sign and maintain the ON state, thereby can be owing to the view data in the hook processing module 400 rewriting image data storage zone 106b.Therefore, can prevent the above-described problem from occurring.

Like this, in embodiment 3, hook processing module 400 also is hook and obtains specific drawing command in advance, carries out the write direct processing of RAM106 of the view data of region of variation.Its result can save in the comparative example shown in Figure 3 from VRAM114 to the needed time of RAM106 transmitted image data.Its result has the advantage that can accelerate the transfer rate when projector's 200 transmitted image data fully.In addition, indicate that 106c makes hook processing module 400 synchronous with the processing of VNC server 130 owing to use to transmit, so can prevent to transmit wrong image section.

D. embodiment 4

Figure 18 is the key diagram of hierarchy of the software and hardware of the computing machine of expression among the embodiment 4.Be with comparative example difference shown in Figure 3, between application program 122 and GDI124, appended hook processing module 400, in the RAM106 stored 2 kinds of region of variation information 106a1 and 106a2 (hereinafter referred to as " region of variation information A 1, A2 "), other structure is identical with Fig. 3.Be that with the difference of embodiment 1 shown in Figure 6 region of variation information 106a has 2 information 106a1,106a2, other structure is identical with embodiment 1.

Figure 19 is the hook processing module 400 of expression among the embodiment 4 and the process flow diagram of the action of VNC server 130.Step S10～S16 is carried out by hook processing module 400, and step S20～S26 is carried out termly by VNC server 130.Though whole flow processs of handling are identical with flow process shown in Figure 7, changed the content (back narration) of step S20, the S22 of VNC server.

Hook processing module 400, when when application program 122 has been sent specific drawing command, this drawing command of hook in step S10 replaces GDI124 to obtain this drawing command.

In step S12, carry out according to the drawing command login region of variation information processing that obtains.Specifically, hook processing module 400 obtains the position and the size in the zone of describing (the region of variation Ra of Fig. 4 (B)) according to drawing command, and execution will be represented write direct the processing among the RAM106 of the region of variation information A 1 of this domain transformation.

In step S16, hook processing module 400 is called common GDI function execution according to the drawing command of obtaining and is described to handle in step S10.In addition, display driver 126 is the same with comparative example shown in Figure 3 with driver 128 (Figure 18) of projector, according to the drawing command execution processing separately that receives from GDI124.That is, display driver 126 rendering image in VRAM114, projector's driver 128 will represent that the region of variation information A 2 of this description region writes in the RAM106.

On the other hand, VNC server 130 definite zone (being called " frame updating zone ") that should be sent to the view data of projector 200 in step S20.Figure 20 is the process flow diagram of the detailed step of the step S20 among the expression embodiment 4.In step S30, S32, obtain the 1st and the 2nd region of variation information A 1, A2.As mentioned above, the information in the 1st region of variation information A 1 zone that to be expression described by the image data storage zone 106b of hook processing module 400 in RAM106 is to write information in the RAM106 by hook processing module 400.On the other hand, the 2nd region of variation information A 2 is the information in the zone described in VRAM114 by display driver 126 of expression, is to write information in the RAM106 by projector's driver 128.

2 region of variation RA1, RA2 one example that Figure 21 (A) expression is represented with 2 region of variation information A 1, A2.At this, 2 region of variation RA1, RA2 are configured in the same picture area SCA.Wherein, so-called " picture area SCA " is meant all zones of the image that is stored among the VRAM114, and this all zone with image data storage zone 106b equates.Strictly speaking, though the 1st region of variation RA1 is that the 2nd region of variation RA2 is the zone with the address definition in the VRAM114 with the zone of the address definition in the 106b of image data storage zone, they can enough identical picture area SCA performances.

In addition, in the example of Figure 21 (A),, exist 2 region of variation RA1, RA2 to form the situation of various relations in addition though 2 region of variation RA1, RA2 are overlapped.For example, also there are 2 complete nonoverlapping situations of region of variation RA1, RA2, the situation that also exists both to overlap fully.For example, describe according to specific drawing command in hook processing module 400, thereafter, the common module 124,126,128 of describing is carried out under the situation that same area describes according to identical drawing command, and then 2 region of variation RA1, RA2 become identical.But, when carrying out identical drawing command, according to the setting of each module the phenomenon that there are some differences in 2 region of variation RA1, RA2 might appear also.

Figure 21 (B) expression VNC server 130 is directly obtained the regional TG1 of image from RAM106 when image transmits, Figure 21 (C) expression obtains the regional TG2 of image from VRAM114.Also these regional TG1, TG2 are called " transit area ".From this example as can be seen, the 1st region of variation RA1 (directly obtain in RAM106 by=TG1) image.On the other hand, the image that is not included in the regional TG2 of the part among the 1st region of variation RA1 among the 2nd region of variation RA2 is obtained from VRAM114.The reason of distinguishing like this is because reduce the image of obtaining from VRAM114 as far as possible, thereby reduces the cause that this obtains the needed time.For example, under the situation that 2 region of variation RA1, RA2 overlap fully, owing to do not need to obtain image from VRAM114, so can transmit processing at high speed.Figure 21 (D) expression is by the zone that VNC server 130 transmits all (frame updating zone TTG).This frame updating zone TTG be equivalent to the 1st and the 2nd region of variation RA1, RA2's and the zone.

In addition, have the situation that in the 1st region of variation information A 1, comprises a plurality of information corresponding with a plurality of drawing commands.In this case, the description region of these a plurality of drawing commands becomes the 1st region of variation RA1 with the zone.The 2nd region of variation RA2 too.

In the step S34 of Figure 20, calculate the poor of the region of variation RA1, the RA2 that represent by 2 kinds of region of variation information A 1, A2.Specifically, in the 2nd region of variation RA2, calculate the regional TG2 (Figure 21 (C)) that is not included among the 1st region of variation RA1.In step S36, carry out the optimized processing of frame updating zone TTG (Figure 21 (D)).

Figure 22 is the key diagram of content of the optimal treatment in expression frame updating zone.The frame updating zone TTG that Figure 22 (A) expression is identical with Figure 21 (D).In optimal treatment, shown in Figure 22 (B), TTG is divided into nonoverlapping adjacent rectangular area R11～R13 mutually with the frame updating zone.Then, the frame updating zone after adopting these rectangular areas R11～R13 as optimization.Because each frame updating region R 11～R13 is rectangle,, can reduce the image data amount of transmission so compare with the situation of the image of the such rectangular shape of the frame updating zone TTG before transmission comprises optimization.

In the step S22 of Figure 19, obtain the view data of the image section suitable with the frame updating zone.Figure 23 is the process flow diagram of the detailed step of the step S22 among the expression embodiment 4.Whether in step S40, verifying the 2nd transit area TG2 (Figure 21 (C)) is empty.When the 2nd region of variation information A 2 does not exist and the 2nd region of variation A2 when being completely contained among the 1st region of variation A1, the 2nd transit area TG2 is empty.When the 2nd transit area TG2 is sky, transfer to the step S44 that narrates later.On the other hand, when the 2nd transit area TG2 is not sky, execution in step S42.In step S42, the view data that VNC server 130 is obtained the 2nd transit area TG2 from VRAM114 writes the image data storage zone 106b in the RAM106.Its result is in the whole stored states of image in the frame updating zone TTG shown in Figure 21 (D) among the 106b of image data storage zone.In step S44, VNC server 130 is obtained the view data of frame updating zone TTG from the image data storage zone 106b of RAM106.It is in addition, actual that what obtain is the view data of each frame updating region R 11～R13 (Figure 22 (B)) after the optimal treatment.

In the step S24 of Figure 19, according to predefined coded format changing image data.In step S26, generation comprises the view data of such conversion and the frame updating message (Fig. 5) of region of variation information, is sent to projector 200 via network interface portion 112.

Like this, in embodiment 4, also be hook processing module 400 hooks and obtain specific drawing command in advance, carry out the write direct processing of RAM106 of the view data of region of variation.Its result can save in the comparative example shown in Figure 3 from VRAM114 to the needed time of RAM106 transmitted image data.Its result has the advantage that can accelerate the transfer rate when projector's 200 transmitted image data fully.

In addition, in the foregoing description 4,, obtain and be sent to projector 200 from VRAM114 less than the image section of the regional TG2 (Figure 21 (C)) that describes by hook processing module 400.Its result is sent to projector 200 by common module 124,126,128 image represented of describing with also can having no loss.

E. embodiment 5

Figure 24 is the region of variation of expression among the embodiment 5 and the key diagram of the relation in frame updating zone, is the figure corresponding with Figure 21 of embodiment 4.Though whole apparatus structures of embodiment 5 are identical with embodiment 4 with treatment scheme, the zone that becomes transmission object is different with embodiment 4.Specifically, in embodiment 5, the 1st transit area TG1 (Figure 24 (B)) that directly obtains image from RAM106 is set at the 1st and the 2nd region of variation RA1, RA2 superposed part, in other words, the 1st transit area TG1 is set at the zone among the 1st region of variation RA1 of being also contained in the 2nd region of variation RA2.On the other hand, the same part among the 1st region of variation RA1 of not being included in that is set among the 2nd region of variation RA2 of the 2nd transit area TG2 (Figure 24 (C)) that obtains image from VRAM114 and embodiment 4.Therefore, all frame updating zone TTG (Figure 24 (D)) as the zone of transmission object are identical with the 2nd region of variation RA2.

Like this, in embodiment 5, transmit by VNC server 130 as the image in the 2nd region of variation RA2 in the zone of in VRAM114, describing by GDI124 and display driver 126.The reason of handling like this is as follows.That is, because the drawing command of being handled by hook processing module 400 hooks is also carried out by GDI124 and display driver 126 thereafter, once more so all basically drawing commands are by GDI124 and display driver 126 execution.Therefore, as long as transmit the image of the 2nd region of variation RA2, just can in projector 200, show correct image.But, when from VRAM114, obtaining all view data this moment, can produce the problem that data transmit needs considerable time.Therefore, in embodiment 5,, shortened data and obtained the needed time by directly obtaining view data from RAM106 for the part that is included among the 1st region of variation RA1 among the 2nd region of variation RA2.In addition, in embodiment 5, still less be preferable over embodiment 4 on this point than embodiment 4 at the image data amount that transmits.

In addition, under many circumstances, consistent by hook processing module 400 zone of describing (the 1st region of variation RA1) and the zone of describing by GDI124 and display driver 126 (the 2nd region of variation RA2).Therefore, as embodiment 5, even the image that is not included in the part among the 2nd region of variation RA2 that omits among the 1st region of variation RA1 transmits, being presented at the possibility that image in the projector 400 produces inharmonious sense also is the degree that can ignore.To this, in the above embodiments 4, since among the 1st region of variation RA1 with the 2nd region of variation RA2 non-overlapping portions also transmitted image, so hypothesis also has and can transmit the advantage of image more completely under the situation that the 1st and the 2nd region of variation RA1, RA2 differ widely.

In addition, VNC server 130 also can constitute and can handle 1 execution of selection a plurality of transfer modes of (being also referred to as " the 2nd transfer mode ") from the transmission that (being also referred to as " the 1st transfer mode ") and embodiment 5 are handled in the transmission that comprises embodiment 4.The selection of transfer mode can be undertaken by the user, perhaps, also can be that VNC server 130 automatically carries out the selection of transfer mode according to the processing power (processing speed of CPU or the transfer rate of bus etc.) of computing machine 100 (generally being image supply device).Like this, can select to transmit with suitable transfer rate the transfer mode of desirable image.

F. embodiment 6

Figure 25 is the key diagram of hierarchy of the software and hardware of the computing machine of expression among the embodiment 6.And comparative example difference shown in Figure 3 is to have appended hook processing module 400 between application program 122 and GDI124, in the RAM106 stored 2 kinds of region of variation information 106a1 and 106a2 (hereinafter referred to as " region of variation information A 1, A2 ") and in the RAM106 stored transmission record information 106d (hereinafter referred to as " transmitting record information HA1 "), other structure is identical with Fig. 3.Be to have appended transmission record information 106d with the difference of embodiment 4 shown in Figure 180, other structure is identical with embodiment 4.

Figure 26 is the key diagram of the example of expression 2 region of variation information A 1, A2 and transmission record information HA1.Figure 26 (A-1)～(A-3) expression is the state of t0 constantly, and Figure 26 (B-1)～(B-3) expression is the state of t1 constantly.Suppose that VNC server 130 repeats transmission with designated time intervals and handles, carry out at moment t0 and transmit the back in moment t1 execution transmission next time.

The region R A1 (being called " region of variation RA1 ") that the 1st region of variation information A 1 expression shown in Figure 26 (A-1) is directly described by the image data storage zone 106b of hook processing module 400 (Figure 25) in RAM106.Image in this region of variation RA1 is called " image G1 ".The 1st region of variation information A 1 is write in the RAM106 by hook processing module 400.The 2nd region of variation information A 2 expressions shown in Figure 26 (A-2) are depicted in the interior region R A2 (being called " region of variation RA2 ") of VRAM114 by display driver 126 (Figure 25).Image in this region of variation RA2 is called " image G2 ".The 2nd region of variation information A 2 is write in the RAM106 by projector's driver 128.Transmission record information HA1 shown in Figure 26 (A-3) be illustrated in advance appointment during directly be depicted in image data storage zone 106b's and past of transmitting by VNC server 103 the 1st region of variation RA1 (being called " resume zone ") by hook processing module 400.In the present embodiment, the 1st region of variation that only will become transmission object in transmission is before handled is set as the resume zone.But, also can be with the region of variation in the repeatedly transmission processing of going ahead of the rest as the resume zone.The 1st region of variation RA1 did not exist during transmission before moment t0 was handled, and therefore, supposed to login transmission record information HA1 at moment t0 yet.In addition, transmitting record information HA1 is write in the RAM106 by VNC server 130.

In addition, in the example of Figure 26, represent the state of each area configurations in same picture area SCA.Wherein, so-called " picture area SCA " expression is stored in all zones of the image among the VRAM114, and this equates with all zone of the regional 106b of image data storage.Strictly speaking, though the 1st region of variation RA1 is that the 2nd region of variation RA2 is the zone with the address definition in the VRAM114 with the zone of the address definition in the 106b of image data storage zone, they can enough identical picture area SCA performances.

Shown in Figure 26 (B-1)～(B-3), at moment t1, the 1st region of variation information A 1 does not exist, and the 2nd region of variation information A 2 is the information in the zone (that is, with moment t0 the identical zone of the 1st region of variation RA1) of presentation video G1.In this state, the drawing command of this image G1 was handled by hook processing module 400 hooks before moment t0, after this, was producing when module 124,126,128 is handled by describing between moment t0 and the t1.In addition, shown in Figure 26 (B-3) °, at moment t1, the 1st region of variation information A 1 of t0 is as transmitting record information HA1 login constantly.In Figure 26 (B-3), for the ease of diagram, draw resume region R HA1 in the transmission processing (processing that VNC server 130 carries out) of following explanation with the single-point line, these transmission of t0, t1 are constantly handled describing.

Figure 27 is the hook processing module 400 of expression among the embodiment and the process flow diagram of the action of VNC server 130.Step S10～S16 is carried out by hook processing module 400, and step S20～S26 is carried out termly by VNC server 130.Though whole flow processs of handling with shown in Figure 19 identical, have changed the content (back narration) of step S20, the S22 of VNC server.

When application program 122 is sent specific drawing command, hook processing module 400 is this drawing command of hook in step S10, replaces GDI124 to obtain this drawing command.

In step S12, carry out according to the drawing command login region of variation information processing that obtains.Specifically, hook processing module 400 obtains the position and the size in the zone of describing (the region of variation RA1 of Figure 26 (A-1)) according to drawing command, and execution will be represented write direct the processing among the RAM106 of the region of variation information A 1 of this region of variation.

In step S14, carry out region of variation RA1 view data write processing.Specifically, hook processing module 400 is launched view data in the region of variation RA1 according to drawing command, and execution is with write direct the processing among the image data storage zone 106b in the RAM106 of this view data.

In step S16, hook processing module 400 is called common GDI function execution according to the drawing command of obtaining at step S10 and is described to handle.In addition, display driver 126 is the same with comparative example shown in Figure 3 with driver 128 (Figure 25) of projector, according to the drawing command execution processing separately that receives from GDI124.That is, display driver 126 rendering image in VRAM114, projector's driver 128 will represent that the region of variation information A 2 of this description region writes in the RAM106.

On the other hand, VNC server 130 definite zone (being called " frame updating zone ") that should be sent to the view data of projector 200 in step S20.Figure 28 is the process flow diagram of the detailed step of the step S20 among the expression embodiment 6.In step S50, S52, obtain the 1st and the 2nd region of variation information A 1, A2.As mentioned above, to be expression be depicted in the information in the zone among the image data storage zone 106b in the RAM106 by hook processing module 400 to the 1st region of variation information A 1, is to write information in the RAM106 by hook processing module 400.On the other hand, the 2nd region of variation information A 2 is that expression is depicted in the information in the zone in the VRAM114 by display driver 126, is to write information in the RAM106 by projector's driver 128.

Figure 29 (A) expression constantly 2 region of variation RA1, the RA2 of t0 and resume region R HA1 still, HA1 does not exist in moment t0 resume region R.

In addition, in the example of Figure 29 (A),, exist 2 region of variation RA1, RA2 to form the situation of various relations in addition though 2 region of variation RA1, RA2 are overlapped.For example, also there are 2 complete nonoverlapping situations of region of variation RA1, RA2, the situation that also exists both to overlap fully.For example, describe according to specific drawing command in hook processing module 400, thereafter, the common module 124,126,128 of describing is carried out under the situation that same area describes according to identical drawing command, and then 2 region of variation RA1, RA2 become identical.But, when carrying out identical drawing command, according to the setting of each module the phenomenon that there are some differences in 2 region of variation RA1, RA2 might appear also.

VNC server 130 was directly obtained the regional TG1 of image when Figure 29 (B) was illustrated in moment t0 from RAM106 when image transmits, and Figure 29 (C) expression obtains the regional TG2 of image from VRAM114.These regional TG1, TG2 are also referred to as " transit area ".From this example as can be seen, when transmission resume HA1 does not exist, the 1st region of variation RA1 (directly obtain in RAM106, and in addition, the image of the regional TG2 that is not included in the part among the 1st region of variation RA1 among the 2nd region of variation RA2 is obtained from VRAM114 by=TG1) image.Qu Bie reason is the image of obtaining from VRAM114 in order to reduce as far as possible like this, obtains the needed time to reduce this.For example, when 2 region of variation RA1, RA2 complete when overlapping owing to do not need to obtain image, so can transmit processing at high speed from VRAM114.Figure 29 (D) is illustrated in moment t0 by the zone that VNC server 130 transmits all (frame updating zone TTG).This frame updating zone TTG be equivalent to the 1st and the 2nd region of variation RA1, RA2's and the zone.

In addition, there is the situation that comprises a plurality of information corresponding in the 1st region of variation information A 1 with a plurality of drawing commands.In this case, the description region of these a plurality of drawing commands becomes the 1st region of variation RA1 with the zone.The 2nd region of variation RA2 too.

In the step S54 of Figure 28, calculate the poor of the region of variation RA1, the RA2 that represent with 2 kinds of region of variation information A 1, A2.Specifically, calculate the regional TG2 (Figure 29 (C)) among the 1st region of variation RA1 of not being included among the 2nd region of variation RA2.

In step S56, obtain and transmit record information HA1, in step S58, calculate the poor of resume region R HA1 and the 2nd region of variation RA2.The processing of this step S58 is the processing that is used to adjust the 2nd transit area TG2 (obtaining the zone of image during transmission from VRAM114).Do not exist owing to transmit record information HA1, so relevant this contents processing illustrates later on according to the processing at moment t1 at moment t0.In step S60, the discarded record information HA1 that transmits in step S62, logins the 1st region of variation information A 1 as transmitting record information HA1.Its result, the 1st region of variation information A 1 of t0 can be as next transmission record information HA1 utilization of t1 constantly constantly.

In step S64, carry out the optimal treatment of frame updating zone TTG (Figure 29 (D)).Figure 30 is the key diagram of content of the optimal treatment in expression frame updating zone.The frame updating zone TTG that Figure 30 (A) expression is identical with Figure 29 (D).In optimal treatment, shown in Figure 30 (B), TTG is divided into nonoverlapping adjacent rectangular area R11～R13 mutually with the frame updating zone.Then, adopt in the frame updating zone of these rectangular areas R11～R13 after as optimization.Because each frame updating region R 11～R13 is rectangle,, can reduce the image data amount of transmission so compare with the situation of the image of the such rectangular shape of the frame updating zone TTG before transmission comprises optimization.

In the step S22 of Figure 27, obtain the view data of the image section suitable with the frame updating zone.Figure 31 is the process flow diagram of the detailed step of the step S22 among the expression embodiment 6.Whether in step S70, verifying the 2nd transit area TG2 (Figure 29 (C)) is empty.In addition, as mentioned above, " the 2nd transit area TG2 " is the zone of obtaining view data in the TTG of frame updating zone from VRAM114.When the 2nd region of variation information A 2 does not exist, and be completely contained in the 1st region of variation A1 and resume zone as the 2nd region of variation A2 with the zone in the time, the 2nd transit area TG2 is empty.When the 2nd transit area TG2 is sky, transfer to step S74 described later.On the other hand, when the 2nd transit area TG2 is not sky, execution in step S72.In step S72, the view data that VNC server 130 is obtained the 2nd transit area TG2 from VRAM114 writes the image data storage zone 106b in the RAM106.Its result is in the state that image data storage zone 106b stores the image in the frame updating zone TTG shown in all Figure 29 (D).In step S74, VNC server 130 is obtained the view data of frame updating zone TTG from the image data storage zone 106b of RAM106.It is in addition, actual that what obtain is the view data of each frame updating region R 11～R13 (Figure 30 (B)) after the optimal treatment.

In the step S24 of Figure 27, according to predefined coded format changing image data.In step S26, generation comprises the view data of such conversion and the frame updating message (Fig. 5) of region of variation information, is sent to projector 200 via network interface portion 112.

At moment t1, carry out the processing of step S20～S26 of Figure 27 too.But at moment t1, shown in Figure 26 (B-1)～(B-3), the 1st region of variation information A 1 does not exist, and the 2nd region of variation information A 2 is the information in the zone of presentation video G1, and transmitting record information HA1 also is the information in the zone of presentation video G1.

Figure 32 is the expression key diagram of the relation in the region of variation of t1 and resume zone and frame updating zone constantly.Shown in Figure 32 (A), the 1st region of variation RA1 does not exist, and the 2nd region of variation RA2 is identical with resume region R HA1.At this moment, in the processing of the step S54 of Figure 28, the part that is not included among the 1st region of variation RA1 among the 2nd region of variation RA2 is generated as the 2nd transit area TG2 (Figure 32 (B)).In addition, in the processing of the step S58 of Figure 28, the part of deletion resume region R HA1 from the 2nd transit area TG2.Figure 32 (D) represents this revised the 2nd transit area TG2 '.In this example, because the 2nd region of variation RA2 is identical with resume region R HA1, so revised the 2nd transit area TG2 ' is empty.On the other hand, append among the 1st transit area TG1 (directly obtaining the zone of image from RAM106) (Figure 32 (C)) from the zone of the 2nd transit area TG2 deletion.At moment t1, because the 2nd transit area TG2 ' is empty, thus not to obtain image from VRAM114, but directly obtain and transmit all of the interior image of frame updating zone TTG (Figure 32 (E)) from image data storage zone 106b.

From the example of Figure 29 and Figure 32 as can be seen, the frame updating zone TTG that becomes the object that image transmits and resume region R HA1 have or not that it doesn't matter, and it is definite with the zone as the 1st and the 2nd region of variation RA1, RA2's.Resume region R HA1 directly obtains the 1st transit area TG1 of view data and the 2nd transit area TG2 (perhaps TG2 ') that obtains from VRAM114 and using in order to determine from image data storage zone 106b.Specifically, among the 1st region of variation RA1 and the 2nd region of variation RA2 be included in zone among the resume region R HA1 become the 1st transit area TG1 in addition with the zone, the zone that is not included in any one of the 1st region of variation RA1 and resume region R HA1 among the 2nd region of variation RA2 becomes the 2nd transit area TG2 (perhaps TG2 ').In addition, also can think the 1st transit area TG1 be among the 1st region of variation RA1 and the 2nd region of variation RA2 be not included among the 1st region of variation RA1 and be included in zone among the resume region R HA1 and the zone.By dividing the 1st and the 2nd transit area TG1, TG2 in this wise, can reduce the amount of the view data that obtains from VRAM114.

In addition, when hypothesis is not used the situation that transmits record information HA1, then should obtain the image of the 2nd region of variation RA2 from VRAM114 at moment t1.To this, in the present embodiment, VRAM114 can not visited and image data storage zone 106b in the RAM106 directly obtains the image of this region of variation RA2.Its reason is because this region of variation RA2 directly was depicted in by hook processing module 400 among the 106b of image data storage zone in the moment before this, so even do not obtain also and can obtain correct image from image data storage zone 106b from VRAM114.From this explanation as can be seen, in the present embodiment, can reduce because the possibility that must obtain a large amount of view data that the execution of drawing command regularly causes with the transmission deviation regularly of image from VRAM114.

Figure 33 is the key diagram of other example of expression 2 region of variation information A 1, A2 and transmission record information HA1.The a certain state that transmits moment t10 regularly of Figure 33 (A-1)～(A-3) expression, Figure 33 (B-1)～(B-3) are represented its next state that transmits moment t11 regularly.At moment t10,2 region of variation A1a, the A1b of RA1a, the RA1b of the region of variation of expression 2 image G1, G2 are as the 1st region of variation information A 1 login that becomes process object.In addition, have only the information of the region of variation RA2 of the image G1 that represents the side among these 2 image G1, G2 to login as the 2nd region of variation information A 2.In addition, suppose that transmitting record information HA1 at moment t10 does not exist.On the other hand, at moment t11, the 1st region of variation information A 1 does not exist, and has logined the information of the region of variation of presentation video G2 as the 2nd region of variation information A 2.In addition, 2 region of variation information A 1a, the A1b of t0 have constantly been logined as transmitting record information HA1.

In the transmission of moment t10 was handled, shown in Figure 34 (A), 2 kinds of region of variation RA1, RA2 adopted with the frame updating zone TTG of zone as transmission object.This frame updating zone TTG equates with the zone with the 1st region of variation RA1a, the RA1b's shown in Figure 33 (A-1).Therefore, the image in the TTG of this frame updating zone does not need to obtain from VRAM114, and all directly obtains from image data storage zone 106b.

In the transmission of moment t11 is handled, owing to the 1st region of variation RA1 does not exist, so shown in Figure 34 (B), the 2nd region of variation RA2 former state ground adopts as frame updating zone TTG.But the 2nd region of variation RA2 is completely contained among resume region R HA1a, the RHA1b (Figure 33 (B-3)).Therefore, the image of the frame updating of t11 zone TTG does not need to obtain from VRAM114 yet constantly, and all directly obtains from image data storage zone 106b.

Like this, in embodiment 6, also be hook processing module 400 hooks and obtain specific drawing command in advance, carry out the write direct processing of RAM106 of the view data of region of variation.Its result can save in the comparative example shown in Figure 3 and transmit the needed time from VRAM114 to the view data of RAM106.Its result has the advantage that can accelerate the transfer rate when projector's 200 transmitted image data fully.

In addition, in the foregoing description 6, projector 200 is obtained and be sent to the image section that is not included in the regional TG2 in any one of the 1st region of variation RA1 and resume region R HA1 among the 2nd region of variation RA2 from VRAM114.Its result is sent to projector 200 by common module 124,126,128 image represented of describing with also can having no loss.

G. embodiment 7

Figure 35 is the region of variation of expression among the embodiment 7 and the key diagram of the relation in frame updating zone, is the figure corresponding with Figure 29 of embodiment 6.Though embodiment 7 its whole apparatus structures or treatment scheme are identical with embodiment 6, the zone that becomes transmission object is different with embodiment 6.Specifically, in embodiment 7, the 1st transit area TG1 (Figure 35 (B)) that directly obtains image from RAM106 is set at the 1st and the 2nd region of variation RA1, RA2 superposed part.In other words, the 1st transit area TG1 is set at the zone among the 1st region of variation RA1 of being also contained among the 2nd region of variation RA2.On the other hand, obtain the 2nd transit area TG2 (Figure 35 (C)) of image from VRAM114, the same with embodiment 6, be set at and be not included in part among the 1st region of variation RA1 among the 2nd region of variation RA2.Therefore, all frame updating zone TTG (Figure 35 (D)) as the zone that becomes transmission object are identical with the 2nd region of variation RA2.

In addition, as Figure 26 explanation, do not exist, so the image section in the 2nd transit area TG2 (Figure 35 (C)) is all obtained from VRAM114 owing to transmit record information HA1 at moment t0.But, the same with embodiment 6 when transmitting record information HA1 and exist, from the 2nd transit area TG2, delete among the 2nd transit area TG2 and the zone resume region overlapping, fall it and be appended among the 1st transit area TG1 (with reference to Figure 32).In other words, the image section that is included in the zone in any one of the 1st region of variation RA1 and resume region R HA1 among the 2nd region of variation RA2 is directly obtained from RAM106.In addition, the image section that is not included in the zone in any one of the 1st region of variation RA1 and resume region R HA1 among the 2nd region of variation RA2 is obtained from VRAM114.Therefore, the processing of moment t1 shown in Figure 32, also the same in embodiment 7 with embodiment 6.

Like this, in embodiment 7, transmit by VNC server 130 as the image in the 2nd region of variation RA2 that is depicted in the zone in the VRAM114 by GDI124 and display driver 126.The reason of handling in this wise is as follows.That is,, carry out once more by GDI124 and display driver 126 thereafter, so all basically drawing commands are all carried out by GDI124 and display driver 126 owing to the drawing command of handling by hook processing module 400 hooks.Therefore, if transmit the image of the 2nd region of variation RA2, then can in projector 200, show correct image.But, obtain all view data when this moment from VRAM114, can be created in the problem that needs the long duration in the data transmission.Therefore, in embodiment 7,, shortened data and obtained the needed time by directly obtaining view data from RAM106 for the part that is included in any one of the 1st region of variation RA1 and resume region R HA1 among the 2nd region of variation RA2.In addition, in embodiment 7, also lack than embodiment 6 at the image data amount that transmits and to be preferable over embodiment 6 on this point.

In addition, in most of the cases, consistent by hook processing module 400 zone of describing (the 1st region of variation RA1) and the zone of describing by GDI124 and display driver 126 (the 2nd region of variation RA2).Therefore, as embodiment 7, even the image that is not included in the part among the 2nd region of variation RA2 that omits among the 1st region of variation RA1 transmits, the possibility of the inharmonious sense that the image that shows in projector 400 produces also is the degree that can ignore.To this, in the above embodiments 6, since among the 1st region of variation RA1 with the 2nd region of variation RA2 non-overlapping portions also transmitted image, so hypothesis also has and can transmit the advantage of image more completely under the situation that the 1st and the 2nd region of variation RA1, RA2 differ widely.

Figure 36 is the key diagram of another example of 2 region of variation information A 1, A2 and transmission record information HA1 among the expression embodiment 7.At the moment t20 shown in Figure 36 (A-1)～(A-3), logined information A 1a, the A1b of the region R A1a, the RA1b that represent 2 image G10, G20 as the 1st region of variation information A 1, logined the region R A2 that represents the 1st image G10 (=RA1a) information A 2 as the 2nd region of variation information A 2.At this, for convenience of explanation, suppose that the 1st image G10 occupies all images of picture area SCA, in addition, the 2nd image G11 is the image that slides to the right.This state for example produces when the animation effect setting as image object skids off.Transmitting record information HA1 at moment t20 does not exist.

At the moment t21 shown in Figure 36 (B-1)～(B-3), the 1st region of variation information A 1 does not exist, and has region R A2 as the 2nd region of variation information A 2 expressions the 2nd image G11 (=RA1b) information A 2.In addition, as transmitting record information HA1, the moment t20 has before this logined 2 the 1st region of variation information A 1a, A1b that are present in the RAM106.Like this, in the example of Figure 36, the login of also supposing the 1st region of variation information A 1 of being undertaken by hook processing module 400 regularly regularly has deviation slightly with the login of the 2nd region of variation information A 2 of being undertaken by projector's driver 128.

Figure 37 is the moment t20 of expression embodiment 7 and the key diagram in the frame updating zone of moment t21.As mentioned above, in embodiment 7, TTG is identical with the 2nd region of variation RA2 all the time in the frame updating zone.The image section that is included in the zone in any one of the 1st region of variation RA1 and resume region R HA1 among the 2nd region of variation RA2 is directly obtained from RAM106, and the image section that is not included in the zone in any one of the 1st region of variation RA1 and resume region R HA1 is obtained from VRAM114.As shown in figure 36, at moment t20, the 2nd region of variation RA2 is included among the 1st region of variation RA1a, the RA1b.In addition, at moment t21, the 2nd region of variation RA2 is included among resume region R HA1a, the RHA1b.Therefore, directly obtain from RAM106 at all images of moment t20, t21.

Shown in the example of Figure 36, utilizing the animation effect image carrying out at a high speed when mobile, the timing of the login of the 1st and the 2nd region of variation A1, A2 produces the possibility height of deviation.At this moment, when hypothesis utilize to transmit record information HA1, can appear at t21 constantly and need obtain all problems of image in the 2nd region of variation RA2 from VRAM114.To this, in embodiment 6,7, owing to directly obtain the image section that transmits in the resume region R HA1 from RAM106, so can shorten the needed time of obtaining of image.

In addition, VNC server 130 also can constitute the transmission of handling (being also referred to as " the 1st transfer mode ") and embodiment 7 from the transmission that comprises embodiment 6 and handle 1 execution of selection a plurality of transfer modes of (being also referred to as " the 2nd transfer mode ").The selection of transfer mode can be undertaken by the user, perhaps, also can be that processing power (processing speed of CPU or the transfer rate of bus etc.) the VNC server 130 according to computing machine 100 (generally being image supply device) automatically carries out the selection of transfer mode.Like this, then can select to transmit with suitable transfer rate the transfer mode of desirable image.

H. embodiment 8

Figure 38 is the key diagram of hierarchy of the software and hardware of the computing machine of expression among the embodiment 8.Be with the difference of comparative example shown in Figure 3, between application program 122 and GDI124, appended hook processing module 400, in the RAM106 stored 2 kinds of region of variation information 106a1 and 106a2 (hereinafter referred to as " region of variation information A 1; A2 "), in the RAM106 stored transit area information 106s (hereinafter referred to as " transit area information RS again ") again, other structure is identical with Fig. 3.Be to have appended transit area information 106s again with the difference of embodiment 4 shown in Figure 180, other structure is identical with embodiment 4.

Figure 39 is 2 region of variation information A 1 of expression, A2 and the key diagram of the example of transit area information RS again.Figure 39 (A-1)～(A-3) expression is the state of t100 constantly, and Figure 39 (B-1)～(B-3) expression is the state of t101 constantly.Suppose that VNC server 130 repeats transmission with designated time intervals and handles, after moment t100 carries out transmission, carry out transmission next time at moment t101.

The 1st region of variation information A 1 expression shown in Figure 39 (A-1) directly is depicted in the region R A1 (being called " region of variation RA1 ") of the image data storage zone 106b in the RAM106 by hook processing module 400 (Figure 38).Image in this region of variation RA1 is called " image G1 ".The 1st region of variation information A 1 is write in the RAM106 by hook processing module 400.The 2nd region of variation information A 2 expressions shown in Figure 39 (A-2) are depicted in the interior region R A2 (being called " region of variation RA2 ") of VRAM114 by display driver 126 (Figure 38).Image in this region of variation RA2 is called " image G2 ".The 2nd region of variation information A 2 is write in the RAM106 by projector's driver 128.The information of transit area again RS shown in Figure 39 (A-3) is illustrated in the 1st region of variation RA1 (being called " transit area RRS again ") that directly is depicted in the past of being transmitted by VNC server 130 behind the 106b of image data storage zone by hook processing module 400.During transmission before moment t100 was handled, the 1st region of variation RA1 did not exist, and therefore hypothesis is in moment t100 also not login of transit area information RS again.In addition, transit area information RS is write in the RAM106 by VNC server 130 again.

In addition, the example of Figure 39 represents that each region R A1, RA2, RRS are configured in the state in the same picture area SCA.Wherein, so-called " picture area SCA " expression is stored in all zones of image among the VRAM114, and this equates with all zone of the regional 106b of image data storage.Strictly speaking, though the 1st region of variation RA1 is the zone with the address definition in the 106b of image data storage zone, the 2nd region of variation RA2 and again transit area RRS be zone with the address definition in the VRAM114, but their can enough identical picture area SCA performances.

Shown in Figure 39 (B-1)～(B-3), at moment t101, the 1st and the 2nd region of variation information A 1, A2 do not exist, and transit area information RS is the information in the zone (that is, with moment t100 the identical zone of the 1st region of variation RA1) of presentation video G1 again.In addition, in Figure 39 (B-3), for the ease of diagram, with the single-point line transit area RRS again that draws.

As described below, VNC server 130 is carried out common transmission at moment t100 according to region of variation information A 1, A2 and is handled (being also referred to as " transfer mode usually ").In addition, owing to do not have region of variation A1, an A2, handle (being also referred to as " transfer mode again ") at moment t101 so carry out to transmit again according to transit area information RS again.

In addition,, do not carry out transmission again at moment t100 yet and handle, transmit processing usually and carry out even hypothesis has been logined transit area information RS again at moment t100.That is, when any one of 2 region of variation information A 1, A2 exists, carry out to transmit usually and handle, when 2 region of variation information A 1, A2 both sides do not exist and transit area information RS exists again, carry out to transmit again and handle.

Figure 40 is the hook processing module 400 of expression among the embodiment 8 and the process flow diagram of the action of VNC server 130.Step S10～S16 is carried out by hook processing module 400, and step S20～S26 is carried out termly by VNC server 130.Whole flow processs of handling are identical with flow process shown in Figure 19, but changed the content (back narration) of step S20, the S24 of VNC server.

Hook processing module 400 when when application program 122 has been sent the certain illustrative order, at this drawing command of step S10 hook, replaces GDI124 to obtain this drawing command.

In step S12, carry out according to the drawing command login region of variation information processing that obtains.Specifically, hook processing module 400 obtains the position and the size in the zone of describing (the region of variation RA1 of Figure 39 (A-1)) according to drawing command, and execution will be represented the write direct processing of RAM106 of the region of variation information A 1 of this region of variation.

In step S14, carry out region of variation RA1 view data write processing.Specifically, hook processing module 400 is launched view data in the region of variation RA1 according to drawing command, and execution is with the write direct processing of the image data storage zone 106b in the RAM106 of this view data.

In step S16, hook processing module 400 is called common GDI function execution according to the drawing command of obtaining at step S10 and is described to handle.In addition, display driver 126 is the same with comparative example shown in Figure 3 with driver 128 (Figure 38) of projector, according to the drawing command execution processing separately that receives from GDI124.That is, display driver 126 rendering image in VRAM114, projector's driver 128 will represent that the region of variation information A 2 of this description region writes in the RAM106.

On the other hand, VNC server 130 is in the definite zone (being called " frame updating zone ") that should be sent to the view data of projector 200 of step S20.Figure 41 is the process flow diagram of the detailed step of the step S20 among the expression embodiment 8.At step S300, will transmit sign again and be set at OFF.Whether this transmits sign again is to represent carry out to transmit the sign of handling again.Transmit the ON state representation of sign again and carry out transmission processing again, the OFF state representation is carried out and is transmitted processing usually.In addition, transmit the sign login again in RAM106.

In step S302, S304, obtain the 1st and the 2nd region of variation information A 1, A2.As mentioned above, to be expression be depicted in the information in the zone of the image data storage zone 106b in the RAM106 by hook processing module 400 to the 1st region of variation information A 1, is to write information in the RAM106 by hook processing module 400.On the other hand, the 2nd region of variation information A 2 is that expression is depicted in the information in the zone in the VRAM114 by display driver 126, is to write information in the RAM106 by projector's driver 128.

Figure 42 (A) expression is 2 region of variation RA1, RA2 and the transit area RRS again of t100 (Figure 39 (A-1)～(A-3)) constantly.But, moment t100 again transit area RRS do not exist.

In addition, in the example of Figure 42 (A),, exist 2 region of variation RA1, RA2 to form the situation of various relations in addition though 2 region of variation RA1, RA2 are overlapped.For example, also there are 2 complete nonoverlapping situations of region of variation RA1, RA2, the situation that also exists both to overlap fully.For example, describe according to specific drawing command in hook processing module 400, thereafter, the common module 124,126,128 of describing is carried out under the situation that same area describes according to identical drawing command, and then 2 region of variation RA1, RA2 become identical.But, when carrying out identical drawing command, according to the setting of each module the phenomenon that there are some differences in 2 region of variation RA1, RA2 might appear also.

VNC server 130 was directly obtained the regional TG1 of image when Figure 42 (B) was illustrated in moment t100 from RAM106 when image transmits, and Figure 42 (C) expression obtains the regional TG2 of image from VRAM114.Also these regional TG1, TG2 are called " transit area ".From this example as can be seen, usually transmitting in the processing, the 1st region of variation RA1 (directly obtain from RAM106, and in addition, the image that is not included in the subregion TG2 among the 1st region of variation RA1 among the 2nd region of variation RA2 is obtained from VRAM114 by=TG1) image.Difference is the image of obtaining from VRAM114 in order to reduce as far as possible like this, obtains the needed time to reduce this.For example, when 2 region of variation RA1, RA2 overlap fully, owing to do not need to obtain image from VRAM114, so can transmit processing at high speed.Figure 42 (D) is illustrated in moment t100 by the zone that VNC server 130 transmits all (frame updating zone TTG).This frame updating zone TTG be equivalent to the 1st and the 2nd region of variation RA1, RA2's and the zone.

In addition, exist in the situation that comprises a plurality of information corresponding in the 1st region of variation information A 1 with a plurality of drawing commands.In this case, the description region of these a plurality of drawing commands becomes the 1st region of variation RA1 with the zone.For the 2nd region of variation RA2 with transit area RRS is too again.

In the step S306 of Figure 41, judge whether 2 region of variation RA1, RA2 both sides are empty.When 2 region of variation RA1, RA2 both sides are sky, carry out among Xu Shu the step S314 in the back to transmit again and handle.On the other hand, when any one of 2 region of variation RA1, RA2 when not being empty, in step S308～S312, carry out to transmit usually and handle.

In the step S308 of Figure 41, calculate the poor of the region of variation RA1, the RA2 that represent with 2 kinds of region of variation information A 1, A2.Specifically, calculate the regional TG2 (Figure 42 (C)) among the 1st region of variation RA1 of not being included among the 2nd region of variation RA2.

In step S310, the 1st region of variation information A 1 is appended as transit area information RS again.Its result, the 1st region of variation information A 1 of t100 can be in next transit area information RS utilization again of t101 conduct later on constantly constantly.

In step S312, carry out the optimal treatment of frame updating zone TTG (Figure 42 (D)).Figure 43 is the key diagram of the optimal treatment content in expression frame updating zone.The frame updating zone TTG that Figure 43 (A) expression is identical with Figure 42 (D).In optimal treatment, shown in Figure 43 (B), TTG is divided into nonoverlapping adjacent rectangular area R11～R13 mutually with the frame updating zone.Then, adopt in the frame updating zone of these rectangular areas R11～R13 after as optimization.Because each frame updating region R 11～R13 is rectangle,, can reduce the image data amount of transmission so compare with the situation of the image of the such rectangular shape of the frame updating zone TTG before transmission comprises optimization.

In the step S22 of Figure 40, obtain the view data of the image section suitable with the frame updating zone.Figure 44 is the process flow diagram of the detailed step of the step S22 among the expression embodiment 8.In addition, the step of Figure 44 is identical with the step of Figure 31 of the above embodiments 4.Whether in step S70, verifying the 2nd transit area TG2 (Figure 42 (C)) is empty.In addition, as mentioned above, " the 2nd transit area TG2 " is the zone of obtaining view data in the TTG of frame updating zone from VRAM114.When the 2nd region of variation information A 2 does not exist, and when the 2nd region of variation A2 was completely contained among the 1st region of variation A1, the 2nd transit area TG2 was empty.When the 2nd transit area TG2 is sky, transfer to the step S74 that narrates later.On the other hand, when the 2nd transit area TG2 is not sky, execution in step S72.In step S72, the view data that VNC server 130 is obtained the 2nd transit area TG2 from VRAM114 writes the image data storage zone 106b in the RAM106.Its result is in the state that image data storage zone 106b all stores the image in the frame updating zone TTG shown in Figure 42 (D).In step S74, VNC server 130 is obtained the view data of frame updating zone TTG from the image data storage zone 106b of RAM106.It is in addition, actual that what obtain is the view data of each frame updating region R 11～R13 (Figure 43 (B)) after the optimal treatment.

In the step S24 of Figure 40, according to any one changing image data of predefined a plurality of coded formats (being also referred to as " compress mode " or " compression method ").Figure 45 is the process flow diagram of the detailed step of the step S24 among the expression embodiment 8.In step S502, judge to transmit again whether to indicate OFF.(transmit under the situation about handling usually) when transmitting sign OFF again, imagery exploitation JPEG compresses.On the other hand, (transmit under the situation about handling) when transmitting sign ON again, imagery exploitation ZLIB compresses again.In addition, we know that the ZLIB compression is reversible compression, are the compression methods (harmless compression) that does not have deterioration in image quality.In the present embodiment, use the JPEG compression, increase transfer rate so can reduce image data amount owing to transmit usually to handle.On the other hand, use the ZLIB compression owing to transmit again to handle, so can transmit higher-quality image.

In addition, as compression method, also can adopt these methods various compression methods in addition.In addition, also can transmit processing usually and transmit in the processing again and utilize identical compression method.When in transmitting processing usually and transmission is handled again, utilizing different compression methods, preferably can from a plurality of compression methods that comprise the compression method that big compression method of relative deterioration in image quality and relative deterioration in image quality are little, select compression method.In this case, preferably, in transmission is handled again, use the little compression method of relative deterioration in image quality transmitting the big compression method of the relative deterioration in image quality of use in the processing usually.This is because describe to stop when carrying out transmission processing again, owing to whether the picture quality quality is found out easily, so will transmit higher-quality image.

In the step S26 of Figure 40, generate the view data comprise after such conversion and the frame updating message (Fig. 5) of region of variation information, be sent to projector 200 via network interface portion 112.

At moment t101, carry out the processing of step S20～S26 of Figure 40 too.But at moment t101, shown in Figure 39 (B-1)～(B-3), region of variation information A 1, A2 do not exist, and have logined the information in the zone of presentation video G1 as transit area information RS again.In addition, 2 region of variation information A 1, all non-existent situations of A2 both sides represent not have the drawing command (image describe stop) of image.At this moment, in the step S306 of Figure 41, owing to region of variation RA1, RA2 both sides are empty, so the transmission again of execution in step S314 is handled.

Figure 46 is the process flow diagram of the detailed step of expression step S314.Judge in step S320 more whether transit area RRS is empty.When transit area RRS is empty again, direct end process.In this case, not carrying out transmission again handles.On the other hand, when transit area RRS is not empty again, the processing of execution in step S322～S326.

Figure 47 is the key diagram of the contents processing of expression step S322.Shown in Figure 47 (A), at moment t101, the 1st and the 2nd region of variation RA1, RA2 do not exist, and transit area RRS is the zone of image G1 again.At this moment, in the step S322 of Figure 46, shown in Figure 47 (B), (C), be partitioned into (perhaps extracting out) region D P of the specified size of the beginning of transit area RRS again, this region D P is appended among the 2nd transit area TG2.In addition, because region of variation RA1, RA2 are empty, so only cut zone DP is set as the 2nd transit area TG2.In step S322, further from deleting cut zone DP the transit area RRS again.Figure 47 (D) represents this revised RRS ' of transit area again.Carve t101 at this moment, because the 1st transit area TG1 (directly obtaining the zone of image from RAM106) is for empty, so the 2nd transit area TG2 equates with image update zone TTG (Figure 47 (E)).Therefore, obtain and transmit all images in the TTG of frame updating zone from VRAM114.

In addition, also can not with the part of transit area RRS again but it is all set as the 2nd transit area TG2.In other words, also at least a portion of transit area RRS again can be set as the 2nd transit area TG2.But, as present embodiment, set as the 2nd transit area TG2 if only incite somebody to action again the region D P of the specified size among the transit area RRS, then can shorten 1 time transmission again and handle the needed time.In addition, handle, can not make the advantage of handling the overtreating delay of carrying out by common transmission so also have owing in through the process that transmits processing more repeatedly, when having begun to describe, can promptly returning common transmission.

Preferably the size of cut zone DP is the size of predefined appointment.Wherein, so-called " specified size " is not limited to pre-determine the height of region D P and width both sides' situation, also has the implication widely that comprises following various situations: only determined height in advance and width be arbitrarily situation (setting situation about equating for) or only definite in advance width with the width of transit area RRS again and highly be arbitrarily situation (setting situation about equating for) with the height of transit area RRS again, set the situation etc. of the data size (several bytes of beginning) of region D P.

In the step S324 of Figure 46, carry out the optimal treatment of frame updating zone TTG.This handles identical with the optimal treatment (Figure 43) that transmits in handling usually.In step S326, will transmit sign again and be set at ON.

When having determined the frame updating zone in this wise, then carry out step S22 (Figure 44), step S24 (Figure 45) and the step S26 of Figure 40 successively.In addition, the contents processing of the step S22～S26 in transmit handling is again carried out the ZLIB compression with transmitting usually among the step S504 that the contents processing difference of handling only is Figure 45.Because transmitting use ZLIB compression in the processing again, so can transmit higher-quality image.

Like this, in embodiment 8, also be hook processing module 400 hooks and obtain specific drawing command in advance, carry out the write direct processing of RMA106 of the view data of region of variation.Its result can save in the comparative example shown in Figure 3 from VRAM114 to the needed time of RAM106 transmitted image data.Its result has the advantage that can accelerate the transfer rate when projector's 200 transmitted image data fully.

In addition, in embodiment 8, transmitting in the processing usually, projector 200 is not obtained and be sent to the image section of the regional TG2 that is described by hook processing module 400 (Figure 42 (C)) from VRAM114.Its result is sent to projector 200 by common module 124,126,128 image represented of describing with also can having no loss.

And then, in embodiment 8, usually transmitting when handling the 1st region of variation RA1 as transit area RRS login again, image describe to stop the time again the image in the transit area RRS from RAM114, obtain and transmission again.Though directly obtain from RAM106 usually transmitting when handling the image of the 1st region of variation RA1,, also can after describing to stop, transmitting high-quality image again even the quality of this image is not desired picture quality.This particularly under following such situation effect remarkable.

That is,, then drawing command is passed to GDI124 via hook module 400 when when application program 122 is sent specific drawing command.At this moment, exist utilize drawing command in GDI124 further manuscript as data conditions.In this case, being depicted in image among the image data storage zone 106b in the RAM106 and display driver 126 in hook processing module 400 is depicted between the image among the RAM114 and produces difference.Image in the 1st region of variation RA1 is directly obtained and is sent to projector 200 from image data memory zone 106b and shows, on the other hand, shows by display driver 126 to be depicted in image among the VRAM114 on the picture of computing machine 100 (Fig. 1).Originally will be presented at computing machine 100 on the identical image of image be also shown in the projector 200, but when GDI124 has processed image, can not realize.But, because both image difference is very little usually, thus describing to continue to carry out the image in the picture occurred some variation during, image on projector 200 and the computing machine 100 is variant not to have a big problem yet even be presented at.On the other hand, when describing to stop, because the observer can observe image more meticulously, so the unsatisfied situation of image that in projector 200, shows can occur feeling.In embodiment 8, after describing to stop, owing to obtain and transmit again image in the transit area RRS from VRAM114, so also can enough projectors 200 show desired image under these circumstances.

In addition, in the above-described embodiments, though when describing to stop, beginning to transmit again processing immediately, also can be after describing to stop through appointment during after begin to transmit again processing.

I. embodiment 9

Figure 48 is the process flow diagram of the detailed step of the step S20 (the frame updating zone of Figure 40 is determined to handle) among the expression embodiment 9.The embodiment 9 just contents processing of step S20 (say so in more detail and transmit the content of handling again) is different with embodiment 8, and other structure is identical with embodiment 8 with action.In Figure 48, between the step S306 of Figure 41 and step S308, append step S400, in addition, the content that transmits the step S314a that handles again is different with the step S314 of Figure 41.

In step S400, stop count value CT and zoning number N is initialized as 0.These parameters C T, N are transmitting the parameter of handling utilization in (step S314a) again.Because (step S308～S312) identical with embodiment 8 is so omit explanation to transmit processing usually.

Figure 49 is the process flow diagram of the detailed step of the step S314a (transmit and handle) among the expression embodiment 9.This Figure 49 has appended step S410～S416 among step S320～S326 at Figure 46.

In step S410, judge to stop count value CT whether more than or equal to the maximal value CTmax of appointment.Stop count value CT and be being illustrated in the parameter that the transmission that begun to be undertaken by VNC server 130 several times after describing to stop is handled.When stopping count value CT less than maximal value Ctmax, in step S412, will stop count value CT and increase by 1, the transmission again of execution in step S320～S326 is handled.Therefore, the transmission again that repeats (CTmax-1) inferior step S412, S320～S326 after describing to stop to be handled.In addition, because the processing of step S320～S326 is identical with the processing (Figure 47) of explanation among the embodiment 8, omit explanation.

On the other hand, when stopping count value CT more than or equal to maximal value Ctmax, the then processing of execution in step S414, S416 (" full frame transmits processing again ").That is, this full frame transmits again to be handled no matter whether logined transit area information RS again, then carries out when stopping count value CT more than or equal to maximal value Ctmax.In addition, maximal value CTmax for example is set at and is equivalent to describe to stop the back value in about 1 second.

In step S414, the value of zoning number N increases by 1.This zoning number N is the parameter that is used to be illustrated in each the zoning number (sequence number) when with specified size the full frame area dividing being a plurality of zone.In step S416, N zoning in the full frame zone is appended among the 2nd transit area TG2, transfers to step S326 and will transmit sign again to be set at ON.

Figure 50 is the key diagram of the content of expression step S414, S416.Transmit in the processing at full frame, picture area SCA all is split on a plurality of zoning DDP1～DDPn of specified size again.Then, becoming the moment t200 of CTmax≤CT (Figure 50 (A)), the 1st zoning DDP1 is set as the 2nd transit area TG2.In addition, at next moment t201 (Figure 50 (B)), the 2nd zoning DDP2 is set as the 2nd transit area TG2.Its result, the transmission more repeatedly of the imagery exploitation of full frame is handled and is sent to projector 200.

In addition, also can not with the part of picture area SCA but it is all set as the 2nd transit area TG2.But, as present embodiment, if only the zoning of the part of picture area SCA is set as the 2nd transit area TG2, then can shorten transmit again for 1 time handle in the needed time.In addition, handle, can not make the advantage of handling the overtreating delay of carrying out by common transmission so also have owing in the process that transmits processing more repeatedly, when having begun to describe, can promptly returning common transmission.

Preferably the size of zoning DDP1～DDPn is the size of predefined appointment.Wherein, so-called " specified size " is not limited to pre-determine the height of zoning and width both sides' situation, also has the implication widely that comprises following various situations: only determined height in advance and width be arbitrarily situation (set for the width of picture area SCA and equate) or only definite in advance width and highly be arbitrarily situation (set for the height of picture area SCA and equate), set the situation etc. of the data size (several bytes of beginning) of zoning.

In addition, also the transmission again of full frame is handled and be called " full frame transmits processing again " or " full frame is transfer mode again ".Transmit again in the processing at full frame, on not using again transit area information RS this point with handle different according to the transmission again of Figure 46, Figure 47 explanation among the embodiment 8.Using transmitting again of transit area information RS to handle the transmission again that also can be called narrow sense handles again.In addition, in embodiment 9, also can not carry out the transmission again of narrow sense and handle, transmit processing again and only carry out full frame.

Like this, in embodiment 9, transmit processing again owing to after describing to stop, transferring to full frame during through appointment, thus can be at image describe to stop the image that the full frame zone in the VRAM114 is transmitted in the back.Therefore, even between image that transmits by the processing of transmission again of using common transmission to handle and transmit again the narrow sense of process information RS and the image in the VRAM114, produced under the situation of difference for a certain reason, also can make the image that in computing machine 100 and projector 200, shows in full accord.

J. embodiment 10

Figure 51 is the process flow diagram of the detailed step of the step S24 (the view data conversion process of Figure 40) among the expression embodiment 10.The embodiment 10 just contents processing of step S24 (say so in more detail and transmit the content of handling again) is different with embodiment 8 or embodiment 9, and other structure is identical with embodiment 8 or embodiment 9 with action.Figure 51 is the figure that has appended step S520, S522 between the step S500 of Figure 45 and step S502.

In step S520, judge whether the image for the frame updating zone should use the JPEG compression.Whether need to use the JPEG compression, for example can judge by analysis of image data.Specifically, to the assigned address of image (for example, four jiaos and central authorities) the pixel value of specified pixel number separately sample and count colour index, when this colour index adopts the ZLIB compression during less than specified threshold value, when more than or equal to threshold value, also can adopt the JPEG compression.Owing to,, can not transmit high-quality image so can excessively not reduce transfer rate even the ZLIB compression also can reduce suitable data volume for the few image of colour index.On the other hand, by adopting the JPEG compression can realize that high-speed image transmits for the many images of colour index.In addition, adopt the judgement of which kind of compression method to carry out in the mode of each image of describing, perhaps also can (mode of the region R 11～R13) of Figure 43 (B) be carried out with each the frame updating zone after the optimization.

In step S522, append the information of the transit area again RS in the frame updating zone of having logined expression JPEG compression.Like this, even utilizing JPEG compression transmitted image quality to have slightly under the situation of image of deterioration, also can utilize transmission again after describing to stop to handle and transmit high-quality image again.

In

embodiment

10,2 kinds of zones that become transmission object in transmission is handled usually are as transit area login again.That is, in the step S310 of Figure 41, the 1st region of variation RA1 as transit area login again, in addition, in the step S522 of Figure 51, will be compressed the zone of the image that transmits as transit area login again through JPEG.

Figure 52 represents region of variation RA1, RA2 and the example of the relation of transit area RRS again among the embodiment 10.Figure 52 (A) is and the 1st and the 2nd region of variation RA1 shown in Figure 42 (A), the figure that RA2 is identical, frame updating region R 11～R13 of Figure 52 (B) identical with shown in Figure 43 (B).Wherein, frame updating region R 11 be equate with the 1st region of variation RA1 handle the zone describe by hook.Therefore, this region R A1 is no matter whether the compression of its image utilizes any of JPEG compression and ZLIB compression, as transit area login again.Utilize the JPEG compression when in addition, supposing the transmission of the image in frame updating region R 12, R13.At this moment, frame updating region R 12, R13 also append login as transit area again.Its result, shown in Figure 52 (C), with frame updating region R 11～R13 all as the login of transit area RRS again.

In addition, in embodiment 10, can be not yet with the 1st region of variation RA1 as transit area login again, and the zone of the image that only will transmit through the JPEG compression is as transit area login again.In addition, as embodiment 8 explanations, also can use JPEG compression or ZLIB compression other various compression methods in addition as compression method.

Like this, in embodiment 10 because when transmitting the image of JPEG compression, in advance should the zone as transit area login again, image describe stop the back and obtain and transmit again image in the transit area from VRAM114, so can in projector 200, show high-quality image.

K. variation

K1. variation 1

As the frame updating message of supplying with projector 200 from computing machine 100, can use the various information of using in the foregoing description in addition.For example, as frame updating message, can use the information that comprises view data at least.Specifically, for example when transmitting all view data of picture, do not need to transmit region of variation information.

In addition, as frame updating message, preferably comprise position and the information of size and the view data in the region of variation of expression region of variation (frame updating zone) at least.This is that the data volume that then needs to transmit has tailed off because if only transmit the data (region of variation information and view data thereof) relevant with region of variation.And, in the foregoing description 2, will represent except these information that preferably the multiplying power information of amplification/reduction magnification or the dimension information of the picture size of expression after amplifying/dwindling are included in the frame updating message.In addition, in the foregoing description 2, though be not only can carry out image to amplify situation about also can dwindle, the present invention also can be applicable to the situation of can only image amplifying.In addition, in embodiment 2, though be the situation that transmits motion video, the structure of embodiment 2 also can be applicable to the situation that transmits rest image.

K2. variation 2

In the foregoing description 3,, also can use transmission sign 106c other structure in addition to carry out both coordinations though use transmission to indicate that 106c coordinates the processing between hook processing module 400 and the VNC server 130.For example, also can represent that the mode that whether is just transmitting with the information of handling in carries out image constitutes both with transmitting to hook processing module 400 from VNC server 130.In this case, during VNC server 130 carries out image transmit with processing, also can make 400 waits of hook processing module and not begin the processing corresponding with drawing command.

K3. variation 3

Indicate that as in embodiment 3, needing to keep to transmit 106c is the image transmission processing of ON, also can from step S210～S230 of Figure 15, remove step S230 (view data conversion process), otherwise perhaps also can in step S210～S230, append step S250 (view data transmits and handles).But, when the frame updating zone is not full frame, (do not utilize the situation of region of variation information), transmit with handling the view data that comprises definite processing of picture area (step S210) and frame updating zone at least preferably as image and obtain processing (step S220).On the other hand, when the frame updating zone is full frame,, the image transmission obtains processing (step S220) as long as comprising view data at least with processing.

K4. variation 4

In the foregoing description 4 to embodiment 6, though be at the image section of obtaining the 2nd transit area TG2 (Figure 21 (C), Figure 24 (C), Figure 29 (C)) from VRAM114 and after temporarily writing in the regional 106b of image data storage RAM106 in, obtain the image of frame updating zone TTG and transmit from RAM106, but also can omit the processing that writes image data storage zone 106b via network.But,, then, handle the simple advantage that becomes so have owing to finally via the network transmitted image time, from 1 image data storage zone 106b, obtain image according to the step of the foregoing description 4 to embodiment 6.

K5. variation 5

In the above-described embodiments, describe module and be divided into GDI124 and display driver 126 and projector's driver 128 these 3 modules, but the division of module is arbitrarily, these functions can be concentrated in 1 module.In addition, also the function of display driver 126 and projector's driver 128 can be concentrated in 1 module.

K6. variation 6

In the above-described embodiments, though used personal computer, replace it also can use the computing machine (mobile computer, handheld computer, workstation etc.) of other kind as image supply device.In addition, except these computing machines, also can use the equipment of the same function of having of can being connected with network and computing machine.Such equipment for example comprises information portable terminal, mobile phone, mail terminal, game machine, set-top box etc.In addition, can use projector's various display device in addition as image display device.

K7. variation 7

As network, except Local Area Network, can use diverse networks such as wide area network (WAN), the Internet, in-house network.In addition, network can be used wired formation, perhaps also can use wireless formation.

K8. variation 8

The part of the function that realizes with software in the foregoing description can realize that also perhaps the part with hard-wired function also can realize with software with hardware.

More than, though understand the present invention in detail and illustrate, these just represent the present invention as an example, and the present invention does not limit to due to this, and thought of the present invention and scope are only limited by the claim of adding.

Claims

1. an image supply device is to be used for supplying with the image supply device that image makes its demonstration via network to image display device, it is characterized in that possessing:

Hook is also obtained the specific drawing command that is sent by the application program that is installed in the above-mentioned image supply device and the hook processing module of using the image memory region rendering image according to the specific transmission of the drawing command of obtaining in general-purpose storage in advance;

Be used for according to the drawing command that receives from application program or above-mentioned hook processing module in frame memory rendering image describe module; And

Image transmits processing module, and it is obtained image and send the image of obtaining to above-mentioned image display device via above-mentioned network with image memory region from above-mentioned transmission.

2. image supply device as claimed in claim 1, wherein,

Above-mentioned hook processing module has expression as writing function above-mentioned general-purpose storage in according to the region of variation information of the region of variation in the zone of above-mentioned drawing command rendering image in above-mentioned transmission in image memory region;

Above-mentioned image transmits processing module, obtains with reference to the above-mentioned region of variation information in the above-mentioned general-purpose storage of being stored in to be stored in above-mentioned transmission and to send above-mentioned image display device with above-mentioned region of variation information via above-mentioned network with the interior image section of the above-mentioned region of variation of image memory region and with the image section of obtaining.

3. image supply device as claimed in claim 1, wherein,

Above-mentioned image transmits processing module, has by being stored in above-mentioned transmission to send the function that screen displayed that above-mentioned image display device makes above-mentioned image display device is amplified resulting the 2nd image behind above-mentioned the 1st image with the 1st image of image memory region to via above-mentioned network;

4. image supply device as claimed in claim 1, wherein,

Above-mentioned image transmission processing module is loaded into above-mentioned hook processing module in the above-mentioned application program when above-mentioned image transmits the processing module starting, and unloads above-mentioned hook processing module when above-mentioned image transmits the execution end of processing module from above-mentioned application program.

5. image supply device as claimed in claim 1, wherein,

Above-mentioned hook processing module, at least comprise above-mentioned image and transmit processing module obtains the appointment of treatment of picture from above-mentioned transmission with image memory region image and transmit when handling carrying out, to transmit with processing until above-mentioned image and finish not begin to carry out the processing corresponding and wait for above-mentioned drawing command.

6. image supply device as claimed in claim 5, wherein,

Above-mentioned image transmits processing module, in above-mentioned image transmits with processing execution the transmission sign in the above-mentioned general-purpose storage is set at the ON state, and after above-mentioned image transmits with the processing end above-mentioned transmission sign is set at the OFF state;

Above-mentioned hook processing module switches to OFF until above-mentioned transmission sign and does not begin to carry out the processing corresponding with above-mentioned drawing command and wait for when above-mentioned transmission is masked as ON.

7. image supply device as claimed in claim 5, wherein,

Above-mentioned image transmits processing module,

(i) transmit with in handling at above-mentioned image, obtain with reference to the above-mentioned region of variation information in the above-mentioned general-purpose storage of being stored in and be stored in above-mentioned transmission with the image section in the above-mentioned region of variation of image memory region,

8. image supply device as claimed in claim 1, wherein,

Above-mentioned image transmits processing module,

9. image supply device as claimed in claim 1, wherein,

Above-mentioned image transmits processing module,

(ii) be not from above-mentioned frame memory obtain but from above-mentioned transmission with image memory region obtain with above-mentioned the 2nd region of variation be also contained in regional suitable image section in above-mentioned the 1st region of variation,

10. image supply device as claimed in claim 9, wherein,

Above-mentioned image transmits processing module, obtain from above-mentioned frame memory with above-mentioned the 2nd region of variation be not included in the regional suitable image section in above-mentioned the 1st region of variation and write above-mentioned transmission with image memory region after, obtain the image section suitable with image memory region from above-mentioned transmission with above-mentioned frame updating zone.

11. image supply device as claimed in claim 1, wherein,

Above-mentioned image transmits processing module,

(iii) be not from above-mentioned frame memory obtain but from above-mentioned transmission with image memory region obtain the image section suitable with above-mentioned the 1st region of variation and with above-mentioned the 2nd region of variation be not included in above-mentioned the 1st region of variation but be included in regional suitable image section in the above-mentioned resume zone

12. image supply device as claimed in claim 1, wherein,

Above-mentioned image transmits processing module,

13. image supply device as claimed in claim 12, wherein,

Above-mentioned image transmits processing module, obtain from above-mentioned frame memory with above-mentioned the 2nd region of variation be not included in the regional suitable image section in any one of above-mentioned the 1st region of variation and above-mentioned resume zone and write above-mentioned transmission with image memory region after, obtain the image section suitable with image memory region from above-mentioned transmission with above-mentioned frame updating zone.

14. image supply device as claimed in claim 1, wherein,

Above-mentioned image transmits processing module to have,

When the describing of the image of describing module, obtain and transmit by above-mentioned hook processing module be depicted in above-mentioned transmission with the common transfer mode of the image of image memory region and

15. image supply device as claimed in claim 14, wherein,

Above-mentioned hook processing module has expression as writing function above-mentioned general-purpose storage in according to the 1st region of variation information of the 1st region of variation in the zone of above-mentioned specific drawing command rendering image in above-mentioned transmission in image memory region;

Above-mentioned image transmits processing module,

In above-mentioned transfer mode again, from above-mentioned frame memory obtain and transmission and above-mentioned transit area again the regional suitable image section of specified size.

16. image supply device as claimed in claim 15, wherein,

17. image supply device as claimed in claim 14, wherein,

Above-mentioned transfer mode again is included in the full frame transfer mode again of describing to stop to begin transmitting through back during the appointment image in the full frame zone in the above-mentioned frame memory from above-mentioned image.

18. image supply device as claimed in claim 17, wherein,

Above-mentioned image transmits processing module, at above-mentioned full frame again in the transfer mode, with above-mentioned full frame area dividing is a plurality of zonings of specified size, by transmitting the transmission that the image that transmits 1 zoning in turn selecting in the processing from above-mentioned a plurality of zonings is finished the image in above-mentioned full frame zone at per 1 time.

19. image supply device as claimed in claim 18, wherein,

Above-mentioned image transmits processing module, also has:

Will be in above-mentioned common transfer mode with above-mentioned the 1st compression method compression and the image-region record that transmits function as the transit area again of the image-region that in above-mentioned transfer mode again, transmits; And

In above-mentioned transfer mode again, the function that the image in the above-mentioned transit area is again compressed and transmits image with above-mentioned the 2nd compression method.

20. an image supply method is to supply with the method that image makes its demonstration via network to image display device, it is characterized in that, comprising:

Send the operation of drawing command by being installed in application program in the image supply device;

(a) hook is also obtained specific drawing command that is sent by application program and the hook treatment process of using the image memory region rendering image according to the specific transmission of the drawing command of obtaining in general-purpose storage in advance; And

Send the operation of drawing command or above-mentioned hook treatment process receives drawing command and the operation of rendering image in frame memory from above-mentioned application program;

(b) obtain image with image memory region and the image of obtaining is sent to the operation of above-mentioned image display device via above-mentioned network from above-mentioned transmission.

21. image supply method as claimed in claim 20, wherein,

Above-mentioned operation (a) comprising:

Judge that comprise the image of obtaining the appointment of treatment of picture with image memory region from above-mentioned transmission at least transmits the operation of whether carrying out with processing;

Transmit when handling when carrying out above-mentioned image, transmit with processing until above-mentioned image and finish not begin to carry out the processing corresponding and the operation waited for above-mentioned drawing command.

22. image supply method as claimed in claim 20, wherein,

Above-mentioned operation (a) comprising:

Preparation is used to handle describing module and hook and obtaining the specific drawing command that sent by above-mentioned application program and according to the operation of the specific transmission of the drawing command of obtaining in general-purpose storage with the hook processing module of image memory region rendering image in advance of the drawing command that sent by application program;

Above-mentioned hook processing module is according to the operation of the specific transmission of the specific drawing command that is sent by above-mentioned application program in above-mentioned general-purpose storage with the image memory region rendering image;

Above-mentioned hook processing module will be represented as writing operation above-mentioned general-purpose storage in according to the 1st domain transformation information of the 1st region of variation in the zone of above-mentioned specific drawing command rendering image in above-mentioned transmission in image memory region;

Above-mentioned hook processing module is supplied with the above-mentioned operation of describing module with this drawing command after having handled above-mentioned specific drawing command;

The above-mentioned operation of describing module according to the drawing command rendering image in frame memory that receives from above-mentioned application program or above-mentioned hook processing module; And

The above-mentioned module of describing will be represented as write operation in the above-mentioned general-purpose storage according to the 2nd region of variation information of the 2nd region of variation in the zone of above-mentioned drawing command rendering image in above-mentioned frame memory;

Above-mentioned operation (b) comprising:

With reference to the above-mentioned the 1st and the 2nd region of variation information that is stored in the above-mentioned general-purpose storage, from above-mentioned frame memory obtain with above-mentioned the 2nd region of variation be not included in the operation of the regional suitable image section in above-mentioned the 1st region of variation;

Not to obtain from above-mentioned frame memory but obtain the operation of the image section suitable from above-mentioned transmission with image memory region with above-mentioned the 1st region of variation; And

With the image section obtained with expression as the above-mentioned the 1st and the 2nd region of variation and the frame updating area information in frame updating zone send the operation of above-mentioned image display device to via above-mentioned network.

23. image supply method as claimed in claim 20, wherein,

Above-mentioned operation (a) comprising:

Above-mentioned operation (b) comprising:

Be not from above-mentioned frame memory obtain but from above-mentioned transmission with image memory region obtain with above-mentioned the 2nd region of variation be included in the operation of the regional suitable image section in above-mentioned the 1st region of variation; And

The frame updating area information in the frame updating zone that the image section obtained is identical with above-mentioned the 2nd region of variation with expression sends the operation of above-mentioned image display device together to via above-mentioned network.

24. image supply method as claimed in claim 20, wherein,

Above-mentioned operation (a) comprising:

The above-mentioned operation of describing module according to the drawing command rendering image in frame memory that receives from above-mentioned application program or above-mentioned hook processing module;

The above-mentioned module of describing will be represented as write operation in the above-mentioned general-purpose storage according to the 2nd region of variation information of the 2nd region of variation in the zone of above-mentioned drawing command rendering image in above-mentioned frame memory; And

Above-mentioned the 1st region of variation that exists during transmission in will be between the antephase of appointment is handled is set as the resume zone and the transmission record information that will represent this resume zone writes operation in the above-mentioned general-purpose storage;

Above-mentioned operation (b) comprising:

With reference to the above-mentioned the 1st and the 2nd region of variation information and the above-mentioned transmission record information that are stored in the above-mentioned general-purpose storage, from above-mentioned frame memory obtain with above-mentioned the 2nd region of variation be not included in the operation of the regional suitable image section in any one of above-mentioned the 1st region of variation and above-mentioned resume zone;

Be not from above-mentioned frame memory obtain but from above-mentioned transmission with image memory region obtain the image section suitable with above-mentioned the 1st region of variation and with above-mentioned the 2nd region of variation be not included in above-mentioned the 1st region of variation but be included in the operation of the regional suitable image section in the above-mentioned resume zone; And

25. image supply method as claimed in claim 20, wherein,

Above-mentioned operation (a) comprising:

Above-mentioned operation (b) comprising:

Be not from above-mentioned frame memory obtain but from above-mentioned transmission with image memory region obtain with above-mentioned the 2nd region of variation be included in the operation of the regional suitable image section among at least one side in above-mentioned the 1st region of variation and above-mentioned resume zone; And

26. image supply method as claimed in claim 20, wherein,

Above-mentioned operation (a) comprising:

Preparation is used for handling the drawing command and the describing module and hook and obtaining the specific drawing command that is sent by above-mentioned application program and the operation of using the hook processing module of image memory region rendering image according to the specific transmission of the drawing command of obtaining in general-purpose storage in advance at the frame memory rendering image of being sent by application program; And

Above-mentioned operation (b) comprising:

When carrying out describing of image, obtain and transmit the operation of the image that is depicted in above-mentioned transmission usefulness image memory region according to drawing command; And

Above-mentioned image describe stop after, the operation that obtains the image that is depicted in the above-mentioned frame memory and transmit via above-mentioned network.