JP2005217827A - Device and method for transferring information, and program - Google Patents

Abstract

<P>PROBLEM TO BE SOLVED: To provide an information transferring device capable of effectively realizing reproducibility and high image quality in quick screen update at the side of a device in a transfer destination, when transferring image information from the information transferring device to the device of the transfer destination. <P>SOLUTION: A display image generation section 1 updates an image as required. An update image information acquisition section 3 acquires an image update position and an update image. An update image compression section 4 compresses the update image. An update image transfer section 6 transfers update image information including the compressed update image obtained by compression and the image update position to the device of the transfer destination via a data transfer section 8. A transfer image restoration section 7 decodes the compressed update image. A compression error calculation section 5 obtains a compression error from the update image in which the original update image and the compressed update image are decoded. A compression error transmission region decision section 10 decides that error information including the compression error is transferred to the device of the transmission destination. An error information transmission section 11 transfers the error information whose transfer is determined to the device of the transfer destination via the data transfer section 8. <P>COPYRIGHT: (C)2005,JPO&NCIPI

Description

  The present invention relates to a system for transferring and displaying a screen of a PC or PDA in real time on a screen of another PC or projector via a network.

  In recent years, notebook PCs and projectors have become widespread, and in presentations, a method of presenting presentation materials by connecting a notebook PC and a projector with a cable and enlarging and projecting the PC screen onto the projector has become common. . In addition, projectors are becoming cheaper and smaller, and there are increasing opportunities to use them not only for formal presentations but also for presentations of materials and sharing of minutes in regular meetings.

  However, since a projector needs to be projected onto a screen or the like, it is likely to be restricted by the installation location. Therefore, in order to use the projector, it is necessary to move near the projector, or when multiple people project in turn, each of them may carry the PC close to the projector and then change the connection. In addition, it was necessary to prepare data in advance on one PC.

  Therefore, recently, a system for connecting a projector and a PC wirelessly, such as IEEE 802.11b wireless LAN and Bluetooth, has been released. Connecting wirelessly eliminates the need for the projector to carry his / her PC near the projector, making it possible to connect from any location in the room. In addition, even when a plurality of people project alternately, it is easy to change the projector's PC. In addition, it is easy to project to multiple projectors simultaneously.

  When transferring screen data of a PC via a network such as wireless, unlike a case where a dedicated wired connection such as an RGB cable is used, the usable bandwidth is limited, and thus compression of image data is necessary. In the case of PC screen transfer, the data to be transferred is not known in advance, and the screen size is as large as XGA (1024 * 768) or larger. Since it is difficult to assume the use of special hardware, it is common to transfer image data in a changed area as a sequence of still images.

As a still image compression method, for example, reversible compression without compression distortion using zlib (for example, disclosed in detail in Non-Patent Document 1), JPEG (for example, disclosed in detail in Non-Patent Document 2), etc. There is lossy compression with compression distortion. Conventionally, the screen is transferred using either one of them. When the lossless compression method is used, the original image can be obtained as it is when it is decoded on the receiving side. However, for images with many gradations, it takes time to compress, the data size after compression is large, and transfer takes time. There were disadvantages. On the other hand, when the lossy compression method is used, a stable compression time and data size after compression can be obtained regardless of the content of the image, but the original image cannot be obtained as it is, and noise is generated. It was.
zlib Home Site, searched January 23, 2004, Internet <URL: http://www.gzip.org/zlib/> official JPEG homepage, search January 23, 2004, Internet <URL: http://www.jpeg.org/>

  Conventionally, in a system that transfers the screen of a device to another device in real time, in order to achieve quick screen update reproducibility on the receiving side, the image quality must be reduced to reduce the amount of data. In addition, the reproducibility of the screen update has to be significant to achieve high image quality.

  The present invention has been made in view of the above circumstances, and when transferring information for screen display from an information transfer device to a transfer destination device, reproducibility and high image quality of quick screen update on the transfer destination device side. It is an object to provide an information transfer device, an information transfer method, and a program that can effectively realize the above.

  An information transfer apparatus according to the present invention includes an update unit that updates an image of all or a part of a region in a display screen, an image update position in the display screen related to the image update, and an acquisition unit that acquires the updated image An update image compression means for compressing the update image, a first transfer means for transferring the post-compression update image obtained by the compression and the update image information including the image update position to a transfer destination device, and the compression Decoding means for decoding the post-update image by a decoding method corresponding to the compression method related to the compression, the original update image to be compressed, and the post-compression update image related to the original update image Calculation means for calculating a compression error between them based on the updated image obtained in this way, a determination means for making a decision to transfer error information including the compression error to the transfer destination device, The error information determined by means, characterized in that a second transfer means for transferring to the transfer destination device.

The present invention relating to the apparatus is also established as an invention relating to a method, and the present invention relating to a method is also established as an invention relating to an apparatus.
Further, the present invention relating to an apparatus or a method has a function for causing a computer to execute means corresponding to the invention (or for causing a computer to function as means corresponding to the invention, or for a computer to have a function corresponding to the invention. It can also be realized as a program (for realizing the program), and can also be realized as a computer-readable recording medium on which the program is recorded.

  According to the present invention, when information for screen display is transferred from the information transfer apparatus to the transfer destination apparatus, it is possible to effectively realize quick screen update reproducibility and high image quality on the transfer destination apparatus side. .

  Hereinafter, embodiments of the present invention will be described with reference to the drawings.

(First embodiment)
FIG. 1 shows a configuration example of an information transfer apparatus according to the first embodiment of the present invention.

  As shown in FIG. 1, the information transfer apparatus 100 includes a display image generation unit 1, a display 2, an update image information acquisition unit 3, an update image compression unit 4, a compression error calculation unit 5, an update image transfer unit 6, and a transfer. An image restoration unit 7, a data transfer unit 8, a compression error holding unit 9, a compression error transmission area determination unit 10, and an error information transfer unit 11 are provided.

  FIG. 2 shows a configuration example of a system using the information transfer apparatus of this embodiment. In this example, the information transfer apparatus 100 is configured using a personal computer (PC), the transfer destination apparatus 101 to which the PC 100 transfers update image information and error information is a projector, and the projector 101 is information transferred from the PC 100. This is a configuration example in the case where a screen is generated based on the above and projected onto the screen 102 for display. In this example, the same screen as that of the PC 100 operated by the user is displayed on the screen 102 by the projector 101. In this example, the PC 100 and the projector 101 are connected by using wireless such as IEEE802.11b.

  FIG. 3 shows another configuration example of a system using the information transfer apparatus of this embodiment. In this example, by using the Internet / Intranet 103 rather than wirelessly, a plurality of information transfer apparatuses PCs 100-1 and 100-2 are connected to a PC (not shown) and a projector 101 that display transferred screens. The According to this example, there is no need for devices that perform screen transfer to be close to each other, and devices that are in remote locations that are remote from each other can also perform screen transfer.

  Hereinafter, each part of FIG. 1 will be described.

  The display image generation unit 1 is a part that generates an image to be displayed on the display 2. Usually, in order to store the latest image to be displayed, a frame buffer (not shown) having a size corresponding to the screen resolution is prepared. The generation of the display image itself is performed by cooperation of the application, the OS, and the display driver, and the generated image is written in the frame buffer. The written contents of the frame buffer are sent to the display 2.

  The display 2 is a part that displays the image generated by the display image generation unit 1.

  The updated image information acquisition unit 3 is a part that acquires updated image information including, for example, image data to be displayed and updated, data on the update position thereof, and the like. The screen update may be performed in units of the entire screen, or may be performed in a specific part of the screen (for example, a unit of window, all or part of a window). Alternatively, it may be performed in units of an arbitrary part of the screen.

  As a method for acquiring update image information by the update image information acquisition unit 3, all update information generated for display update from the display image generation unit 1 may be received and used as it is. Alternatively, the updated display image may be extracted by periodically acquiring the latest display image from the display image generating unit 1 and comparing the acquired latest display image with the previously acquired image. In addition, it is possible to monitor which part has been updated by hooking drawing-related events such as screen update used in the system being used, and to obtain only the image of the obtained updated part from the frame buffer. Is also possible. The acquired updated image information is transferred to the updated image compression unit 4 and the compression error calculation unit 5. The image data passed from the updated image information acquisition unit 3 to the updated image compression unit 4 and the compression error calculation unit 5 is a continuation of still image data.

  The update image compression unit 4 is a part that compresses the update image data in the update image information passed from the update image information acquisition unit 3. The compression method is not particularly limited, and for example, the JPEG method that is most commonly used in still image compression may be used. However, in this embodiment, the case where irreversible compression is used as a compression method is assumed. In this embodiment, after a compressed image is transmitted to a transfer destination device (for example, a projector), a compression error is transmitted when a certain condition is satisfied. However, a compression error does not occur in lossless compression. . The compressed data is transferred to the update image transfer unit 6 and the transfer image restoration unit 7 together with the update position information of the image.

  The update image transfer unit 6 is a part that sends update image information in which update image data is compressed to a transfer destination apparatus. The update image transfer unit 6 requests the data transfer unit 8 to transfer the update image information including the update position and the compressed update image data to the transfer destination device. At this time, when necessary for restoration and display on the transfer destination device side, information on the data size of the updated image data before and after compression is added to the updated image information.

  The data transfer unit 8 is a part that transfers the updated image information to the transfer destination device.

  The transfer image restoration unit 7 is a part that decodes the compressed image data. The decoded image data is transferred to the compression error calculator 5. Decoding is performed by the same method as the method of decoding the compressed image data received by the transfer destination device. Thus, a predicted image for the image displayed on the transfer destination device side is obtained.

  The compression error calculation unit 5 is a part that calculates a difference (that is, compression error) between the update image data passed from the update image information acquisition unit 3 and the decoded image data passed from the transfer image restoration unit 7. is there. When lossy compression is used as a compression method, a difference is generated between an image before compression and an image obtained by decoding compressed data, and this becomes a compression error. The obtained compression error is passed to the compression error holding unit 9.

  The compression error holding unit 9 is a part that holds the compression error obtained by the compression error calculation unit 5 for a certain period. Further, when the compression error holding unit 9 passes the held compression error information to the compression error transmission region determination unit 10 or is notified of the region where the compression error is to be transmitted from the compression error transmission region determination unit 10, The notified compression error of the area is transferred to the error information transfer unit 11.

  The error information transfer unit 11 is a part that sends error information including the compression error data passed from the compression error holding unit 9 and the position information of the compression error to the transfer destination device. The compression error holding unit 9 distinguishes the error information from the update image information transferred by the update image transfer unit 6 so that the compression error can be correctly reflected in the display image on the transfer destination apparatus side. The data transfer unit 8 is requested to transfer to the transfer destination device. The update image information and the error information may be distinguished by any method, for example, flag information indicating whether the update image information or the error information is added to the update image information or the error information and transferred.

  The compression error transmission area determination unit 10 is a part that determines whether or not to transmit a compression error based on the update area information on the screen and determines an area for transmitting the compression error.

  For example, as a simplest method, a method for determining a region where a compression error is transmitted may be determined based on whether an image of a certain region has been updated and then not updated for a certain period of time. That is, a compression error is not transmitted for a screen that is only displayed for a short time, and the compression error is transmitted only after the display is maintained for a certain period of time. Further, if the image in the area is updated, the compression error is not transmitted (there is no longer a meaning to transmit the compression error). In this case, the compression error holding unit 9 is notified to transmit the compression error of the area that has not been updated for a certain period of time. Of course, this is only an example, and various other methods can be used as a method of determining a region for transmitting a compression error.

  Next, FIG. 4 shows an example of an operation procedure of the information transfer apparatus.

  When the update image data is input (step S1), it is irreversibly compressed by a predetermined method (step S2), and the update image information including the compressed image data is transferred to the transfer destination device (step S3).

  The transferred compressed image data is decoded by a decoding method corresponding to the compression method (step S4), and a compression error is calculated from the original updated image data to be compressed and the image data obtained as a result of decoding. Is obtained (step S5).

  Here, waiting for the elapse of a predetermined time (step S6), when a predetermined condition is satisfied (for example, when the update area related to the transferred updated image information is not updated even after the elapse of the predetermined time). In step S7, error information including a compression error is transferred to the transfer destination device (step S8).

  Note that the transmission of updated image information in step S3 may be performed after step S4 or after step S5.

  FIG. 5 shows another example of the operation procedure of the information transfer apparatus. Each processing is basically the same as the example of FIG. 4, but in the example of FIG. 4, decoding and compression error calculation (steps S4 and S5) are performed regardless of whether error information is transmitted. On the other hand, in the example of FIG. 5, the decoding and compression error calculation (steps S16 and S17) is performed after it is determined that the error information is transferred in step S15.

Next, an information transfer operation in the information transfer apparatus of this embodiment will be described using a specific example. Here, the information transfer apparatus is, for example, a laptop or laptop PC (may be a desktop PC or the like), and the transfer destination apparatus is a projector as an example. In the PC, the screen is updated in accordance with a user operation or the like. For example, assume that two new text editor windows are opened. The display image generating unit 1 generates two window rectangular images and displays them on the display 2. This is shown in FIG. The update image information acquisition unit 3 acquires two rectangles as update images from the display image generation unit 1. The two images are compressed by the update image compression unit 4 and transferred to the projector as the transfer destination device by the update image transfer unit 6.

  On the projector side, the transferred compressed image is decoded and displayed. At this time, if lossy compression is used for compression, a compression error occurs, resulting in an image slightly different from the original image. FIG. 7 shows an image displayed on the projector in which the compression error has occurred. In FIG. 7, the area where the compression error exists is indicated by hatching. However, actually, for example, the outline of the character is distorted.

  On the PC side, the compressed image is decoded in the same manner as the projector side, and a compression error is obtained by taking the difference between the decoded image data and the uncompressed image data. In this case, two rectangular error images are obtained. This is shown in hatched areas in FIG. The obtained error image is held for a certain period together with the acquired time. As a method of storing the error image, an error image buffer corresponding to the screen size may be prepared and the error image obtained in the buffer may be updated, or the obtained error image list may be used as it is. You may keep it.

  The compression error transmission area determination unit 10 always checks the area where the image has been updated, and checks whether or not the same area has been further updated a certain time after the update. For example, if the PC screen has not been updated since two rectangles have been updated, the compression error transmission area determination unit 10 sets these two areas as areas to which an error image should be transmitted. As a result, the two stored error images are transmitted to the projector.

  In the projector, by reflecting the received error image on the display image, the same image as the display image on the PC without the compression error as shown in FIG. 6 is displayed.

  Next, consider a case where a new updated image is displayed only on one of the rectangles after the screen update of the two text editor rectangles, as shown in FIG. In this case, the compression error transmission area determination unit 10 does not need to transmit the error image on the right side of the two areas (because the area has been updated) when determining the error transmission area after a certain time. Therefore, only the error image area on the left side is set as the error image transmission area. As a result, unnecessary error image data need not be transmitted.

  In addition, regarding the newly displayed graph image on the right side of the two areas in FIG. 9, it is determined whether or not to transmit an error image after a certain period of time thereafter.

  For example, when the lower half of one rectangular area is updated with another image, a method of transmitting only the upper half area of the error image held for the rectangular area is also possible. In this way, it is possible to transmit a partial area of an error image, and it is possible to reduce the amount of data to be transmitted unnecessarily.

  Various variations are conceivable as conditions for determining the compression error transmission region by the compression error transmission region determination unit 10.

  As the simplest condition, it can be considered that “the image update has not been updated for a certain period of time since the image was updated” as described above.

  Furthermore, as a more advanced control, a method is conceivable in which the time from image update to compression error transfer start is variable. As a specific control method for changing the waiting time until compression error transfer, for example, when the image update is frequently performed, the waiting time is lengthened, and the image update interval is widened. The method of shortening the waiting time can be considered.

  If the interval between image updates is wide, that is, if the screen is not updated much, the probability of sending a compression error after a certain time is expected to increase. Eventually, if a compression error is to be sent, a clearer (higher quality) image can be seen earlier on the transfer destination apparatus side by sending the compression error sooner.

  Conversely, if the interval between image updates is narrow, that is, if image updates occur frequently, even if a compression error is transmitted, the image update is performed immediately thereafter, and the meaning of transmitting the compression error is lost. The possibility increases. Therefore, it is possible to expect an effect of reducing transmission of useless compression error by lengthening the time until compression error transmission.

  A method of changing the waiting time according to the characteristics of the updated image is also conceivable. For example, if the number of colors used is very large (over the reference number), it is a natural picture or a very complex picture, and it is considered that the compression error is not noticeable. To do. On the contrary, when the number of colors used is small (less than the reference number), it is considered that the compression error is easily noticeable by a text editor or the like, and the time until the compression error transmission is short. Further, for example, if it is possible to acquire information on an application that generates an update image, it is possible to use the information. In other words, if the application is an editor, it may be possible to send the compression error early, or if it is an image viewer, the time until the compression error is sent may be increased.

(Second Embodiment)
In the first embodiment, if a predetermined condition is satisfied after the compressed image data is transferred, the compression error is transferred. In the second embodiment, the compression error is also compressed. It is intended to be transferred.

  FIG. 10 shows a configuration example of an information transfer apparatus according to the second embodiment of the present invention.

  As shown in FIG. 10, the information transfer apparatus 100 includes a display image generation unit 1, a display 2, an update image information acquisition unit 3, an update image compression unit 4, a compression error calculation unit 5, an update image transfer unit 6, and transfer. An image restoration unit 7, a data transfer unit 8, a compression error holding unit 9, a compression error transmission area determination unit 10, an error information transfer unit 11, a compression error compression unit 12, a compression error restoration 13, and a residual error calculation 14 are provided.

  That is, this configuration example is obtained by adding the compression error compression unit 12, the compression error restoration 13, and the residual error calculation 14 to the configuration example of FIG.

  Below, it demonstrates centering on the point which is different from 1st Embodiment.

  The compression error compressing unit 12 is a part that compresses the data of the compression error to be transmitted that is passed from the compression error holding unit 9. The method used for compression is not particularly limited. As described above, in the present embodiment, it is assumed that irreversible compression is used for compression of updated image data. However, a lossless compression method may be used for compression of a compression error, or irreversible. A compression method may be used. In addition, the compression method for the compression error may use the same compression method and the same compression parameters as the update image data compression method, or may use the same compression method as the update image data compression method and a different compression parameter. However, a compression method different from the compression method of the update image data may be used.

  The configuration example of FIG. 10 is a configuration example when an irreversible compression method is used for compression of a compression error. When the irreversible compression method is used, a compression error of compression error data is generated, so that a predetermined condition is set. When the above is established, the compression error with respect to the compression error data is transferred.

  When the lossless compression method is used for compression of the compression error, it is possible to transmit without the compression error of the compression error to be transmitted, so there is no need to transfer the compression error (residual error) with respect to the compression error data. In this case, the compression error restoration 13 and the residual error calculation 14 may be deleted from the configuration example of FIG.

  The compression error restoration 13 is a part for decoding compressed compression error data when an irreversible compression method is used for compression of a compression error.

  The residual error calculation 14 is a part for calculating a difference (residual error) between a compression error before compression and a compression error after decoding when an irreversible compression method is used for compression of the compression error. The calculation result data is transferred to the compression error holding unit 9. Alternatively, when the calculated result is smaller than a certain threshold value, the data may be discarded.

  The compression error holding unit 9 holds the residual error data passed from the residual error calculation 14 in the same manner as other compression errors, and notifies the compression error transmission area determination unit 10 of the information. Similar to the transfer of the compression error for the compressed image data, when the predetermined condition is satisfied (for example, when there is no image update for a certain period), the stored residual error is transmitted. As the conditions for determining the residual error transmission area by the compression error transmission area determination unit 10, various variations are conceivable as described above for the conditions for determining the compression error transmission area.

  An example of the operation procedure when the lossless compression method is used for compressing the compression error is that after calculating the compression error in step S5 of FIG. 4 or step S17 of FIG. In step S18 of step 5, the compressed compression error may be transmitted.

  An example of an operation procedure when the lossy compression method is used for compression of the compression error is, for example, after calculating the compression error in step S5 of FIG. 4 or step S17 of FIG. The compressed compression error is transmitted in step S8 or step S18 in FIG. 5, and the procedure in FIG. 11 may be executed after step S8 in FIG. 4 or step S18 in FIG.

  That is, the transferred compressed compression error is decoded by a decoding method corresponding to the compression method (step S21), and a residual error is obtained from the compression error before compression and the compression error obtained as a result of decoding (step S22). ).

  Here, waiting for the elapse of a certain time (step S23), when a predetermined condition is satisfied (for example, when the update area related to the transferred updated image information is not updated even after the elapse of the certain time). (Step S24), the residual error is transmitted (step S25).

  Of course, the above procedure is an example, and other procedures are possible.

  Note that a method of further compressing and transferring the above residual error is also possible. Further, when the lossy compression method is used for compressing the residual error, the difference between the residual error before compression and the decoded residual error after compression (referred to as a residual error) is set to a predetermined value. It is also possible to transfer data when the condition is satisfied. Also, a method of compressing and transferring the residual error is possible.

(Third embodiment)
In the first embodiment, if a predetermined condition is satisfied after the compressed image data is transferred, the compression error is transferred. In the second embodiment, the compression error is also compressed. It is intended to be transferred.

  FIG. 12 shows a configuration example of an information transfer apparatus according to the third embodiment of the present invention.

  As shown in FIG. 12, the information transfer apparatus 100 includes a display image generation unit 1, a display 2, an update image information acquisition unit 3, an update image compression unit 4, a compression error calculation unit 5, an update image transfer unit 6, and transfer. An image restoration unit 7, a data transfer unit 8, a compression error transmission area determination unit 10, an error information transfer unit 11, a display image holding unit 15, and a transfer image holding unit 16 are provided.

  That is, this configuration example is obtained by deleting the compression error holding unit 9 and adding the display image holding unit 15 and the transfer image holding unit 16 from the configuration example of FIG.

  An example of the operation procedure of the information transfer apparatus of this embodiment is the same as that shown in FIG.

  Below, it demonstrates centering on the point which is different from 1st Embodiment.

  The display image holding unit 15 is a part that holds an image currently being displayed. As a method for holding the display image, for example, a frame buffer (not shown) corresponding to the resolution of the screen is prepared, and if the screen is updated, the image is overwritten at that position.

  The transfer image holding unit 16 is a part that holds the transferred compressed image for a certain period. After a certain period of time, it is determined that it will not be used for transmission of compression error, and the stored transfer image is discarded. Also, when a new transfer image that completely includes the image area is stored, it may be determined that it is not used for transmission of a compression error and discarded. As a result, the amount of memory to be used can be further reduced. When the compression error calculation unit 5 requests a transfer image in the designated area, the transfer image related to that area is passed.

  In this embodiment, the compression error transmission region determination unit 10 notifies the compression error calculation unit 5 of the region for which transmission of compression error has been determined. Upon receiving the notification, the compression error calculation unit 5 acquires the display image of the area from the display image holding unit 15 and the transferred image from the transfer image holding unit 16. Since the transfer image is a compressed image, the transfer image restoration unit 7 restores the image. A compression error is obtained by obtaining a difference between the obtained display image and the restored image. The obtained compression error is passed to the error information transfer unit 11.

  In the present embodiment, it is not necessary to restore the compressed image or calculate the compression error for all the images that have been updated, and the amount of processing is required to obtain the compression error only in the area where it is determined to transfer the compression error. Less is enough.

  In the second embodiment, the function of compressing and transferring the compression error is provided in the first embodiment, but the compression error of the second embodiment is compressed in the third embodiment. Of course, an embodiment provided with a transfer function is also possible.

Each of the above functions can be realized even if it is described as software and processed by a computer having an appropriate mechanism.
The present embodiment can also be implemented as a program for causing a computer to execute predetermined means, causing a computer to function as predetermined means, or causing a computer to realize predetermined functions. In addition, the present invention can be implemented as a computer-readable recording medium that records the program.

  Note that the present invention is not limited to the above-described embodiment as it is, and can be embodied by modifying the constituent elements without departing from the scope of the invention in the implementation stage. In addition, various inventions can be formed by appropriately combining a plurality of components disclosed in the embodiment. For example, some components may be deleted from all the components shown in the embodiment. Furthermore, constituent elements over different embodiments may be appropriately combined.

The figure which shows the structural example of the information transfer apparatus which concerns on the 1st Embodiment of this invention. The figure which shows the structural example of the system using the information transfer apparatus of each embodiment of this invention. The figure which shows the other structural example of the system using the information transfer apparatus of each embodiment of this invention. The flowchart which shows an example of the operation | movement procedure of the information transfer apparatus which concerns on the embodiment The flowchart which shows the other example of the operation | movement procedure of the information transfer apparatus which concerns on the embodiment The figure which shows an example of the image displayed on the display of the information transfer apparatus which concerns on the embodiment The figure which shows an example of the image which the compression error displayed with the projector generate | occur | produced The figure for demonstrating the error image between the image of FIG. 6, and the image of FIG. The figure for demonstrating the update of a part of image displayed on the display of the information transfer apparatus which concerns on the embodiment The figure which shows the structural example of the information transfer apparatus which concerns on the 2nd Embodiment of this invention. The flowchart which shows an example of the operation | movement procedure of the information transfer apparatus which concerns on the embodiment The figure which shows the structural example of the information transfer apparatus which concerns on the 3rd Embodiment of this invention.

Explanation of symbols

  DESCRIPTION OF SYMBOLS 1 ... Display image generation part, 2 ... Display, 3 ... Update image information acquisition part, 4 ... Update image compression part, 5 ... Compression error calculation part, 6 ... Update image transfer part, 7 ... Transfer image restoration part, 8 ... Data Transfer unit, 9 ... compression error holding unit, 10 ... compression error transmission area determination unit, 11 ... error information transfer unit, 12 ... compression error compression unit, 13 ... compression error restoration, 14 ... residual error calculation, 15 ... display image holding 16 Transfer image holding unit

Claims (13)

Updating means for updating an image of all or part of the area in the display screen;
An image update position in the display screen related to the image update and an acquisition means for acquiring the update image;
Update image compression means for compressing the update image;
A first transfer means for transferring a post-compression update image obtained by the compression and update image information including the image update position to a transfer destination device;
Decoding means for decoding the post-compression updated image by a decoding method corresponding to the compression method related to the compression;
Calculation means for calculating a compression error between the original update image to be compressed and an update image obtained by decoding the post-compression update image related to the original update image; ,
Determining means for determining to transfer error information including the compression error to the transfer destination device;
An information transfer apparatus comprising: second transfer means for transferring the error information determined by the determination means to the transfer destination apparatus.   The determining means has not yet transferred the error information, and the display area of the updated image related to the error information in the display screen is updated for a reference time or more after the update related to the updated image. The information transfer apparatus according to claim 1, wherein if it is not, it is determined that the compression error is transferred.   The information transfer apparatus according to claim 2, wherein the determination unit includes a reference time adjustment unit that adjusts the reference time based on attribute information related to the updated image related to the error information.   The reference time adjusting means adjusts the reference time longer if the image is frequently updated by the updating means, and adjusts the reference time shorter if not. 4. The information transfer device according to 3.   The reference time adjusting means adjusts the reference time longer when the number of colors used in the updated image related to the error information is equal to or larger than the reference number, and adjusts the reference time shorter when not. The information transfer apparatus according to claim 3, wherein:   When the updating means is based on one or a plurality of application programs, the reference time adjusting means is an editor that adjusts the reference time longer if the application program related to the error information is an image viewer. 4. The information transfer apparatus according to claim 3, wherein the reference time is adjusted to be short in some cases.   The information transfer apparatus according to claim 1, wherein the decoding unit and the calculation unit perform the decoding and the calculation prior to determination by the determination unit.   2. The information transfer apparatus according to claim 1, wherein the decoding unit and the calculation unit perform the decoding and the calculation only on error information determined to be transferred to the transfer destination apparatus by the determination unit. A compression error compression means for compressing the compression error;
The second transfer unit transfers error information including a compression error after compression obtained by the compression error compression unit to the transfer destination device with respect to the error information determined by the determination unit. The information transfer apparatus according to claim 1.   The compression error compression unit compresses the compression error using a compression method different from a compression method used when the update image compression unit compresses the update image, or the same compression method and a different compression parameter. The information transfer apparatus according to claim 1. Means for decoding the compressed error after compression by a decoding method corresponding to the compression method related to the compression;
Means for calculating a compression error between them based on an original compression error to be compressed and a compression error obtained by decoding the post-compression compression error related to the original compression error;
Means for determining to transfer residual information including a compression error between the compression errors to the transfer destination device;
11. The information transfer apparatus according to claim 9, further comprising means for transferring the remaining information determined by the means to the transfer destination apparatus. An acquisition step of acquiring an image update position in the display screen and an update image thereof related to an image update in the display screen;
An update image compression step of compressing the update image;
A first transfer step of transferring a post-compression update image obtained by the compression and update image information including the image update position to a transfer destination device;
A decoding step of decoding the post-compression updated image by a decoding method corresponding to the compression method related to the compression;
A calculation step for calculating a compression error between the original update image to be compressed and an update image obtained by decoding the post-compression update image related to the original update image; ,
A determination step for determining to transfer error information including the compression error to the transfer destination device;
And a second transfer step of transferring the error information determined in the determination step to the transfer destination device. In a program for causing a computer to function as an information transfer device,
The program is
An acquisition step of acquiring an image update position in the display screen related to an image update in the display screen and the updated image;
An update image compression step of compressing the update image;
A first transfer step of transferring a post-compression update image obtained by the compression and update image information including the image update position to a transfer destination device;
A decoding step of decoding the post-compression updated image by a decoding method corresponding to the compression method related to the compression;
A calculation step for calculating a compression error between the original update image to be compressed and an update image obtained by decoding the post-compression update image related to the original update image; ,
A determination step for determining to transfer error information including the compression error to the transfer destination device;
A program causing a computer to execute a second transfer step of transferring the error information determined in the determination step to the transfer destination device.

Images