JP4588086B2 - Image transmission apparatus, image transmission method, and image transmission program - Google Patents

Description

  The present invention relates to an image transmission device, an image transmission method, and an image transmission program.

  As the processing performance of computers has progressed significantly, its use is becoming more widespread. For example, an individual user owns a plurality of computers, and there are increasing opportunities to use the computers in different working environments for each computer. In this case, usually, input / output devices such as a keyboard, a display, and a mouse are connected to a plurality of computers via a switch to reduce space and cost.

  Such a switch is generally called a KVM (K: Keyboard, V: Video, M: Mouse) switch. The switch is connected between the input / output device and the plurality of computers, and activates the connection between the input / output device and only one of the plurality of computers. The user can select and use a computer to be connected to the input / output device from among a plurality of computers using the switch.

  However, in such a conventional switching device, it is necessary to perform an operation from a mouse and a keyboard connected to the switching device, and there is a problem that the operation cannot be performed unless the user is present. As a switch for solving such a problem, a switch that can be operated remotely has been proposed.

  According to the switch that can be operated remotely, the computer connected to the switcher can be accessed not only from the mouse and keyboard connected to the switcher, but also from a PC installed remotely via the network. can do. The technique of patent document 1 is proposed about such a conventional switch. According to the switch described in Patent Document 1, a plurality of computers can be switched remotely from another computer having an input device.

  Moreover, the technique of patent document 2 is proposed regarding the screen display technique regarding a switch. According to the central monitoring and control system described in Patent Document 2, a personal computer connected to a host computer via a network is used as a remote terminal, screen display information on the computer display is transmitted by an X window system, and the remote terminal is operated by a mouse. The screen switching is notified to the host computer through the keyboard, so that the screen display and the operation function equivalent to the monitoring control display of the host computer can be obtained on the computer display.

Further, although not related to a switch, a technique described in Patent Document 3 has been proposed as a technique related to cursor control. The pointing cursor predictive moving apparatus described in Patent Document 3 detects the movement progress of the mouse cursor, predicts the final object, and skips the cursor to the icon of the object, thereby reducing the movement time of the cursor. It is.
JP 2001-344189 A Japanese Patent Laid-Open No. 9-69010 Japanese Patent Laid-Open No. 3-48922

  However, in the conventional switch, the image output is A / D converted from analog to digital for each scanning line and transmitted to a remote control computer connected via a network, so that the screen to be transmitted becomes wider. A / D conversion took time and the frame rate was lowered. This frame rate depends on the conversion processing speed. The display for pointing like a mouse cursor has a problem that the pointing accuracy is lowered when the frame rate is lowered.

  Further, in the conventional switch, the image data input from the selected computer is acquired at 1 / n of the scanning frequency F (1 ≦ n <scanning frequency), and the acquired image and the previously acquired image are obtained. It has also been proposed to extract a line or block including a difference as a result of comparison and send the extracted line or block to a remote control computer. Since the points are checked, the frame rate decreases as the screen size increases. Also, the frame rate decreases when the screen change is large. For this reason, the mouse cursor display update frequency also decreases with the frame rate, which causes a problem of pointing problems.

  Although the pointing cursor predictive moving apparatus described in Patent Document 3 can shorten the moving time of the cursor, this apparatus cannot eliminate the decrease in pointing accuracy based on the decrease in the frame rate.

  Accordingly, the present invention has been made to solve these problems, and provides an image transmission device, an image transmission method, and an image transmission program that can ensure pointing accuracy even when the frame rate of the screen is low. Objective.

  The image transmission device according to claim 1 is an image transmission device that transmits an image to an information processing device connected to a predetermined network, an acquisition unit that acquires position information of a cursor from the information processing device, and the acquisition Based on the cursor position information acquired by the means, an image extracting means for extracting a cursor peripheral image from an image storage means for storing an image to be transmitted to the information processing device, and a cursor peripheral image extracted by the image extracting means Cursor image transmission means for transmitting to the information processing apparatus.

  According to the first aspect of the present invention, the cursor peripheral image is extracted from the image storage unit based on the cursor position information acquired from the information processing apparatus, and the extracted cursor peripheral image is transmitted to the information processing apparatus. Therefore, the frame rate of the cursor can be improved. Thereby, pointing accuracy can be secured.

  According to a second aspect of the present invention, in the image transmitting apparatus according to the first aspect, the image extracting unit is configured to transmit the first image transmitted to the information processing apparatus and the first image after the first image. A difference between the second image to be transmitted is taken to detect the presence or absence of a change in the image, and a predetermined region including a change in the second image with respect to the first image is extracted. According to the second aspect of the present invention, since the predetermined area including the change amount of the second image with respect to the first image is extracted, the frame rate of the cursor can be further improved.

  According to a third aspect of the present invention, the image transmission device according to the first or second aspect further includes an image transmission unit that transmits an entire image to the information processing device, and the image transmission unit includes: When the position information of the cursor is acquired from the information processing apparatus, the transmission of the entire image to the information processing apparatus is stopped, and after the cursor peripheral image is transmitted by the cursor image transmission means, the information processing apparatus The transmission of the entire image is resumed.

  According to the third aspect of the present invention, when the position information of the cursor is acquired from the information processing apparatus, the transmission of the entire image to the information processing apparatus is stopped, and the cursor peripheral image is transmitted to the information processing apparatus. Since the transmission of the entire image is resumed, the frame rate of the cursor can be improved even when the frame rate of the entire screen is low. Thereby, pointing accuracy can be secured.

  An image transmission method according to claim 4 is an image transmission method for transmitting an image to an information processing apparatus connected to a predetermined network. In the image transmission method, an acquisition step of acquiring position information of a cursor from the information processing apparatus; Based on the cursor position information acquired in the acquisition step, an image extraction step of extracting a cursor peripheral image from an image storage unit that stores an image to be transmitted to the information processing device; and a cursor peripheral image extracted in the image extraction step A cursor image transmission step of transmitting the information to the information processing apparatus.

  According to the fourth aspect of the invention, the cursor peripheral image is extracted from the image storage unit based on the cursor position information acquired from the information processing apparatus, and the extracted cursor peripheral image is transmitted to the information processing apparatus. Therefore, the frame rate of the cursor can be improved. Thereby, pointing accuracy can be secured.

  Further, according to the present invention, as described in claim 5, in the image transmission method according to claim 4, the image extraction stage includes a first image to be transmitted to the information processing apparatus, and a next of the first image. The difference between the first image and the second image to be transmitted is taken to detect the presence or absence of a change in the image, and a predetermined region including the change in the second image with respect to the first image is extracted.

  According to the fifth aspect of the present invention, since the predetermined region including the change amount of the second image with respect to the first image is extracted, the frame rate of the cursor can be further improved.

  The image transmission method according to claim 6 further includes an image transmission step of transmitting an entire image to the information processing apparatus in the image transmission method according to claim 4 or 5, wherein the image transmission step includes: When the position information of the cursor is acquired from the information processing apparatus, the transmission of the entire image to the information processing apparatus is stopped, and the cursor peripheral image is transmitted to the information processing apparatus after the cursor image transmission step. The transmission of the entire image is resumed.

  According to the sixth aspect of the present invention, when the position information of the cursor is acquired from the information processing apparatus, the transmission of the entire image to the information processing apparatus is stopped, and the cursor peripheral image is transmitted to the information processing apparatus. Since the transmission of the entire image is resumed, the frame rate of the cursor can be improved even when the frame rate of the entire screen is low. Thereby, pointing accuracy can be secured.

  An image transmission method according to claim 7 is the image transmission method according to any one of claims 4 to 6, further comprising: image processing for performing image processing on an entire image to be transmitted to the information processing apparatus. The image processing step stops image processing of the whole image when the position information of the cursor is acquired from the information processing apparatus, and transmits the cursor peripheral image by the cursor image transmission means. The image processing of the whole image is resumed later.

  According to the seventh aspect of the present invention, when the position information of the cursor is acquired from the information processing apparatus, the image processing of the entire image is stopped and the image processing of the entire image is resumed after transmitting the cursor peripheral image. As a result, the frame rate of the cursor can be improved even when the frame rate of the entire screen is low. Thereby, pointing accuracy can be secured.

  Further, according to the present invention, as described in claim 8, in the image transmission method according to any one of claims 4 to 7, the image transmission step includes a first image acquired from the computer. And a second image acquired next to the first image to detect the presence or absence of a change in the image, and a predetermined area including a change in the second image with respect to the first image is detected. It transmits to the said information processing apparatus, It is characterized by the above-mentioned.

  According to the eighth aspect of the present invention, the difference between the first image acquired from the computer and the second image is taken to detect whether the image has changed, and the amount of change in the second image relative to the first image is detected. Since only the predetermined area including the image data is supplied to the information processing apparatus, the frame rate of the entire screen can be improved.

  Further, according to the present invention, as described in claim 9, in the image transmission method according to any one of claims 4 to 8, the image extraction step includes: It is characterized by extracting. According to the ninth aspect of the present invention, since the cursor peripheral image is extracted at every predetermined interval, the frame rate of the cursor can be improved even when the frame rate of the entire screen is low.

  Further, according to the present invention, as described in claim 10, in the image transmission method according to claim 9, the predetermined interval is changed based on a set value from the information processing apparatus. . According to the tenth aspect of the present invention, the predetermined interval can be changed based on the setting value from the remote control computer, so that the frame rate of the cursor can be arbitrarily set.

  Further, according to the present invention, as described in claim 11, in the image transmission method according to claim 9, the predetermined interval is changed according to a congestion state of the network. According to the eleventh aspect of the invention, since the predetermined interval is changed according to the network congestion status, the frame rate of the cursor is changed according to the network congestion status.

  An image transmission method according to a twelfth aspect of the present invention is the image transmission method according to any one of the fourth to eleventh aspects, further comprising an image compression step of compressing an image to be transmitted to the information processing apparatus. It is characterized by that. According to the twelfth aspect of the invention, since the image to be transmitted to the information processing apparatus is compressed, the frame rate can be improved.

  Further, according to the present invention, as described in claim 13, in the image transmission method according to claim 12, the image compression stage changes a compression method or a compression rate according to a network congestion state. And According to the thirteenth aspect of the present invention, since the compression method or the compression rate is changed according to the congestion status of the network, the image can be transmitted according to the network status.

  The image transmission program according to claim 14 is a computer for transmitting an image to an information processing apparatus connected to a predetermined network, an acquisition means for acquiring cursor position information from the information processing apparatus, and the acquisition means. An image extracting means for extracting a cursor peripheral image from an image storage means for storing an image to be transmitted to the information processing device based on the position information of the cursor acquired by the step, and the cursor peripheral image extracted by the image extracting means It functions as a cursor image transmission means for transmitting to the apparatus.

  According to the fourteenth aspect of the present invention, the cursor peripheral image is extracted from the image storage means based on the cursor position information acquired from the information processing apparatus, and the extracted cursor peripheral image is transmitted to the information processing apparatus. Therefore, the frame rate of the cursor can be improved. Thereby, pointing accuracy can be secured.

  Further, according to the present invention, as described in claim 15, in the image transmission program according to claim 14, the image extraction means includes a first image to be transmitted to the information processing apparatus, and the next of the first image. The difference between the first image and the second image to be transmitted is taken to detect the presence or absence of a change in the image, and a predetermined region including the change in the second image with respect to the first image is extracted.

  According to the fifteenth aspect of the present invention, since the predetermined area including the change amount of the second image with respect to the first image is extracted, the frame rate of the cursor can be further improved.

  An image transmission program according to a sixteenth aspect is the image transmission program according to the fourteenth or fifteenth aspect, further comprising image transmission means for transmitting an entire image to the information processing apparatus, wherein the image transmission means When the position information of the cursor is acquired from the information processing apparatus, the transmission of the entire image to the information processing apparatus is stopped, and the cursor peripheral image is transmitted to the information processing apparatus after the cursor image transmission step. The transmission of the entire image is resumed.

  According to the invention described in claim 16, when the position information of the cursor is acquired from the information processing apparatus, the transmission of the entire image to the information processing apparatus is stopped, and after the cursor peripheral image is transmitted, Since the transmission of the entire image is resumed, the frame rate of the cursor can be improved even when the frame rate of the entire screen is low. Thereby, pointing accuracy can be secured.

  An image transmission program according to claim 17 is the image transmission program according to any one of claims 14 to 16, and further performs image processing for performing image processing of an entire image to be transmitted to the information processing apparatus. And the image processing means stops the image processing of the entire image when the position information of the cursor is acquired from the information processing apparatus, and transmits the cursor peripheral image by the cursor image transmission means. The image processing of the whole image is resumed later.

  According to the seventeenth aspect of the present invention, when the position information of the cursor is acquired from the information processing apparatus, the image processing of the entire image is stopped and the image processing of the entire image is restarted after transmitting the cursor peripheral image. As a result, the frame rate of the cursor can be improved even when the frame rate of the entire screen is low. Thereby, pointing accuracy can be secured.

  Further, according to the present invention, as described in claim 18, in the image transmission program according to any one of claims 14 to 17, the image transmission unit transmits the first information to the information processing apparatus. A difference between the first image and the second image transmitted next to the first image is detected to detect the presence or absence of a change in the image, and a predetermined amount including a change in the second image with respect to the first image is detected. The region is transmitted to the information processing apparatus.

  According to the eighteenth aspect of the present invention, the difference between the first image acquired from the computer and the second image is taken to detect whether the image has changed, and the amount of change in the second image relative to the first image is detected. Since only the predetermined area including the image data is supplied to the information processing apparatus, the frame rate of the entire screen can be improved.

  Further, according to the present invention, as set forth in claim 19, in the image transmission program according to any one of claims 14 to 18, the image extraction means displays the cursor peripheral image at predetermined intervals. It is characterized by extracting. According to the nineteenth aspect of the invention, since the cursor peripheral image is extracted at every predetermined interval, the frame rate of the cursor can be improved even when the frame rate of the entire screen is low.

  Further, according to the present invention, as described in claim 20, in the image transmission program according to claim 19, the predetermined interval is changed based on a set value from the information processing apparatus. . According to the twentieth aspect, since the predetermined interval can be changed based on the set value from the remote control computer, the frame rate of the cursor can be arbitrarily set.

  According to a twenty-first aspect of the present invention, in the image transmission program according to the nineteenth aspect, the predetermined interval is changed according to a congestion state of the network. According to the twenty-first aspect of the present invention, the predetermined interval is changed according to the network congestion status, so the cursor frame rate is changed according to the network congestion status.

  An image transmission program according to claim 22 is the image transmission program according to any one of claims 14 to 21, further comprising image compression means for compressing an image to be transmitted to the information processing apparatus. It is characterized by that. According to the twenty-second aspect, since the image to be transmitted to the information processing apparatus is compressed, the frame rate can be improved.

  According to a twenty-third aspect of the present invention, in the image transmission program according to the twenty-second aspect, the image compression unit changes a compression method or a compression rate in accordance with a network congestion state. And According to the twenty-third aspect of the present invention, since the compression method or the compression rate is changed according to the congestion status of the network, the image can be transmitted according to the network status.

  As described above, according to the present invention, it is possible to provide an image transmission apparatus, an image transmission method, and an image transmission program that can ensure pointing accuracy even when the frame rate of the screen is low.

  Hereinafter, an embodiment to which the present invention is applied will be described. FIG. 1 is a block diagram for explaining a switch according to the present embodiment. As shown in FIG. 1, the switch 10 is connected to a plurality of servers S1 to Sn, a mouse 20, a keyboard 21, and a display 22 for operating the servers S1 to Sn from nearby locations.

  Further, remote control computers 31 and 32 for operating the servers S1 to Sn from a remote place are connected to the switcher 10 via a network 30. In the present embodiment, the network 30 will be described using Ethernet (registered trademark) which is a bus-type LAN (local area network).

  The switcher 10 includes an image processing unit 11, a network conversion circuit 13, a packet filtering circuit 14, a controller 15, an analog SW2, a keyboard / mouse (KBMS) control microcomputer 16, and KBMS emulation controllers KC1 to KCn. . The switch 10 corresponds to an information processing device and an image transmission device.

  The image processing unit 11 is for performing predetermined processing to send analog RGB signals from the servers S1 to Sn to the remote control computers 31 and 32 on the network 30. The image processing unit 11 includes a controller 110, an A / D conversion circuit 111, a memory 112, an image compression circuit 113, and an analog SW1.

  The analog SW1 switches the servers S1 to Sn accessed by the remote operation computers 31 and 32. The analog SW 1 can be switched by operating a switch (not shown) provided in the switch 10. The analog SW 1 can also switch the connection destination from the remote control computers 31 and 32.

  The controller 110 controls the entire image processing unit 11. The controller 110 is obtained from the servers S1 to Sn (computers) based on acquisition means for acquiring cursor position information from the remote control computers 31 and 32 based on a predetermined program, and on the cursor position information acquired by the acquisition means. It functions as an image extraction unit that extracts a cursor peripheral image from a memory 112 (image storage unit) that stores an image, and a cursor image transmission unit that transmits the cursor peripheral image extracted by the image extraction unit to the remote control computers 31 and 32.

  At this time, when extracting the cursor peripheral image, the controller 110 takes the difference between the first image acquired from the servers S1 to Sn and the second image acquired next to the first image, and extracts the image. The presence / absence of a change may be detected, and only a predetermined region including a change amount of the second image with respect to the first image may be extracted.

  The controller 110 also functions as an image transmission unit that transmits the entire image to the remote operation computers 31 and 32 based on a predetermined program. The image transmission means stops the transmission of the entire image to the remote operation computers 31 and 32 when the position information of the cursor is acquired from the remote operation computers 31 and 32, and the cursor image transmission means transmits the cursor peripheral image. Later, transmission of the entire image to the remote control computers 31 and 32 is resumed.

  In addition, the controller 110 instructs the image processing means to perform image processing of the entire image to be transmitted to the remote control computers 31 and 32 based on a predetermined program. This image processing means stops the image processing of the entire image when the position information of the cursor is acquired from the remote control computers 31 and 32, and after the cursor peripheral image is transmitted by the cursor image transmitting means, the image processing of the entire image is performed. To resume. This image processing is, for example, A / D conversion performed by the A / D conversion circuit 111.

  Further, when the controller 110 transmits the entire image based on a predetermined program, the controller 110 calculates a difference between the first image acquired from the servers S1 to Sn and the second image acquired next to the first image. Thus, the presence / absence of a change in the image is detected, and a predetermined area including the change in the second image with respect to the first image is transmitted to the remote control computer.

  The image extracting means may extract a cursor peripheral image at predetermined intervals. The predetermined interval may be changed based on the set value from the remote operation computers 31 and 32. Further, the predetermined interval may be changed according to the congestion status of the network.

  The A / D conversion circuit 111 converts analog RGB signals from the servers S1 to Sn into digital signals for transmission over the network. The memory 112 stores image data from the server side. This memory 112 corresponds to image storage means.

  The image compression circuit 113 compresses an image to be transmitted to the remote operation computer based on a predetermined compression method or compression rate. In the image compression circuit 113, the compression method or the compression rate may be changed according to the congestion status of the network 30. This image compression circuit 113 corresponds to image compression means. In the example shown in FIG. 1, the image compression means is realized by hardware, but the image compression means can also be realized by software. When realized by software, a predetermined program is loaded and executed by the controller 110.

  The predetermined compression method or compression rate can be appropriately changed according to the congestion status of the network under the control of the controller 15. In addition, by performing a predetermined operation on the remote operation computers 31 and 32, the compression method or compression rate in the image compression circuit 113 can be changed. As a compression method, for example, there are methods such as JPEG and MPEG.

  In FIG. 1, an example in which the image processing unit 11 is configured as one is described, but a plurality of the image processing units 11 may be provided. By providing a plurality of image processing units 11, the servers S1 to Sn can be simultaneously accessed from a plurality of remote control computers 31, 32, and the like. The image processing unit 11 can be configured by a board, and by increasing the number of boards, the number of users who can access the servers S1 to Sn can be increased.

  The network conversion circuit 13 is for connecting the switch 10 to the LAN. The network conversion circuit 13 converts the digital signal from the image processing unit 11 or the digital signal from the keyboard / mouse control microcomputer 16 into a packet and outputs the packet on the network. The packet filtering circuit 14 adds the amount of packet data received by the network conversion circuit 13.

  The controller 15 controls the entire switch 10. The controller 15 sends the absolute coordinate values of the mouse received from the remote control computers 31 and 32 to the KBMS control microcomputer 16 and also to the image processing unit 11. The controller 15 controls the compression method or compression rate in the image compression circuit 113.

  The keyboard / mouse control microcomputer 16 controls the mouse and keyboard connected to the mouse 20, keyboard 21, and remote operation computers 31, 32 for each of the servers S1 to Sn.

  Next, the remote control computer will be described. The remote control computers 31 and 32 correspond to information processing apparatuses. FIG. 2 is a block diagram showing a configuration of the remote operation computer 32. As shown in FIG. 2, the remote control computer 32 includes a central processing unit (CPU) 33, a CPU bus 34, a main storage device 35, a system bus 36, a bus bridge 37, an expansion slot 38, a display board 39, a keyboard controller 40, A mouse I / F 41 and a network control unit 42;

  The CPU 33 is a processor that controls the information processing apparatus, and is connected to the main storage device 35 via the CPU bus 34. The bus bridge 37 is a bridge for connecting the CPU bus 34 and the system bus 36. The expansion slot 38 is a slot for connecting various peripheral devices to the remote control computer 32. In this example, the display board 39, the keyboard controller 40, the mouse I / F 41, and the network control unit 42 are connected. Yes.

  A display device 46, a keyboard 47, and a pointing device (mouse) 48 are connected to the display board 39, the keyboard controller 40, and the mouse I / F 41 through cables 43 to 45, respectively. FIG. 3 is a configuration diagram showing details of the display board 39 and the display device 46 in FIG. The display board 39 includes a display controller 39a and a graphic memory 39b.

  The display controller 39a has a function of writing and reading display data to and from the graphic memory 39b based on a command given from the CPU 33 via the system bus 36 and generating display data to the display device 46.

  In the remote operation computer 32 and the display device 46 thus configured, the display operation is performed as follows. That is, the control command from the CPU 33 is written to the display controller 39a of the display board 39 through the path of the CPU bus 34, the bus bridge 37, the system bus 36, and the expansion slot 38, and further, the graphic memory 39b controlled by the display controller 39a. Is written to.

  The display controller 39a refers to the contents of the graphic memory 39b and converts the contents into an I / F signal that can be displayed on the display device 46. This I / F signal is transferred to the display device 46 via the cable 43 and displayed.

  The CPU 33, based on a predetermined program, first means for acquiring cursor position information, second means for transmitting cursor position information acquired by the first means to the switch 10 (information processing apparatus), switching The display controller 39a is instructed to synthesize the second image corresponding to the position information of the cursor transmitted by the second means acquired from the switch 10 with the first image acquired from the switch 10. The display controller 39a outputs the synthesized image to the display device 46.

  FIG. 4 is an explanatory diagram showing a hierarchical structure of software and hardware in the remote operation controller 32. In FIG. 4, 201 is an application, 202 is an OS (Operating System), 203 is a display driver, 204 is a keyboard driver, and 205 is a pointing driver. These are software layers.

  In such a hierarchical structure, the application 201 notifies the OS 202 by an API (Application Programming Interface) defined by the OS 202. The OS 202 notifies the display driver 203 by GDI (Graphics Device Interface) defined by the OS 202. The display driver 203 directly controls the display board 7 through the above-described path.

  The display content requested by the application 201 is displayed on the display device 46 by such a process. The input from the keyboard 47 passes through the cable 44 and is notified to the keyboard driver 204 by the keyboard controller 40. The contents are stored in the OS 202 by the keyboard driver 204, and the stored contents are read by the key input request API from the application 201 and passed to the application 201.

  The input from the pointing device (mouse) 48 passes through the cable 45 and is notified to the pointing device driver 205 by the mouse I / F 41. The pointing device driver 205 converts the contents into information such as cursor coordinates and button presses, and notifies the OS 202 of the contents. The OS 202 notifies the application 201 of the information, and the application 201 determines the state of the pointing device 48 based on the notification content from the OS 202 and performs corresponding processing.

  The predetermined remote operation application calculates absolute coordinates from the acquired relative coordinate values of the mouse based on the relative coordinate values of the mouse acquired from the OS 202 and the resolution of the target computer acquired in advance from the switch 10. The remote operation application transmits mouse data converted into absolute coordinates to the switch 10.

  Next, the image processing unit of the switch 10 will be described. FIG. 5 is a diagram for explaining the image processing unit 11. In the image acquisition step S11, the image processing unit 11 of the switcher 10 acquires the image data input from the selected servers S1 to Sn at 1 / n of the scanning frequency F. Here, n is 1 ≦ n <scanning frequency.

  In the A / D conversion step S12, the A / D conversion circuit 111 converts the entire image data acquired from the servers S1 to Sn from analog to digital for each scanning line. In the frame skipping step S13, the controller 110 performs frame skipping. The images input from the servers S1 to Sn are about 60 Hz, and the change area extraction in the change area extraction step, which will be described later, may not end within 1/60 seconds, so it is necessary to perform frame decimation. The screen data that has undergone frame thinning is stored in the memory 112.

  In the change area extraction step S14, the controller 110 detects the presence or absence of an image change by taking the difference between the first image obtained from the servers S1 to Sn and the second image acquired next to the first image. When there is a change, a predetermined region including a change amount of the second image with respect to the first image is extracted.

  In the network transmission step S <b> 15, the controller 110 transmits a predetermined area including a change amount of the second screen relative to the first screen to the remote operation computer 32 via the network conversion circuit 13. Note that the image output from the controller 110 is compressed by the image compression circuit 113 as necessary.

  Next, another operation example of the image processing unit 11 will be described. FIG. 6 is another example of the operation performed by the image processing unit 110, and is a diagram illustrating a processing flow for transmitting a mouse cursor peripheral image using an input of mouse coordinates as a trigger. In the image acquisition step S21, the image processing unit 11 acquires the image data from the selected servers S1 to Sn at 1 / n of the scanning frequency F.

  In the A / D conversion step S22, the A / D conversion circuit 111 converts the acquired entire image data from analog to digital. The A / D conversion circuit 111 temporarily stops A / D conversion of the entire image data, triggered by the input of mouse coordinates from the remote operation computer 32, and displays the mouse cursor peripheral image calculated from the absolute coordinates of the mouse. After the extraction, A / D conversion of the entire image may be resumed. In the frame decimation step S23, 1 / n frame decimation is performed on the digitally converted image.

  In the change area extraction step S24, the controller 110 detects the presence / absence of an image change by taking the difference between the first image obtained from the servers S1 to Sn and the second image acquired next to the first image. When there is a change, a predetermined region including a change amount of the second image with respect to the first image is extracted. The controller 110 transmits the extracted area to the remote operation computer in the network transmission step S28.

  In addition, when the controller 110 acquires the absolute coordinates of the mouse from the remote operation computer 32 in the change area extraction step S24, the controller 110 proceeds to the frame data acquisition step S25. In the frame data acquisition step S <b> 25, the controller 110 acquires the latest frame data from the memory 112.

  Next, in mouse cursor area extraction step S26, the controller 110 extracts a mouse cursor peripheral image. That is, the controller 110 calculates the mouse cursor position on the image output from the servers S1 to Sn based on the absolute coordinates of the mouse acquired from the remote operation computer. The controller 110 extracts image data of the corresponding block and neighboring blocks from the image stored in the memory 112 based on the calculated mouse cursor position. Thereby, the mouse cursor peripheral image is extracted.

  At this time, the controller 110 holds the previously calculated mouse cursor position in the memory 112, and also extracts image data of the corresponding block and neighboring blocks corresponding to the previously calculated mouse cursor position. Here, the reason why the corresponding block and the neighboring block corresponding to the previously calculated mouse cursor position are also calculated is to erase the mouse cursor at the original position when displayed.

  In addition, when the controller 110 extracts the image data of the corresponding block and the neighboring block from the image stored in the memory 112 based on the calculated mouse cursor position in the mouse cursor region extracting step S26, the controller 110 stores the image data stored in the memory 112. The difference between the first image acquired from the servers S1 to Sn and the second image acquired next to the first image is detected to detect whether the image has changed, and the second image with respect to the first image is detected. Only a predetermined area including the change in the image may be extracted.

  FIG. 7 is a diagram for explaining the corresponding blocks and neighboring blocks extracted by the controller 110. As shown in FIG. 7A, it is assumed that the mouse cursor is initially at the position X1 on the display device. Next, as shown in FIG. 7B, it is assumed that the mouse cursor has moved to the position X2 on the display device.

  As shown in FIG. 7C, the controller 110 extracts the image data of the neighboring block X20 excluding the corresponding block X2 and the corresponding block X2 from the current image stored in the memory 112 based on the calculated mouse cursor position. To do. Similarly, the controller 110 extracts image data of the neighboring block X10 excluding the corresponding block X1 and the corresponding block X1 from the current image stored in the memory 112 based on the previously calculated mouse cursor position. The image of the corresponding block or the image of the neighboring block is referred to as a mouse cursor peripheral image. In the present embodiment, the controller 110 extracts both the corresponding block and the neighboring block, but may extract only the corresponding block.

  In the network transmission step S <b> 27, the controller 110 adds position information to the extracted mouse cursor peripheral image and transmits it to the remote operation computer 32.

  Returning to the change area extraction step S24, the controller 110 takes the difference between the first image obtained from the servers S1 to Sn and the second image acquired next to the first image to determine whether the image has changed. When a change is detected, a predetermined region including a change amount of the second image with respect to the first image is extracted. The controller 110 transmits the extracted area to the remote operation computer 32 in the network transmission step S28.

  Thus, the controller 110 cuts out the previous and current mouse cursor peripheral images and sends them to the remote operation computer 32 in the mouse cursor region extraction step S26, so that the remote operation computer side receives the received mouse cursor peripheral images and positions. By displaying on the display device based on the information, the mouse cursor disappears at the previous position and is displayed at the current position. In other words, the peripheral image of the mouse cursor is preferentially transmitted, and then the remaining images are detected and transmitted sequentially, so that only the mouse cursor moves first on the display device of the remote control computer. Is displayed.

  Next, still another operation example of the image processing unit will be described. FIG. 8 is a diagram illustrating a processing flow in which the image processing unit performs a mouse cursor area extraction process for each predetermined period. In the image acquisition step S31, the image processing unit 10 acquires the image data from the selected servers S1 to Sn at 1 / n of the scanning frequency F. In the A / D conversion step S32, the A / D conversion circuit 111 converts the acquired entire image data from analog to digital.

  In the frame decimation step S33, 1 / n frame decimation is performed on the digitally converted image. In the change area extraction step S34, the controller 110 detects the presence or absence of an image change by taking the difference between the first image obtained from the servers S1 to Sn and the second image acquired next to the first image. When there is a change, a predetermined region including a change amount of the second image with respect to the first image is extracted.

  The controller 110 transmits the extracted area to the remote operation computer 32 in the network transmission step S38. Further, in the change area extraction step S34, the controller 110 proceeds to the frame data acquisition step S35 in order to extract the mouse cursor peripheral image at predetermined intervals. Here, the predetermined interval is 1 / m.

  The extraction interval of mouse coordinate values in the remote control computer 32 is generally 5 ms, 8 ms, 10 ms, etc., so that the pointing accuracy is ensured by adjusting m to the longest period of these mouse coordinate extraction intervals. The amount of data processing and the amount of data transmission can be suppressed. Note that the remote operation computer 32 may display a dialog for setting the extraction interval of the cursor peripheral image as shown in FIG. 13 on the display device 46 so that the user can change the setting value.

  FIG. 13 is a diagram showing a display example of a dialog for setting the extraction interval of the cursor peripheral image. In FIG. 13, reference numeral 50 denotes a cursor peripheral image extraction interval setting screen displayed on the display device 46, 51 denotes a cursor peripheral image extraction interval input field, and 52 denotes a settable cursor peripheral image extraction interval maximum value. An area 53 is an OK button and a 54 cancel button. The cursor peripheral image extraction interval input by the user is transmitted from the remote control computer 32 to the controller 110 of the switch 10.

  In the frame data acquisition step S <b> 35, the controller 110 acquires the latest frame data from the memory 112. Next, in the mouse cursor region extraction step S36, the controller 110 extracts a mouse cursor peripheral image. That is, the controller 110 calculates the mouse cursor position on the image output from the servers S1 to Sn based on the absolute coordinates of the mouse acquired from the remote operation computer. The controller 110 extracts image data of the corresponding block and neighboring blocks from the image stored in the memory 112 based on the calculated mouse cursor position. Thereby, the mouse cursor peripheral image is extracted.

  At this time, the controller 110 holds the previously calculated mouse cursor position in the memory 112, and also extracts image data of the corresponding block and neighboring blocks corresponding to the previously calculated mouse cursor position. In the network transmission step S <b> 37, the controller 110 adds position information to the extracted mouse cursor peripheral image and transmits it to the remote operation computer 32.

  Returning to the change area extraction step S34, the controller 110 takes the difference between the first image obtained from the servers S1 to Sn and the second image acquired next to the first image to determine whether the image has changed. When a change is detected, a predetermined region including a change amount of the second image with respect to the first image is extracted. The controller 110 transmits the extracted area to the remote operation computer 32 in the network transmission step S38.

  In this way, the controller 110 extracts the mouse cursor area at predetermined intervals, cuts out the previous and current mouse cursor peripheral images, and sends them to the remote control computer 32. Even when the image cannot be acquired, the peripheral image of the mouse cursor can be transmitted to the remote operation computer 32.

  Next, processing of the remote control computer will be described. FIG. 9 is a process flowchart in the remote operation computer. In step 101, the remote control computer 32 establishes communication with the switch 10 when the application is activated. In step 102, the remote control computer 32 requests the switch 10 for the resolution of the screen displayed on the server side.

  In step 103, the remote control computer 32 receives the resolution of the screen displayed on the server S1 to Sn side from the switch 10. In step 104, when the remote control computer 32 receives the resolutions of the servers S1 to Sn from the switcher 10, it creates an image reception thread. In step 105, the remote operation computer 32 creates a mouse (MS) and keyboard (KB) acquisition / transmission thread. Thus, the remote operation computer 21 enters a processing loop, and transmits predetermined data to the switch 10 when the mouse and keyboard are operated.

  In step 106, the remote operation computer 32 determines whether the remote operation has been terminated by the user or has been terminated by the administrator or the like. If the remote operation computer 32 determines in step 106 that the remote operation has ended, it ends MS / KB acquisition / transmission in step 107. In step S <b> 108, the remote operation computer 32 ends image reception from the switch 10.

  Next, mouse data acquisition / transmission processing in the remote operation computer and mouse data reception processing in the switch will be described. FIG. 10 is a diagram for explaining mouse data acquisition / transmission processing in the remote operation computer and mouse data reception processing in the switch.

  The remote operation application running on the remote operation computer 32 displays the screen of the target computer selected by the switch 10 in a window. In step 201, the remote operation computer 32 acquires mouse data generated by mouse operation when performing remote operation.

  In step 202, the remote control computer 32 calculates absolute coordinates from the relative coordinates of the acquired mouse data. Specifically, the absolute coordinates are calculated from the relative coordinates of the acquired mouse data based on the mouse cursor position on the window of the remote operation application and the resolution of the target computer acquired in advance from the switch 10. When a mouse operation is performed, the remote operation computer 32 calculates absolute coordinates according to the mouse operation.

  In step 203, the remote operation computer 32 transmits the mouse data converted into absolute coordinates to the switch 10. In step 204, the remote control computer 32 determines whether or not the mouse data acquisition / transmission process has ended. If not, the remote operation computer 32 returns to step 201 and repeats the above loop to complete the mouse data acquisition / transmission process. If it is determined, the process is terminated.

  In step 301, the network interface circuit 13 of the switch 10 receives the absolute coordinate data of the mouse from the remote operation computer 32. In step 302, the controller 15 transmits the absolute coordinate data of the mouse to the KBMS control microcomputer 16.

  In step 303, the controller 15 transmits the absolute coordinate data of the mouse to the image processing unit 11. In step 302 and step 303, the controller 15 transmits the absolute coordinate data of the mouse to the KBMS control microcomputer 16 and the image processing unit 11, respectively. However, the KBMS control microcomputer 16 and the image processing unit 11 transmit to the controller 15 respectively. It is also possible to access and refer to the absolute coordinate data of the mouse. In step 401, the image processing unit 11 performs a check by screen change extraction / transmission processing.

  Next, screen change extraction / transmission processing in the image processing unit will be described. FIG. 11 is a screen change extraction / transmission process flowchart. In step 501, the controller 110 calculates a block in which the mouse cursor exists from the absolute coordinate value of the mouse in the remote operation computer acquired from the controller 15. That is, the controller 15 calculates the position of the image in the memory 12.

  In step 502, the controller 110 obtains the current image from the memory 112. In step 503, the controller 110 creates one pointer for the address on the memory 112, and the screen is blocked, so that the pointer is matched with the pointer and initializes the block pointer.

  In step 504, the controller 110 determines whether the absolute coordinate value of the mouse has been received from the remote control computer 32. In step 504, the controller 110 proceeds to step 506 if the absolute coordinate value of the mouse has not been received from the remote control computer 32.

  On the other hand, if it is determined in step 504 that the absolute coordinate value of the mouse has been received from the remote operation computer 32, the controller 110 performs cursor movement processing in step 505. The cursor movement process will be described later.

  In step 506, the controller 110 checks for image changes in the block. In step 507, the controller 110 moves the block pointer. In step 508, the controller 110 determines whether there is a change in the image in the block. If the controller 110 determines in step 508 that there is no change in the image in the block, the process returns to step 504.

  On the other hand, if the controller 110 determines in step 508 that the image in the block has changed, the controller 110 proceeds to step 509 and transmits the corresponding block image to the remote control computer 32.

  In step 510, the controller 110 moves the block pointer and determines whether the block is finished. For example, if it starts from the upper left of the screen, the block pointer is moved so as to finally check to the lower right, and the block ends when the block pointer reaches the lower right. In step 510, if the controller 110 determines that the block has not ended, the controller 110 returns to step 504.

  On the other hand, if it is determined in step 510 that all blocks have been completed, the controller 110 proceeds to step 511, stores the current image data in the memory 112, and ends the image change extraction / transmission process.

  Next, the cursor movement process will be described. FIG. 12 is a diagram for explaining the cursor movement processing in step 505 of FIG. In step 601 to step 606, the controller 110 checks the block around the previous (previous) mouse cursor. In Steps 607 to 612, the controller 110 checks the blocks around the current mouse cursor.

  In step 601, the controller 110 initializes the block pointer 1. In step 602, the controller 110 checks the change of the previous cursor peripheral block. In step 603, the controller 110 moves the block pointer 1.

  In step 604, the controller 110 determines whether there is a change in the previous cursor peripheral block. If the controller 110 determines in step 604 that there is no change in the previous cursor peripheral block, the controller 110 returns to step 602. On the other hand, if it is determined in step 604 that the previous cursor peripheral block has changed, the controller 110 proceeds to step 605 and transmits the block image to the remote operation computer 32.

  That is, the controller 110 of the image processing unit 11 extracts the block image around the corresponding block and the cursor from the immediately preceding (previous) image acquired from the memory 112. The controller 110 of the image processing unit 11 adds the position information to the area including the change only when there is a change in the block image around the cursor immediately before the extraction (previous), and the remote operation computer via the network interface circuit 13 32.

  In step 606, the controller 110 determines whether the block check is completed. If the controller 110 determines in step 606 that the block check has not been completed, the controller 110 returns to step 602. On the other hand, if it is determined in step 606 that the block check has been completed, the controller 110 proceeds to step 607 and initializes the block pointer 2.

  In step 608, the controller 110 checks for changes in the peripheral blocks of the current cursor. In step 609, the controller 110 moves the block pointer 2. In step 610, the controller 110 determines whether there is a change in the peripheral block of the current cursor. If the controller 110 determines in step 610 that there is no change in the peripheral block of the cursor, the process returns to step 608.

  On the other hand, if it is determined in step 610 that there is a change in the peripheral block of the cursor, the controller 110 proceeds to step 611 and outputs the extracted block image to the remote operation computer 32.

  That is, the controller 110 of the image processing unit 11 extracts the block image around the corresponding block and the cursor from the current image acquired from the memory 112. The controller 110 of the image processing unit 11 adds position information to the area including the change only when there is a change in the extracted block image around the current cursor, and transmits it to the remote control computer 32 via the network interface circuit 13. To do. The image processing unit 11 controller 110 simultaneously sends the previous mouse cursor peripheral block image and the current mouse cursor peripheral block image.

  In step 612, the controller 110 determines whether the block check has been completed. If it is determined that the block check has not been completed, the controller 110 returns to step 608. On the other hand, if the controller 110 determines in step 612 that the block check has been completed, it ends the cursor movement process.

In the remote operation computer 32, the network control unit 42 receives the area including the previous mouse cursor peripheral block image and the current mouse cursor peripheral block image.
The received mouse cursor peripheral block image and current mouse cursor peripheral block image are written into the graphic memory 39b via the system bus 36 based on a command given from the CPU 33.

  The display controller 39a refers to the contents of the graphic memory 39b based on the control command from the CPU 33, and displays the acquired previous mouse cursor peripheral block image and the current mouse cursor peripheral block image on the image currently displayed on the display device 46. The contents are combined and converted into an I / F signal that can be displayed on the display device 46. This I / F signal is transferred to the display device 46 via the cable 43 and displayed. As a result, the mouse cursor disappears at the location before the change, and the mouse cursor is displayed at the location after the change (current), so that the cursor moves.

  Next, a calculation method for network congestion will be described. The switch 10 calculates the network congestion status as follows. FIG. 14 is a flowchart for explaining packet filtering in the switch. The switcher 10 is equipped with a packet filtering function, calculates the amount of packet data within the measurement time, and measures the network congestion status. The network conversion circuit 13 operates in the promiscuous mode, and sends all received packets to the packet filtering circuit 14.

  In step 701, the controller 15 acquires the start time when the packet data amount is acquired in order to control the operation time of the packet filtering function. In step 702, the controller 15 acquires the amount of packet data from the packet filtering circuit 14. In step 703, the packet filtering circuit 14 adds the amount of packet data.

  In step 704, the controller 15 acquires the elapsed time. In step 705, the controller 15 determines whether or not the measurement time has elapsed. If it is determined that the measurement time has elapsed, the controller 15 proceeds to step 706 and reads the packet data amount from the packet filtering circuit 14. In step 707, a data flow rate per unit time (BPS: Bit Per Second) is calculated, and a network congestion state is calculated. On the other hand, if the controller 15 determines in step 705 that the measurement time has elapsed, the process returns to step 702.

  The controller 15 determines an image compression method and compression rate in the image compression circuit 113 according to the calculated network congestion state, and automatically changes the image compression method and compression rate in the image compression circuit 113. It may be. Further, the controller 15 outputs the calculated network congestion status to the controller 110 of the image processing unit 11. The controller 110 may change the predetermined interval for extracting the cursor peripheral image based on the network congestion state.

  Further, in the present embodiment, as shown in FIG. 1, a switch is described as an example, but the present invention is not limited to this, and can be realized by an image transmission device. The image transmission device includes: an acquisition unit that acquires cursor position information from the information processing device; and an image storage unit that stores an image to be transmitted to the information processing device based on the cursor position information acquired by the acquisition unit. Image extraction means for extracting a peripheral image and cursor image transmission means for transmitting the cursor peripheral image extracted by the image extraction means to the information processing apparatus are required.

  According to the present embodiment, the cursor peripheral image is extracted from the image storage means based on the cursor position information acquired from the remote control computer, and the extracted cursor peripheral image is transmitted to the remote control computer. The frame rate of the cursor can be improved. Thereby, pointing accuracy can be secured.

  Although the preferred embodiment of the present invention has been described in detail above, the present invention is not limited to the specific embodiment, and various modifications are possible within the scope of the gist of the present invention described in the claims.・ Change is possible.

It is a block diagram for demonstrating the switch which concerns on this Embodiment. It is a block diagram which shows the structure of a remote control computer. It is a block diagram which shows the detail of a display board and a display device. It is explanatory drawing which shows the hierarchical structure of the software and hardware in a remote control controller. It is a figure for demonstrating an image process part. It is a figure which shows the processing flow which an image process part transmits a mouse cursor periphery image by using the input of the coordinate of a mouse | mouth as a trigger. It is a figure for demonstrating the applicable block and neighboring block which a controller extracts. It is the figure which showed the processing flow in which an image process part performs the area | region extraction process of a mouse cursor for every predetermined period. It is a processing flowchart in a remote control computer. It is a figure for demonstrating the mouse data acquisition and transmission process in a remote control computer, and the mouse data reception process in a switch. It is a screen change extraction / transmission process flowchart. It is a figure for demonstrating a cursor movement process. It is a figure which shows the example of a display of the dialog for setting the extraction space | interval of a cursor peripheral image. It is an operation | movement flowchart of the packet filtering in a switch.

Explanation of symbols

DESCRIPTION OF SYMBOLS 10 Switch 11 Image processing part 13 Network conversion circuit 14 Packet filtering circuit 15 Controller 31, 32 Remote operation computer 110 Controller 111 A / D conversion circuit 112 Memory 113 Image compression circuit S1-Sn server

Claims (23)

In an image transmission apparatus that transmits an image to an information processing apparatus connected to a predetermined network,
Acquisition means for acquiring cursor position information from the information processing apparatus;
An image extracting means for extracting a cursor peripheral image from an image storage means for storing an image to be transmitted to the information processing device based on the cursor position information acquired by the acquiring means;
An image transmitting apparatus comprising: a cursor image transmitting unit configured to transmit a cursor peripheral image extracted by the image extracting unit to the information processing apparatus. The image extraction means detects the presence / absence of an image change by taking a difference between a first image to be transmitted to the information processing apparatus and a second image to be transmitted next to the first image. The image transmission apparatus according to claim 1, wherein a predetermined area including a change amount of the second image with respect to the image of the second image is extracted. The image transmission device further includes image transmission means for transmitting an entire image to the information processing device,
The image transmission means stops the transmission of the entire image to the information processing apparatus when acquiring the position information of the cursor from the information processing apparatus, and after the cursor peripheral image is transmitted by the cursor image transmission means, The image transmission apparatus according to claim 1, wherein transmission of the entire image to the information processing apparatus is resumed. In an image transmission method for transmitting an image to an information processing apparatus connected to a predetermined network,
An acquisition step of acquiring cursor position information from the information processing apparatus;
An image extraction step of extracting a cursor peripheral image from an image storage means for storing an image to be transmitted to the information processing device, based on the cursor position information acquired by the acquisition step;
An image transmission method comprising: a cursor image transmission step of transmitting the cursor peripheral image extracted in the image extraction step to the information processing apparatus. In the image extraction step, a difference between a first image transmitted to the information processing apparatus and a second image transmitted next to the first image is detected to detect presence / absence of an image change, and 5. The image transmission method according to claim 4, wherein a predetermined region including a change amount of the second image with respect to the image of the second image is extracted. The image transmission method further includes an image transmission step of transmitting an entire image to the information processing apparatus,
In the image transmission step, when the position information of the cursor is acquired from the information processing device, the transmission of the entire image to the information processing device is stopped, and after the cursor peripheral image is transmitted by the cursor image transmission step, 6. The image transmission method according to claim 4, wherein transmission of the entire image to the information processing apparatus is resumed. The image transmission method further includes an image processing step of performing image processing of the entire image to be transmitted to the information processing apparatus,
In the image processing step, when the position information of the cursor is acquired from the information processing apparatus, image processing of the entire image is stopped, and the cursor peripheral image is transmitted by the cursor image transmitting unit, and then the entire image is displayed. The image transmission method according to claim 4, wherein the image processing is restarted. In the image transmission step, a difference between a first image acquired from the computer and a second image acquired next to the first image is detected to detect presence or absence of an image change, and the first image 8. The image transmission method according to claim 4, wherein a predetermined region including a change amount of the second image with respect to is transmitted to the information processing apparatus. The image transmission method according to any one of claims 4 to 8, wherein, in the image extraction step, the cursor peripheral image is extracted at a predetermined interval. The image transmission method according to claim 9, wherein the predetermined interval is changed based on a setting value from the information processing apparatus. The image transmission method according to claim 9, wherein the predetermined interval is changed according to a congestion state of the network. The image transmission method according to claim 4, further comprising an image compression step of compressing an image to be transmitted to the information processing apparatus. 13. The image transmission method according to claim 12, wherein in the image compression step, a compression method or a compression rate is changed according to a network congestion state. A computer for transmitting an image to an information processing apparatus connected to a predetermined network;
Obtaining means for obtaining cursor position information from the information processing apparatus;
An image extracting means for extracting a cursor peripheral image from an image storage means for storing an image to be transmitted to the information processing device based on the cursor position information acquired by the acquiring means;
An image transmission program for causing a cursor peripheral image extracted by the image extraction means to function as a cursor image transmission means for transmitting to the information processing apparatus. The image extraction means detects the presence / absence of an image change by taking a difference between a first image to be transmitted to the information processing apparatus and a second image to be transmitted next to the first image. The image transmission program according to claim 14, wherein a predetermined area including a change amount of the second image with respect to the image of the second image is extracted. The image transmission program further comprising image transmission means for transmitting the entire image to the information processing apparatus;
The image transmission means stops the transmission of the entire image to the information processing device when acquiring the cursor position information from the information processing device, and after transmitting the cursor peripheral image by the cursor image transmission step, 16. The image transmission program according to claim 14, wherein transmission of the entire image to the information processing apparatus is resumed. The image transmission program further includes image processing means for performing image processing of the entire image to be transmitted to the information processing apparatus,
The image processing unit stops image processing of the entire image when the position information of the cursor is acquired from the information processing apparatus, and transmits the cursor peripheral image by the cursor image transmitting unit, and then transmits the entire image. The image transmission program according to any one of claims 14 to 16, wherein the image processing is restarted. The image transmission means detects the presence / absence of an image change by taking a difference between a first image to be transmitted to the information processing apparatus and a second image to be transmitted next to the first image. 18. The image transmission program according to claim 14, wherein a predetermined area including a change amount of the second image with respect to the image of the image is transmitted to the information processing apparatus. The image transmission program according to any one of claims 14 to 18, wherein the image extraction unit extracts the cursor peripheral image at predetermined intervals. The image transmission program according to claim 19, wherein the predetermined interval is changed based on a setting value from the information processing apparatus. The image transmission program according to claim 19, wherein the predetermined interval is changed according to a congestion state of the network. The image transmission program according to any one of claims 14 to 21, further comprising image compression means for compressing an image to be transmitted to the information processing apparatus. 23. The image transmission program according to claim 22, wherein the image compression means changes a compression method or a compression rate in accordance with a network congestion situation.

Images