JP2009267734A - Screen data sending terminal, screen data receiving terminal, screen data transmission system, screen data sending method, and screen data sending program - Google Patents

Abstract

<P>PROBLEM TO BE SOLVED: To achieve transmission of screen data by using a small quantity of memory and reduce transmission time of updated screen data. <P>SOLUTION: The screen data sending terminal 100 sending screen data so as to reproduce a display screen in a destination terminal includes: a sending-side screen display part 104 for displaying the screen; a compressed screen data generation part 107 which divides data of the displayed screen into screen data for each display area, compresses the data, and generates compressed screen data; a sending-side communication part 106 for sending the compressed screen data; a sending screen data decision part 109 which determines presence/absence of display screen update by using the compressed screen data for each display area, and decides sending of the compressed screen data in the display area when the presence of update is determined. In this way, efficient screen data transmission is achieved. <P>COPYRIGHT: (C)2010,JPO&INPIT

Description

  The present invention relates to a screen data transmission terminal, a screen data reception terminal, a screen data transmission system, a screen data transmission method, and a screen data transmission program that transmit screen data between information processing terminals connected via a network.

  In recent years, digital TV broadcasting has been started, and high-resolution and high-definition video and audio can be viewed on a television receiver. At the same time, television receivers are becoming compatible with networks. Accordingly, the functions of television receivers are increasing. As a result, the operation of the television receiver and various setting methods have become complicated, and the number of inquiries to the customer consultation center prepared by the manufacturer has increased. In general, an operator who has received an inquiry first asks the user to perform a remote control operation, grasps the situation of the user's television receiver and the cause of the situation, and then prompts the user to operate the remote control again to solve the problem. .

  However, since the operation method has become complicated as described above, there are many cases where the user cannot operate as instructed by the operator, and as a result, the user is forced to feel unpleasant and the user's trouble cannot be solved immediately. was there. Therefore, using a device connected to a communication network such as the Internet, a method for solving a problem by an operator directly or indirectly operating a user's electric device via a communication network using a terminal Has been proposed (see, for example, Patent Document 1). The display screen update system described in Patent Literature 1 considers the communication speed between devices and transmits only the screen data in an area with an update from the screen data transmission terminal device to the screen data reception terminal device.

In the above display screen update system, as shown in FIGS. 14A to 14C, the screen of the screen data transmission terminal device is divided into a plurality of areas, and the screen is divided between the previous screen 1301 and the current screen 1302. Whether or not the screen data is updated is checked for each area, and only the screen data in the updated screen area 1303 (shaded portion) is compressed and transmitted to the screen data receiving terminal device. In FIGS. 14B and 14C, the updated portion 1203 is represented as a star symbol.
JP 2004-086550 A

  However, the above method has a problem that a large amount of memory is consumed because it is necessary to store the same screen data as the screen size in the memory when determining the screen update area. There is also a problem that it takes time from detection of the update screen area to transmission of the update screen data.

  The present invention has been made in view of such circumstances, and an object of the present invention is to enable transmission of screen data with a small memory usage amount and to shorten the transmission time of updated screen data.

  (1) In order to achieve the above object, a screen data transmission terminal according to the present invention is a screen data transmission terminal that transmits screen data to reproduce a display screen at a destination terminal, and displays the screen. A transmission-side screen display unit, a compressed screen data generation unit that divides and compresses the displayed screen data into screen data for each display area, generates compressed screen data, and transmits the compressed screen data. For each display area, determine whether or not to update the displayed screen using the compressed screen data, and decide to transmit the compressed screen data in the display area determined to be updated And a transmission screen data determination unit.

  As described above, the screen data transmission terminal of the present invention determines whether or not the screen displayed using the compressed screen data is updated, and determines transmission of the compressed screen data in the display area determined to be updated. As a result, it is possible to transmit screen data with a small memory usage amount, and to shorten the transmission time of update screen data.

  (2) Moreover, the screen data transmission terminal according to the present invention further includes a transmission side storage unit that stores the compressed screen data to be transmitted, and the transmission screen data determination unit has a total size of the compressed screen data, In order to determine whether or not the displayed screen has been updated, if the capacity of the work area set in the transmission-side storage unit is exceeded, the compressed screen data of all display areas regardless of the presence or absence of the update It is characterized by determining transmission. Thereby, even when the total size of the compressed screen data exceeds the capacity of the work area, it is possible to transmit the screen data without causing a problem.

  (3) In the screen data transmission terminal according to the present invention, the transmission-side storage unit has a work area having a capacity determined from the size of the displayed screen data and the compression rate of the compressed screen data. It is characterized by being set. As a result, it is possible to set a work area that does not easily cause a buffer overflow while reducing the amount of memory to be used.

  (4) The screen data transmission terminal according to the present invention further includes a drawing area detection unit that detects a drawing screen area drawn by a drawing program, and the transmission screen data determination unit includes the drawing area in the display area. Whether or not the displayed screen is updated is determined only for the display area including the screen area. Thereby, since only the area | region which updated by drawing is determined, the efficiency of a determination process can be improved in the transmission of screen data, and the amount of memory used can be reduced.

  (5) In the screen data transmission terminal according to the present invention, when the transmission screen data determination unit determines whether or not the displayed screen is updated, the size of the compressed screen data for each display area is determined. Whether or not there is a change is determined, and whether or not the data itself has changed is determined for the compressed screen data that has been determined to have no size change. Thereby, since the change of the data itself is determined only for the area where the data size of the screen data has changed, the efficiency of the determination process can be improved and the amount of used memory can be reduced.

  (6) A screen data receiving terminal according to the present invention is a screen data receiving terminal that receives screen data transmitted from the screen data transmitting terminal, and the compressed screen data received from the screen data transmitting terminal. And a display screen generation unit that generates screen data for update, and a reception-side screen display unit that displays a screen updated using the screen data for update. Thereby, the screen data receiving terminal can reproduce the screen displayed on the screen data transmitting terminal with few updates.

  (7) A screen data transmission system according to the present invention is a screen data transmission system that efficiently transmits screen data between terminals, and includes the screen data transmission terminal and the screen data reception terminal. And the screen data transmission terminal receives a remote operation from the screen data reception terminal. Thereby, the screen data receiving terminal can reproduce the screen displayed on the screen data transmitting terminal, and it becomes easy to remotely operate the screen data transmitting terminal from the screen data receiving terminal.

  (8) Further, the screen data transmission method according to the present invention is a screen data transmission method for transmitting screen data in order to reproduce the display screen at a destination terminal, the display step for displaying the screen, and the display The divided screen data is divided into screen data for each display area and compressed to generate compressed screen data, the transmission step for transmitting the compressed screen data, and the compression for each display area And determining whether to update the displayed screen using screen data and determining transmission of compressed screen data in the display area determined to be updated. As a result, it is possible to reduce the memory usage of the transmission side terminal when transmitting screen data, and to shorten the transmission time of updated screen data.

  (9) A screen data transmission program according to the present invention is a screen data transmission program executed at a transmission source terminal to reproduce a display screen at a transmission destination terminal, and displays the screen. Dividing the displayed screen data into screen data for each display area, compressing the data to generate compressed screen data, transmitting processing for transmitting the compressed screen data, and for each display area And determining whether to update the displayed screen using the compressed screen data and determining transmission of the compressed screen data in the display area determined to be updated. It is characterized by letting. As a result, it is possible to reduce the memory usage of the transmission side terminal when transmitting screen data, and to shorten the transmission time of updated screen data.

  According to the present invention, it is possible to transmit screen data between terminals connected via a network even with a small memory usage of a screen data transmitting terminal device between terminals. Further, it is possible to shorten the time from the screen update area detection processing to the update screen data transmission processing.

  Next, embodiments of the present invention will be described with reference to the drawings. In order to facilitate understanding of the description, the same reference numerals are given to the same components in the respective drawings, and duplicate descriptions are omitted.

[First Embodiment]
FIG. 1 is a schematic diagram illustrating an example of a screen data transmission system 10. The screen data transmission system 10 includes a screen data transmission terminal 100 and a screen data reception terminal 200. In the example shown in FIG. 1, the screen data transmitting terminal 100 is a television receiver, and the screen data receiving terminal 200 is an external PC. In FIG. 1, the user 110 requests the operator 210 to perform a remote operation by telephone or the like, and the compressed screen data is transmitted from the screen data transmission terminal 100 to the screen data reception terminal 200 in the operation process of the operator 210. . By transmitting the compressed screen data in this way, the operator 210 can view the screen of the screen data transmission terminal 100 with the screen data reception terminal 200 and can be operated remotely. The screen data transmission system 10 illustrated in FIG. 1 is an example, and the screen data transmission system 10 is not limited to such a form.

  FIG. 2 is a block diagram showing a functional configuration of the screen data transmission system 10. Screen data transmission terminal 100 and screen data reception terminal 200 are connected via network 113. The screen data transmission terminal 100 includes a transmission side control unit 102, a transmission side storage unit 103, a transmission side screen display unit 104, a transmission side input unit 105, a transmission side communication unit 106, a compressed screen data generation unit 107, and a drawing area detection unit 108. And a transmission screen data determination unit 109.

  The transmission side control unit 102 is configured by a CPU (Central Processing Unit), and controls the screen data transmission terminal 100 in accordance with instructions of an operating system program and various application programs recorded in the transmission side storage unit 103. The transmission-side control unit 102 sends screen data to be displayed to the transmission-side screen display unit 104 as needed according to the instructions of these programs. The transmission-side screen display unit 104 performs screen data display processing on a display or the like.

  The transmission-side storage unit 103 includes a RAM (Random Access Memory), and stores operating system programs, various application programs, and compressed screen data output from the transmission screen data determination unit 109. The transmission-side storage unit 103 is set with a work area having a capacity determined from the size of the screen data displayed by the transmission-side screen display unit 104 and the compression rate of the compressed screen data.

  With such a setting, it is possible to set a work area that does not easily cause a buffer overflow while reducing the amount of memory to be used. The transmission side screen display unit 104 displays screen data. The transmission side input unit 105 is, for example, a remote controller, a keyboard, a mouse, or the like, and accepts a user operation. The transmission side communication unit 106 communicates with other terminals and transmits / receives information. The transmission side communication unit 106 transmits the compressed screen data determined to be transmitted.

  The compressed screen data generation unit 107 divides the screen data into data corresponding to a plurality of areas on the screen, compresses the screen data in order for each area, and sends the compressed screen data to the transmission screen data determination unit 109. The shape of the divided display area is preferably a rectangle, but can be divided into arbitrary shapes. The run length method is preferably used as the compression method, but other compression methods may be used, or compression may be performed using a dedicated hardware circuit. The drawing area detection unit 108 detects a drawing screen area drawn by a drawing application program.

  The transmission screen data determination unit 109 determines, for each display area, whether or not the screen displayed using the compressed screen data is updated, and determines transmission of the compressed screen data in the display area determined to be updated. . Specifically, the transmission screen data determination unit 109 compares the compressed screen data generated by the compressed screen data generation unit 107 with the compressed screen data of the previous screen stored in the transmission-side storage unit 103, and the compressed screen data If there is a difference between the data, the compressed screen data stored in the transmission side storage unit 103 is updated, and the transmission flag is turned on. Since the compressed data is compared in this way, it is possible to transmit screen data with a small amount of memory usage, and further, it is possible to shorten the transmission time of updated screen data.

  When the total size of the compressed screen data exceeds the capacity of the work area set in the transmission-side storage unit 103 to determine whether or not the displayed screen is updated, the transmission screen data determination unit 109 The transmission of compressed screen data in all display areas is determined regardless of whether or not there is an update. Further, the transmission screen data determination unit 109 determines whether or not the display screen is updated only for the display area including the drawing screen area among the display areas. Further, when determining whether or not the display screen is updated, the transmission screen data determination unit 109 determines whether or not the size of the compressed screen data has changed for each display area, and the compressed screen that has been determined to have no size change. Determine whether the data itself has changed.

  When the above processing is completed for all display areas of one screen, only the compressed screen data for which the transmission flag is turned on is sent to the transmission side communication unit 106, and the compressed screen data in the transmission side storage unit 103 is transmitted. Turn off the flag. Then, the compressed screen data is sent from the transmission side communication unit 106 to the reception side communication unit 206 via the network 113.

  On the other hand, the screen data receiving terminal 200 includes a receiving side control unit 202, a receiving side storage unit 203, a receiving side screen display unit 204, a receiving side input unit 205, a receiving side communication unit 206, and a display screen generation unit 209. The receiving side control unit 202 is constituted by a CPU, controls the screen data receiving terminal 200 in accordance with instructions of an operating system program and various application programs, and sends screen data to be displayed to the receiving side screen display unit 204 as needed. The reception-side storage unit 203 is configured by a semiconductor RAM, and stores operating system programs, various application programs, and screen data received from the screen data transmission terminal device.

  The receiving screen display unit 204 displays screen data. The receiving side input unit 205 receives user operations such as a keyboard, a mouse, and a remote controller. The receiving side communication unit 206 communicates with other terminals. The display screen generation unit 209 expands the compressed screen data of each screen area received by the reception-side communication unit 206, and updates the screen data stored in the reception-side storage unit 203, whereby the screen data transmission terminal 100 and The same screen data is generated and sent to the receiving side screen display unit 204. With the above configuration, the reception-side screen display unit 204 displays the screen data displayed on the screen data transmission terminal 100. In this way, the screen data receiving terminal 200 can reproduce the screen displayed on the screen data transmitting terminal 100 with few updates.

  FIG. 3 is a conceptual diagram showing the data structure of the compressed screen data. The transmission flag is a flag for determining whether or not to transmit the compressed screen data to the reception side communication unit 206. For example, as shown in FIG. 3, 1-bit data (transmission flag section 301) is provided as the transmission flag at the head of the compressed screen data (area information section 302, compressed data section 303) of each display area. In the determination, for example, when the value of the data is off (0), the compressed screen data is not transmitted. When the value is on (1), the compressed screen data is transmitted.

  Next, a series of processing for determining the transmission area and storage processing of the compressed screen data in the transmission-side storage unit 103 will be described. 4A to 4D are conceptual diagrams showing the flow of the transmission area determination process when the screen is updated by a rectangular drawing command on the display screen. FIG. 5 is a diagram showing an example of a data storage method on the memory. FIG. 6 is a diagram illustrating an example of the menu screen 601 on the screen data transmission terminal 100. FIG. 7 is a diagram illustrating an example of the operation screen 701 on the screen data receiving terminal 200. FIG. 8 is a diagram illustrating an example of a method for determining a display area including a rectangle drawing command.

  First, as shown in FIGS. 4A to 4D, the screen is divided into a plurality of regions. Then, the screen data is compressed for each divided area, and is stored in the transmission-side storage unit 103 in order as compressed screen data. In the example of FIGS. 4A to 4D, a display area having a size of (m × n =) 192 × 108 pixels from a screen of (M × N =) 1920 × 1080 pixels is 10 × 10 horizontal. A total of 100 are created.

  In data storage, two work areas (buffers) of a size capable of storing compressed screen data for one screen are set as a previous screen work area 501 and a current screen work area 502. Assuming that the menu screen of a high-definition television is transmitted, it is preferable to set two 64 KB work areas. When a 1920 × 1080 pixel (2 MB) TV screen is drawn on a high-definition TV menu screen on an area about 1/3 the size of one screen and the screen data is compressed by the run-length method, the maximum is 64 KB. It becomes about the size. Conventionally, the size of the work area was 2 MB × 2 = 4 MB. However, by compressing and storing the screen data as described above, 64 KB × 2 = 128 KB is sufficient.

  Next, the compressed screen data for each display area of the current screen is stored in the current screen work area 502. It is preferable that data [0] [0], data [0] [1],..., data [9] [9] are sequentially stored in order. At this time, when the drawing screen area 405 (rectangular drawing command (x1, y1, x2, y2)) by the application program or the like is detected and used to determine the update screen area, the transmission efficiency is improved. When a rectangle drawing command (x1, y1, x2, y2) is received from an application program or the like as shown in FIG. 4B and there is a screen update 406, first, a rectangle drawing command as indicated by the hatched portion on the current screen 402 is displayed. The compressed screen data is created for the display area including the designated area.

  The created compressed screen data is stored in the current screen work area 502. If the stored compressed screen data is different from the compressed screen data in the previous screen work area 501, the transmission flag of the stored compressed screen data is turned on. To. For the display area that does not include the designated area by the rectangular drawing command, the compressed screen data of the same screen area of the previous screen work area 501 is copied to the current screen work area 502 and used.

  A method for determining a display area including a designated area based on such a rectangular drawing command will be described below. As shown in FIG. 8, the rectangular drawing command (x1, y1, x2, y2) in the area determined by the point A and the point B and the vertical and horizontal sizes of each display area are used. The display area including the specified area is obtained. For example, when the screen is divided into a plurality of areas of size m × n, as shown in FIG. 5, the compressed screen data of each display area is data [0] [0], data [0]. [1],..., Data [a] [b] are stored in order. In FIG. 8, the display area d00 is the compressed screen data data [0] [0], the display area d90 is the compressed screen data data [9] [0], and the display area d09 is the compressed screen data data [0] [0]. 9], the display area d99 corresponds to the compressed screen data data [9] [9].

  When there is a rectangular drawing command (x1, y1, x2, y2) in the display area divided in this way, when the data storage location is represented as data [a] [b], the subscript on the left side Compressed screen data in which [a] is greater than or equal to x1 / m and less than or equal to x2 / m, and the right subscript [b] is greater than or equal to y1 / n and less than or equal to y2 / n. Is determined as a data area to be compared. For example, as shown in FIG. 8, when m = 192, n = 108, x1 = 200, y1 = 300, x2 = 800, y2 = 600 on the current screen 402, the value of the x coordinate is 1 or more and 4 or less. (200/192 to 800/192), the value of the y coordinate is 2 or more and 5 or less (300/108 to 600/108). Then, data [1] [2] to data [4] [2], data [1] [3] to data [4] [3], data [1] [4] to data [4] [4], data [1] [5] to data [4] [5] are areas where the compressed screen data should be compared. Since only the area where the update has occurred is determined by drawing as described above, the efficiency of the determination process can be improved when the screen data is transmitted, and the amount of used memory can be reduced.

  At this time, it is determined whether or not the compressed screen data stored in the current screen work area 502 is the same as the compressed screen data in the same display area stored in the previous screen work area 501. If the compressed screen data stored in the current screen work area 502 is different from the compressed screen data in the same display area stored in the previous screen work area 501, the corresponding display stored in the current screen work area 502 is displayed. The transmission flag of the compressed screen data in the area is turned on, and if it is the same, the transmission flag is kept off.

  In the above determination, first, it is compared whether or not the sizes of the compressed screen data in the same screen area of the previous screen 401 and the current screen 402 are the same. If the sizes of the compressed screen data are different, it is determined that the compressed screen data is different. If the sizes are the same, the contents of the compressed screen data are compared to determine whether the compressed screen data is the same. Due to such a determination, the comparison target area 403 (shaded area) shown in FIG. 4C is changed to the comparison target area shown in FIG. 4D in the designated area 404 by the rectangular drawing command shown in FIG. In the display area that does not include (shaded part), the screen data itself is not changed, and the compressed screen data in the same area of the previous screen work area 501 is copied and used. By making such a determination, it is only necessary to determine the change of the data itself for only the area where the data size of the screen data has changed, so that the efficiency of the determination process can be improved and the amount of used memory can be reduced.

  When the storage of all the compressed screen data for each display area is completed, all the compressed screen data for which the transmission flag stored in the current screen work area 502 is turned on are sent to the transmission side communication unit 106, and then the current screen is displayed. The transmission flag of the compressed screen data in the work area 502 is turned off. This process may be a process of sending the compressed screen data to the transmission side communication unit 106 while turning off the transmission flag.

  In the next screen, the compressed screen data stored in the work area 502 for the current screen becomes the compressed screen data of the previous screen, and the compressed screen data of the current screen is stored in the work area 501 for the previous screen. In this way, the compressed screen data of the display area of each screen is alternately stored in the two work areas, and the updated screen area is detected by comparing the compressed screen data for each display area. Thus, when the presence or absence of update is determined after the screen data for each display area is compressed, the size of the screen data to be compared is smaller, so the number of memory accesses to the data is smaller than in the conventional example.

  When the storage of the compressed screen data in the display area for one screen is completed, all the compressed screen data for which the transmission flag is on is sent to the transmission side communication unit 106. Then, a transmission area as shown by the comparison target area 403 (shaded portion) shown in FIG. Thereafter, all the transmission flags of the compressed screen data in the work area are turned off. A series of these processes is performed each time a drawing command is detected. By performing such processing, the screen 601 on the screen data transmission terminal 100 as shown in FIG. 6 can be reproduced on the screen 701 on the screen data reception terminal 200 as shown in FIG. For example, when the TV broadcast and menu screen 601 are displayed on the screen data transmission terminal 100, the menu screen 601 is displayed on the operation screen 701 on the screen data reception terminal 200. Thus, the operator 210 can operate the screen data transmission terminal 100 while looking at the operation screen 701. Thus, by transmitting only the menu screen 601, it is possible to realize screen data transmission that is excellent in real time and does not cause a problem such as copyright. However, the above aspect is merely an example, and screen data including a TV broadcast display may be transmitted to the screen data receiving terminal 200.

  In the process of storing the compressed screen data in the work area, if the total size of the stored compressed screen data exceeds the size of the work area (for example, the above 64 KB), it is determined that the buffer overflows, and the current screen Send the compressed screen data of all display areas. Then, all the compressed screen data stored in the work area is cleared.

  For example, when an overflow occurs while trying to store the compressed screen data of the display area in the work area 502 for the current screen, the compressed screen data is transmitted for the display area of the entire screen of the screen to be stored in the work area 502 for the current screen. Then, all the compressed screen data in the current screen work area 502 is cleared. The compressed screen data of each display area of the next screen is stored in the previous screen work area 501 in order. Thereby, even when the total size of the compressed screen data exceeds the capacity of the work area, it is possible to transmit the screen data without causing a problem.

  FIG. 9 is a flowchart showing a flow of compressed screen data transmission processing in the screen data transmission terminal 100. This flowchart processing is performed every time a rectangular drawing command from an application or the like is detected. Each step will be described below.

  First, the compressed screen data generation unit 107 divides the screen into a plurality of display areas (step S101). Next, it is determined whether the area to be processed is a display area including a designated area by a rectangular drawing command (Yes) or not (No) (step S102). If it is determined that the display area does not include the designated area, the compressed screen data stored in the previous screen work area is copied to the current screen work area (step S103), and the process proceeds to step S106. If the display area includes the designated area, the compressed screen data generation unit 107 compresses the screen data for each display area (step S104). Then, the compressed screen data generated by the compressed screen data generation unit 107 is stored in the current screen work area (step S105).

  Next, the transmission screen data determination unit 109 determines whether the total size of the compressed screen data stored in the transmission-side storage unit 103 exceeds the size of the work area (Yes) or not (No) (step S106). ). If it is determined that the size of the work area has been exceeded, the transmission screen data determination unit 109 sends the compressed screen data of the entire display area to the transmission side communication unit 106 (step S107). Then, the transmission screen data determination unit 109 clears the size of all the compressed screen data stored in the work area (step S108) and ends the process.

  On the other hand, when the transmission screen data determination unit 109 determines that the total size of the compressed screen data stored in the work area does not exceed the size of the work area, the transmission screen data determination unit 109 displays the display area. The compressed screen data created by the compressed screen data generation unit 107 is compared with the compressed screen data of the previous screen to determine whether the data sizes are the same (Yes) or different (No) (step S109). If it is determined that the data sizes are different, the transmission screen data determination unit 109 turns on the transmission flag of the compressed screen data of the current screen (step S110).

  If it is determined in step S109 that the data sizes are the same, the transmission screen data determination unit 109 compares the compressed screen data of the current screen with the compressed screen data of the previous screen, and whether the data is the same (Yes) ) It is determined whether they are different (No) (step S111). If the data is different, the process proceeds to step S110.

  On the other hand, when it is determined that the data is the same, the transmission screen data determination unit 109 determines whether storage of the compressed screen data in all display areas has been completed (Yes) or not (No) (step S112). If the process has not been completed, the process returns to step S102. When storage of compressed screen data for all display areas is complete, the transmission screen data determination unit 109 determines whether there is compressed screen data for which the transmission flag is on (Yes) or not (No). If it is determined (step S113) and there is no compressed screen data for which the transmission flag is turned on, the process ends.

  On the other hand, if there is compressed screen data for which the transmission flag is on, the transmission screen data determination unit 109 sends all the compressed screen data for which the transmission flag is on to the transmission side communication unit 106 (step S114). ). Then, the transmission screen data determination unit 109 turns off all transmission flags of the compressed screen data (step S115), and ends the process. By repeating such processing, screen data can be efficiently transmitted between terminals. The above operation is based on the premise that the compressed screen data of the previous screen is stored in the transmission-side storage unit 103. However, if the compressed screen data of the previous screen is not stored in the transmission, all the operations are performed. Send compressed screen data. The above operation is performed by a program that causes the screen data transmission terminal 100 to execute processing.

  FIG. 10 is a diagram illustrating an example of a transmission packet when transmitting compressed screen data between the transmission-side communication unit 106 and the reception-side communication unit 206. The transmission packet includes a header information part 901 which is a TCP header including control information such as an address indicating a destination, an update flag information part 902 including area information (bitmap information) having compressed screen data to be transmitted, and an update screen. It consists of an update information part 903 including the compressed screen data information of the area. The update flag information unit 902 holds 100-bit data indicating whether (1) or not (0) the compressed screen data of each display area (for example, 10 × 10 = 100) is transmitted. The update information unit 903 holds area information and compressed screen data of each display area.

  Next, a flow of reception processing of compressed screen data in the screen data receiving terminal device 200 will be described. FIG. 11 is a flowchart showing the flow of reception processing. The following processing is performed each time the reception side communication unit 206 receives a transmission packet from the transmission side communication unit 106. The receiving-side storage unit 203 has a work area (buffer) for compressed screen data having a size of 64 KB, and a work for constructing a display screen having a size of 2 MB (1920 × 1080 pixel screen is equivalent to one screen). One area is set for each.

  First, the display screen generation unit 209 receives a transmission packet from the receiving-side communication unit 206, and stores the compressed screen data in the update screen area in the update information unit 903 in the compressed screen data work area (step S201). Next, the display screen generation unit 209 expands the compressed screen data of the update screen area stored in the compressed screen data work area and generates the update screen data of each screen area and the area information (x, y of the update screen). , W, h) is used to update the screen data of the corresponding area of the display screen construction work area in the receiving-side storage unit 203 to create the same screen data as the screen data transmission terminal device (step S202). Then, the display screen generation unit 209 sends the screen data for one screen created in the display screen construction work area in step S202 to the reception-side screen display unit 204 (step S203), and stores it in the compressed screen data work area. The compressed screen data in the updated screen area is cleared, and the process is terminated.

[Second Embodiment]
In the above embodiment, a rectangular drawing command from an application program or the like is used, but screen data may be transmitted without using a rectangular drawing command from the application program or the like. A transmission area determination process in the screen data transmission terminal device at that time will be described. FIGS. 12A to 12C are diagrams illustrating an example of optimization processing for transmission region determination according to the second embodiment. In this embodiment, the compressed screen data of the previous screen and the compressed screen data of the current screen are compared with respect to the display area of the entire screen.

  First, as shown in FIGS. 12A to 12C, the screen is divided into a plurality of areas, and the screen data is compressed for each display area and stored in the work area. The method for storing the compressed screen data in the work area is the same as the method for storing the compressed screen data in the transmission side storage unit 103 described above.

  As an example, if there is a screen update as shown in the comparison target area 1103 between the previous screen 1101 and the current screen 1102, compressed screen data is created for all display areas, and the current screen work area is created. Store. If the compressed screen data stored in the current screen work area 502 is different from the compressed screen data stored in the previous screen work area 501, the transmission flag of the stored compressed screen data is turned on. In the above procedure, an area where the transmission flag is turned on, that is, a transmission area indicated by the comparison target area 1103 (shaded area) is determined. A series of these processes is performed on each screen.

  FIG. 13 is a flowchart showing a flow of transmission processing in the screen data transmission terminal 100. This flowchart process is performed for each screen. Each step will be described below. First, the compressed screen data generation unit 107 divides the screen into a plurality of display areas (step S301). The compressed screen data generation unit 107 compresses the screen data in units of display areas (step S302). The compressed screen data generation unit 107 stores the generated compressed screen data in the current screen work area (step S301).

  Then, the transmission screen data determination unit 109 determines whether the total size of the compressed screen data stored in the current screen work area exceeds the size of the work area (Yes) or not (No) (step S304). When the size of the work area is exceeded, the transmission screen data determination unit 109 sends the compressed screen data of the entire display area to the transmission side communication unit 106 (step S305). Then, the transmission screen data determination unit 109 clears all the compressed screen data sizes stored in the work area (step S306), and ends the process.

  On the other hand, if the size of the work area is not exceeded in step S304, the transmission screen data determination unit 109 uses the compressed screen data created by the compressed screen data generation unit 107 and the compressed screen data of the previous screen for the display area. In comparison, it is determined whether the data sizes are the same (Yes) or different (No) (step S307). If the data sizes are different, the transmission screen data determination unit 109 turns on the transmission flag of the compressed screen data of the current screen (step S309).

  On the other hand, when the data sizes are the same, the transmission screen data determination unit 109 compares the compressed screen data of the current screen with the compressed screen data of the previous screen, and determines whether the data is the same (Yes) or different (No). Determination is made (step S308). If the data is different, the process proceeds to step S309. If the data is the same, the transmission screen data determination unit 109 determines whether storage of the compressed screen data in all display areas is complete (Yes) or not (No) (step S310).

  If it is determined that the compressed screen data storage process has not been completed, the process returns to step S302. If it is determined that storage of compressed screen data for all display areas is complete, the transmission screen data determination unit 109 determines whether there is compressed screen data for which the transmission flag is on (Yes) (No) ) Is determined (step S311).

  If it is determined that there is no compressed screen data for which the transmission flag is on, the process ends. When it is determined that there is compressed screen data for which the transmission flag is on, the transmission screen data determination unit 109 sends all the compressed screen data for which the transmission flag is on to the transmission side communication unit 106 ( Step S312). Then, the transmission screen data determination unit 109 turns off all transmission flags of the compressed screen data (step S313), and ends the process. The above operation is based on the premise that the compressed screen data of the previous screen is stored. However, when the compressed screen data of the previous screen is not stored in the transmission, all the compressed screen data is transmitted. . The above operation is performed by a program that causes the screen data transmission terminal 100 to execute processing.

  It should be noted that the embodiments and examples disclosed above are illustrative and not restrictive. For example, the screen division according to the present embodiment creates 100 divided display regions of 192 × 108 pixels with respect to a screen size of 1920 × 1080 pixels, but the size of the display region is not limited to this. For example, if it is desired to reduce the amount of screen data to be transmitted, the size of the display area can be reduced, and if it is desired to speed up the detection of the updated screen area, the size of the display area can be increased. In the above-described embodiment, the transmission-side storage unit 103 and the reception-side storage unit 203 are each configured by a RAM, but may be configured by a storage device equivalent to this.

It is the schematic which shows an example of the screen data transmission system which concerns on 1st Embodiment. It is a block diagram which shows the functional structure of the screen data transmission system which concerns on 1st Embodiment. It is a conceptual diagram which shows the data structure of compressed screen data. It is a conceptual diagram which shows the flow of a transmission area | region determination process with a display screen. It is a figure which shows the example of the data storage method on a memory. It is a figure which shows an example of the menu screen on a screen data transmission terminal. It is a figure which shows an example of the operation screen on a screen data receiving terminal. It is a figure which shows the example of the determination method of the display area containing a rectangle drawing command. It is the flowchart which showed the flow of the transmission process of compressed screen data. It is a figure which shows the example of a transmission packet at the time of transmitting compressed screen data. It is the flowchart which showed the flow of the reception process. It is a figure which shows the example of an optimization process for the transmission area determination in 2nd Embodiment. It is the flowchart which showed the flow of the transmission process in the screen data transmission terminal 100 which concerns on 2nd Embodiment. (A)-(c) It is a figure which shows the outline | summary of the transmission area | region determination process in the conventional screen transmission system.

Explanation of symbols

DESCRIPTION OF SYMBOLS 10 Screen data transmission system 100 Screen data transmission terminal 102 Transmission side control part 103 Transmission side memory | storage part 104 Transmission side screen display part 105 Transmission side input part 106 Transmission side communication part 107 Compressed screen data generation part 108 Drawing area detection part 109 Transmission screen Data decision unit 110 User 113 Network 200 Screen data reception terminal 200 Screen data reception terminal device 202 Reception side control unit 203 Reception side storage unit 204 Reception side screen display unit 205 Reception side input unit 206 Reception side communication unit 209 Display screen generation unit 210 Operator 301 Transmission flag section 302 Area information section 303 Compressed data section 401 Previous screen 402 Current screen 403 Comparison target area 404 Designated area 405 Drawing screen area 406 Screen update 501 Previous screen work area 502 Current screen work area 601 Menu screen 701 Operation screen 901 Header information part 902 Update flag information part 903 Update information part 1101 Previous screen 1102 Current screen 1103 Comparison target area 1203 Update part d00, d09, d90, d99 Display area

Claims (9)

A screen data transmission terminal that transmits screen data in order to reproduce the display screen on the destination terminal,
A sender screen display for displaying the screen;
A compressed screen data generation unit that divides the displayed screen data into screen data for each display area, compresses the compressed data, and generates compressed screen data;
A transmission side communication unit for transmitting the compressed screen data;
Transmission screen data determination for determining whether to update the displayed screen using the compressed screen data for each display area and determining transmission of the compressed screen data in the display area determined to be updated A screen data transmission terminal. A transmission side storage unit for storing the compressed screen data to be transmitted;
The transmission screen data determination unit, when the total size of the compressed screen data exceeds the capacity of the work area set in the transmission storage unit to determine whether the displayed screen is updated 2. The screen data transmission terminal according to claim 1, wherein transmission of compressed screen data of all display areas is determined regardless of whether or not the update is performed.   The said transmission side memory | storage part has set the work area which has the capacity | capacitance determined from the size of the data of the said displayed screen, and the compression rate of the said compressed screen data, The Claim 2 characterized by the above-mentioned. Screen data transmission terminal. A drawing area detecting unit for detecting a drawing screen area drawn by the drawing program;
The transmission screen data determination unit determines whether or not to update the displayed screen only for a display area including the drawing screen area among the display areas. The screen data transmission terminal described in 1.   The transmission screen data determination unit determines whether there is a change in the size of the compressed screen data for each display area when determining whether the displayed screen is updated, and determines that there is no change in size. The screen data transmission terminal according to claim 1, wherein the presence or absence of change in the data itself is determined for the compressed screen data. A screen data receiving terminal for receiving screen data transmitted from the screen data transmitting terminal according to any one of claims 1 to 5,
Expanding the compressed screen data received from the screen data transmitting terminal, and generating a screen data for update, a display screen generation unit,
A screen data receiving terminal comprising: a receiving-side screen display unit configured to display a screen updated using the update screen data. A screen data transmission system for efficiently transmitting screen data between terminals,
A screen data transmission terminal according to any one of claims 1 to 5,
A screen data receiving terminal according to claim 6,
The screen data transmission system, wherein the screen data transmission terminal receives a remote operation from the screen data reception terminal. A screen data transmission method for transmitting screen data to reproduce a display screen on a destination terminal,
A display step for displaying a screen;
A divided compression step of dividing the displayed screen data into screen data for each display area and compressing to generate compressed screen data;
A transmission step of transmitting the compressed screen data;
A determination step for determining whether or not to update the displayed screen using the compressed screen data for each display area, and determining transmission of the compressed screen data in the display area determined to be updated, The screen data transmission method characterized by including. A screen data transmission program executed on a transmission source terminal in order to reproduce a display screen on a transmission destination terminal,
Display processing to display the screen;
Dividing and compressing the displayed screen data into screen data for each display area, compressing and generating compressed screen data; and
A transmission process for transmitting the compressed screen data;
For each display area, a determination process for determining whether to update the displayed screen using the compressed screen data, and determining transmission of the compressed screen data of the display area determined to be updated, A screen data transmission program characterized by causing a computer to execute.

Images