JP2006293449A - Data sharing system - Google Patents

Abstract

<P>PROBLEM TO BE SOLVED: To provide an application sharing system for eliminating any deviation between a handwritten input operation and display in a client terminal, and for simultaneously writing handwritten inputs without performing the explicit switching of an operator. <P>SOLUTION: Input events in a client terminal 102 are discriminated into the input event of plotting data with an electronic pen or the like and any other input event, and respectively processed by application sharing means 201a and 202a and object sharing means 201a and 202b. In the case of the input events of plotting data, the object sharing means 202b performs plotting processing corresponding to the input event in a client terminal 102, and displays the processing result in the client terminal 102, and converts the plotting data into object data, and transmits the object data to the object sharing means 201b of a server terminal 101, and makes the server terminal 101 display the object data. <P>COPYRIGHT: (C)2007,JPO&INPIT

Description

  The present invention relates to a data sharing system in an electronic board system, and more particularly to a configuration for sharing an application between a client and a server.

In recent years, with the development of network technology, terminals in remote locations are connected to share information. In particular, remote conferences that share video and audio, conference material data, object data necessary for annotating material data, and the like are beginning to spread among terminals in remote locations.
As a data sharing system used for such a remote conference, a configuration in which an application provided in a certain terminal is conventionally shared among a plurality of terminals connected via a network is known (for example, Patent Document 1). reference.).
Japanese Patent Laid-Open No. 05-120241

FIG. 9 is a block diagram showing a schematic configuration of a conventional application sharing system.
In the conventional system, as shown in FIG. 9, the application sharing means 901a and 902a provided in both the server terminal 901 and the client terminal 902 share the application, and the input operation for the application is performed by both the server terminal 901 and the client terminal 902. From what you can do. In this case, the server terminal 901 performs processing corresponding to the input operation, and the application sharing unit 901a transmits the processing result display screen on the server terminal 901 to the application sharing unit 902a of the client terminal 902, and sends it to the client terminal 902. It is supposed to be displayed.

FIG. 10 is a flowchart showing a data sharing processing procedure performed by the conventional system for an input event in a client terminal.
In the data sharing process, as shown in FIG. 10, first, when the client terminal 902 receives an input event (step 1001), the application sharing means 902a of the client terminal 902 uses mouse cursor or electronic pen movement data as input event data. It is acquired (step 1002) and transmitted to the application sharing means 901a of the server terminal 901 (step 1003).
The application sharing unit 901a of the server terminal 901 receives the input event data, performs processing corresponding to the input event data (step 1004), and displays the processing result on the application screen (step 1005). In this case, the application sharing unit 901a of the server terminal 901 processes the input event data as an application operation including object input.
The application sharing unit 901a of the server terminal 901 captures the application screen on which the processing result is displayed, and transmits the screen data to the application sharing unit 902a of the client terminal 902 (step 1006).
The application sharing unit 902a of the client terminal 902 updates the application screen of the client terminal 902 based on the received screen data (step 1007).
As a result, the processing result corresponding to the input operation performed at the client terminal 902 can be displayed on the server terminal 901 and the client terminal 902.

FIG. 11 is an image diagram showing a data sharing processing method in an electronic board system using a conventional application sharing system.
As shown in FIG. 11A, when handwriting input is performed with an electronic pen on the application screen 1101 of the client terminal 902, the application sharing unit 902a of the client terminal 902 sends the pen movement data 1110 to the application sharing unit of the server terminal 901. To 901a.
Next, as shown in FIG. 11B, drawing data corresponding to the pen movement data 1110 is displayed on the application screen 1102 at the server terminal 901, and the application sharing unit 901 a of the server terminal 901 displays the application screen 1102. The captured screen data 1111 is transmitted to the client terminal 902. The client terminal 902 application sharing unit 902a updates and displays the application screen 1101 with the received screen data 1111.

  However, in the conventional system, processing for the input operation performed at the client terminal 902 is performed at the server terminal 901, and application sharing is performed by transmitting the application screen of the server terminal 901 as needed. In this case, a line segment in the middle of input is not displayed, and there is a time difference between the input operation at the client terminal 902 and the display of drawing data.

FIG. 12 shows an example of the relationship between handwriting input and display in the client terminal 902, and the pen movement locus 1210 of the electronic pen when the character “5” is input by handwriting with the electronic pen, and each input operation is performed. It is a figure which shows the screen displays 1220 and 1230 of each of the client terminal 902 and the server terminal 901 at the time. In this example, for convenience of explanation, it is assumed that the input operation at the client terminal 902 and the display processing at the server terminal 901 are performed substantially simultaneously.
As shown in FIG. 12, when the pen input operation for the first stroke of the character “5” is performed, pen movement data is transmitted from the application sharing unit 902a of the client terminal 902 to the application sharing unit 901a of the server terminal 901. The server terminal 901 displays drawing data indicating the first stroke of the character “5”. Thereafter, the application sharing unit 902a of the client terminal 902 displays the drawing data by updating the application screen based on the screen data received from the application sharing unit 901a of the server terminal 901. Therefore, in the client terminal 902, for example, when the pen input operation for the second stroke of the character “5” is performed, the first stroke is displayed, and the input operation and the screen display are performed. Will be displaced. Similarly, for the second and subsequent strokes, the screen display 1220 on the client terminal is shifted with respect to the pen input operation 1210.
As described above, since a time difference occurs between the input operation and the display in the client terminal 902, the user needs to wait for display in order to confirm the drawing data corresponding to the input operation of the client terminal 902, and the smooth input operation. There was a problem that could not be done. In particular, in the example of FIG. 12, it is assumed that the input operation and the display process of the server terminal 901 are performed substantially simultaneously. However, since this depends on the communication speed of the network, in practice, the client terminal There was also a time difference between the input operation at 902 and the screen display at the server terminal 901. Therefore, more time difference has occurred between the input operation and display on the client terminal 902. Further, depending on the timing of screen capture by the application sharing unit 901a of the server terminal 901, an incomplete screen display may be displayed on the client terminal 902, such as a state where a drawn line segment is cut off.
In addition, when application sharing is performed in a conventional system, it is necessary to perform exclusive control so that it cannot be operated from a plurality of terminals at once in order to maintain application consistency. However, all input events are processed as application operations in the server terminal 901. Therefore, there is a problem in that it is necessary to explicitly switch an operator for handwriting input, and writing cannot be performed simultaneously on a plurality of terminals.

  The present invention is for solving the above-described problem, and eliminates the difference between the handwriting input operation and the display in the client terminal, and simultaneously writes the handwritten input from a plurality of terminals without switching the operator explicitly. An object of the present invention is to provide a data sharing system that makes it possible.

In order to solve the above-described problem, the present invention is configured such that an application is shared between a server terminal and a client terminal connected via a network, and the server terminal executes a process according to an application operation input event in the client terminal. A data sharing system comprising application sharing means for displaying a processing result on an application screen and transmitting and displaying the application screen to the client terminal, wherein the client terminal has an input event in the client terminal as an object Whether or not the event is an input event, and if it is an object input event, the process corresponding to the input event is executed to display the object data on the application screen and the object object. Object data transmitting means for transmitting the object data and the relative position information of the object data on the application screen to the server terminal, wherein the server terminal uses the object data received from the object data transmitting means as the relative position information. And object data display means for displaying on the application screen.
The object data is displayed on a different layer from the application screen.

With the above configuration, according to the present invention, in the application sharing system, for the object input operation such as handwritten input performed in the client terminal, the client terminal executes processing and displays the object data as the processing result. Therefore, it is possible to eliminate the time difference between the object input operation such as handwriting input at the client terminal and the display. Therefore, an object input operation that is natural for the user is possible.
In addition, since object data processed at the client terminal is displayed in a layer different from the application screen, exclusive control related to object input processing is not required at the server terminal, and object input operations can be performed simultaneously at multiple client terminals. Is possible.

Hereinafter, a data sharing system according to an embodiment of the present invention will be described with reference to the drawings.
FIG. 1 is a block diagram showing a schematic configuration of the data sharing system according to the present embodiment, and FIG. 2 is a block diagram showing a schematic configuration of each sharing means in the server terminal and the client terminal.
The data sharing system 100 is configured by connecting a server terminal 101 having a shared application and a client terminal 102 via a network. The server terminal 101 and the client terminal 102 are provided with input devices 101a and 102a such as a mouse and an electronic pen.
As shown in FIG. 2, the server terminal 101 and the client terminal 102 have application sharing means 201a and 202a and object sharing means 201b and 202b, respectively, and a display screen or a part of the display screen on the server terminal 101. Is shared by the application sharing means 201a and 202a and the object sharing means 201b and 202b, thereby enabling input operation from both the server input device 101a and the client input device 102a.
In this embodiment, as shown in FIG. 2, the application sharing means 201a, 202a and the object sharing are distinguished by distinguishing the input event at the client terminal 102 into an input event of drawing data by an electronic pen or the like and another input event. Each of the means 201b and 202b performs processing.
In the case of a drawing data input event, the object sharing unit 202b performs a drawing process corresponding to the input event at the client terminal 102, displays the processing result at the client terminal 102, converts the drawing data into object data, and converts the drawing data to the server. The data is transmitted to the object sharing unit 201b of the terminal 101 and displayed on the server terminal 101.
In the case of an input event other than drawing data, as in the conventional system, the application sharing unit 202a transmits the input event data to the application sharing unit 201a of the server terminal 101, and the processing result screen transmitted by the application sharing unit 201a is displayed. The captured data is received and displayed on the client terminal 102.

FIG. 3 is a diagram illustrating a configuration of a shared screen displayed on the server terminal 101 and the client terminal 102, and FIG. 4 is a diagram illustrating an example of displaying the shared screen on the server terminal 101 and the client terminal 102.
As shown in FIG. 3, the shared screen 300 is configured by superimposing the application screen 301 shared by the application sharing units 101a and 102a and the object data 302 shared by the object sharing units 101b and 102b. In the present embodiment, the application screen 301 and the object data 302 are processed as separate layers.
As illustrated in FIG. 4, an application screen 401 a displayed by an application provided in the server terminal 101 and object data 401 b are displayed on the desktop screen 401 on the server terminal 101 side. The application screen 401 a is captured by the application sharing unit 201 a and the captured data is transmitted to the client terminal 102. The object data 401b is received and displayed by the object sharing unit 201b from the object sharing unit 202b of the client terminal 102.
On the other hand, on the desktop screen 402 on the client terminal 102 side, an application screen 402a and object data 402b are displayed corresponding to the desktop screen 401 on the server terminal 101 side. The application screen 202a is received and displayed by the application sharing unit 202a from the application sharing unit 101a on the server 101 side. The object data 402b is generated and displayed by the object sharing unit 102b and transmitted to the object sharing unit 201b on the server 101 side. Therefore, the client terminal 102 can display drawing data at a speed corresponding to handwritten input.
In this case, by transmitting and receiving relative position information indicating the relative position of the object data 401b and 402b with respect to the application screens 401a and 402a, the desktop screens 401 and 402 of both the server 101 and the client 102 can be displayed in the application screens 401a and 402a. The object data 401b and 402b are displayed at the same position.

FIG. 5 is a flowchart showing a data sharing processing procedure performed by the data sharing system according to the present embodiment for an input event in the client terminal 102.
As a premise of this processing, when the application provided in the server terminal 101 is activated and the client terminal 102 connects to the server terminal 101, the application sharing means 201a and 202a and the object sharing means 201b and 202b start sharing To do. In this case, the object sharing means 201b and 202b acquire display position information of the application screen.
In the data sharing process, first, when an input event is received at the client terminal 102 (step 501), the object sharing unit 202b of the client terminal 102 acquires the input event (step 502), and whether or not it is a drawing data input event. Is determined (step 503). In the present embodiment, in order for the object sharing means 202b of the client terminal 102 to distinguish between input events, the input event data includes an input identification flag that distinguishes the input event of drawing data from other input events. To do. In this case, for example, when an electronic pen as the input device 102a is provided with a predetermined button and an input operation is performed with the button pressed, the input identification flag indicates an input event of drawing data. Set things.
If the result of determination is that the event is an input event for drawing data, drawing processing is performed at the client terminal 102 (step 504).
When the drawing data input event ends, the object sharing unit 202b of the client terminal 102 converts the drawing data into the object data 402b (step 505), and the object sharing of the server terminal 101 together with the relative position information on the application screen 402a. It transmits to the means 201b (step 506).
The object sharing unit 201b of the server terminal 101 displays the received object data 401b on the application screen 401a based on the relative position information (step 507).
On the other hand, if it is determined in step 503 that the input event is other than drawing data (such as a mouse click), the application sharing means 202ba of the client terminal 102 acquires the input event and the server terminal 101, as in the conventional system. To the application sharing means 201a (step 508).
The application sharing unit 201a of the server terminal 101 performs application processing for the received input event (step 509), displays the processing result on the screen (step 510), captures the display screen, and captures the captured data to the client terminal 102. It transmits to the application sharing means 202a (step 511).
The application sharing unit 202a of the client terminal 102 updates the application screen 402a based on the received capture data (step 512).

FIG. 6 is a diagram illustrating an example of the data structure of the input event data acquired by the object sharing unit 202b of the client terminal 102.
The input event data includes an input identification flag 603 along with input coordinates 601 and 602.
Input coordinates 601 and 602 indicate values detected by the coordinate detection device of the electronic board as the coordinate values of the mouse or the coordinate values of the electronic pen.
The input identification flag 603 is used for the above-described input event determination process (step 503 in FIG. 5).

FIG. 7 is an image diagram showing an example of drawing data sharing processing by the data sharing system according to the present embodiment.
As shown in FIG. 7A, when handwriting input by the electronic pen is performed on the application screen 700 of the client terminal 102, drawing data is displayed on the application screen 700 of the client terminal 102 as shown in FIG. 701 is displayed, and the drawing data 701 is converted into object data 702 and transmitted to the server terminal 101 to display the drawing data 711 on the application screen 710 of the server terminal 101. When a plurality of client terminals are connected to the server terminal 101, all of them are transmitted from the object sharing unit 202 b of the client terminal 102 where the handwritten input is performed or through the object sharing unit 201 b of the server terminal 101. Send object data to the client terminal.

FIG. 8 shows the pen input operation (movement locus) 810 of the electronic pen in the case of handwriting input in the data sharing system according to the present embodiment, and the screen display of each of the client terminal 102 and the server terminal 101 when each input operation is performed. It is a figure which shows 820,830.
As shown in FIG. 8, when the first stroke of the character “5” is input, after the drawing data corresponding to the pen input operation 810 is displayed on the client terminal 102, the object sharing unit 202b converts the drawing data into the object data. To the object sharing unit 201b of the server terminal 101. The object sharing means 201b of the server terminal displays the received object data superimposed on the application screen. Similarly, for the second to fourth strokes, drawing data display processing is performed by the client terminal 102 in response to the pen input operation 810.
Accordingly, a time difference occurs between the pen input operation at the client terminal 102 and the display on the application screen of the server terminal 101, but the client terminal 102 can eliminate the time difference from the pen input operation to the display. Become.

As described above, in the data sharing system according to the present embodiment, in response to an object input operation such as handwriting input performed at the client terminal, the client terminal executes the process and displays the object data as the processing result. Since the means for transmitting to the server terminal is provided, it is possible to eliminate the time difference between the handwritten input and the display at the client terminal. Therefore, an object input operation that is natural for the user is possible.
In addition, since object data processed at the client terminal is displayed in a layer different from the application screen, exclusive control related to object input processing is not required at the server terminal, and object input operations can be performed simultaneously at multiple client terminals. Is possible. In this case, the object data displayed on the other client terminal is received and displayed via the server terminal.

In the above-described embodiment, the processing related to the drawing data corresponding to the handwriting input operation is performed on the client terminal. However, the present invention is not limited to this. For example, graphic data such as straight lines, circles, and rectangles, clip art, and stamps. The client terminal may perform processing for an input operation of object data including still image data.
The present invention is not only used in an electronic board system, but can also be used in an application sharing system in which personal computers are connected to each other.

It is a block diagram which shows schematic structure of the data sharing system which concerns on one embodiment of this invention. It is a block diagram which shows the partial structure of the data sharing system which concerns on one embodiment of this invention. It is a figure which shows the structure of the share screen in the data sharing system of one embodiment of this invention. It is a figure which shows the example of a display of the share screen in the data sharing system which concerns on one embodiment of this invention. It is a flowchart which shows the data sharing process procedure which the data sharing system which concerns on one embodiment of this invention performs. It is a figure which shows an example of the data structure of the input event data used for the data sharing process which the data sharing system which concerns on one embodiment of this invention performs. It is an image figure which shows the outline | summary of the drawing data display process in the data sharing system of one embodiment of this invention. It is a figure which shows the relationship between the pen movement locus | trajectory and the screen display of each terminal in the data sharing system of one embodiment of this invention. It is a block diagram which shows the partial structure of the conventional data sharing system. It is a flowchart which shows the data sharing process procedure which the conventional data sharing system performs. It is an image figure which shows the outline | summary of the drawing data display process which the conventional data sharing system performs. It is a figure which shows the relationship between the pen movement locus | trajectory and the screen display of each terminal in the conventional data sharing system.

Explanation of symbols

  101 server terminal, 102 client terminal, 201a, 202a application sharing means, 201b, 202b object sharing means, 300 sharing screen, 301 application screen, 302 object sharing screen.

Claims (2)

While sharing an application between a server terminal and a client terminal connected via a network, the server terminal executes a process according to an application operation input event in the client terminal and displays a processing result on the application screen, A data sharing system comprising application sharing means for transmitting and displaying the application screen to the client terminal,
The client terminal identifies whether an input event at the client terminal is an object input event. If the input event is an object input event, the client terminal executes a process according to the input event and displays object data on the application screen. An object data transmitting means for transmitting the object data and relative position information of the object data on the application screen to the server terminal,
The data sharing system, wherein the server terminal includes object data display means for displaying the object data received from the object data transmission means on the application screen based on the relative position information. The data sharing system according to claim 1, wherein the object data is displayed on a layer different from the application screen.

Images