JP5765392B2 - Terminal, terminal control method and control program - Google Patents

Description

  The present invention relates to a terminal, a terminal control method, and a control program.

  Conventionally, there has been a technology for accessing another information processing apparatus such as a personal computer connected to a network by using a function called a remote desktop and remotely operating the other information processing apparatus with one's own information processing apparatus. Exists.

  A conventional technique using the remote desktop function will be briefly described. FIG. 36 is a diagram for explaining the prior art. As shown in the figure, the information processing apparatus 100 and the information processing apparatus 200 are connected via a network 10. The information processing apparatus 100 includes a control unit 140, an input device 150, and an output device 160. In addition, the information processing apparatus 200 includes a control unit 210, an input device 220, and an output device 230. Here, the information processing apparatus is an apparatus capable of information communication, such as a server, a personal computer, or a mobile phone. The input device includes, for example, a keyboard, a mouse, a touch panel, and the like, and the output device includes, for example, a monitor, a speaker, and the like.

  For example, when the information processing apparatus 100 is equipped with a remote desktop function, the user of the information processing apparatus 200 can access the information processing apparatus 100 to remotely operate the information processing apparatus 100.

  By the way, depending on the industrial field, there are times when you want to convey your (operating side) operation details to a remote person (referring side) in real time, such as a telephone consultation about PC operation or remote conference. This is realized by using the remote desktop function.

  For example, when the information processing apparatus 100 illustrated in FIG. 36 has a remote desktop function, information indicating the operation content executed in the information processing apparatus 100 is transmitted from the information processing apparatus 100 to the information processing apparatus 200. . Then, in the information processing apparatus 200, the operation content executed by the information processing apparatus 100 is displayed and output. In this way, the operation content executed in the information processing apparatus 100 is transmitted to the user of the information processing apparatus 200 in real time.

  In addition, for the purpose of assisting understanding of the operation contents displayed on other information processing apparatuses by the remote desktop function, a technique for marking on a screen, a technique for using voice communication in combination, and the like have been proposed.

JP 2002-244987 A JP 2001-222507 A

  However, in the above-described prior art, the operation content of the information processing apparatus on the operation side displayed and output by the information processing apparatus on the reference side is not necessarily expressed in a state that is easily understood by the user of the information processing apparatus on the reference side. There is a problem that is not limited.

  For example, if the pointer operation of the information processing device on the operation side is too early, the user of the information processing device on the reference side cannot grasp the movement of the pointer displayed and output on the information processing device on the reference side. There may be a case where the operation content of the information processing apparatus cannot be grasped. In addition, for example, button operations such as click operations and shortcut key operations of the information processing apparatus on the operation side are not expressed to the extent that they can be identified by the information processing apparatus on the reference side. It is conceivable that the user cannot grasp the operation details of the information processing apparatus on the operation side. Also, for example, when an operation using the touch panel is performed on the information processing apparatus on the operation side, the pointer on the operation side of the reference side appears to the user of the information processing apparatus on the reference side to move instantaneously. There may be a case where the operation content of the information processing apparatus cannot be grasped.

  The disclosed technology has been made in view of the above, and an operation content transmission program capable of providing the operation content of the information processing apparatus on the operation side so that it can be easily understood by the user of the information processing apparatus on the reference side The purpose is to provide.

  The operation content transmission program disclosed in the present application, in one aspect, stores information indicating the content of the operation executed by the own device with respect to another device connected in a communicable state via a network. An operation content transmission program for causing a computer to execute processing to be transmitted, wherein the computer generates an operation reception procedure for receiving the operation and operation content expression information expressing the content of the operation received by the operation reception procedure. An operation content expression information generation procedure and a transmission procedure for transmitting operation content expression information generated by the operation content expression information generation procedure to the other device are executed.

  According to one aspect of the program disclosed in the present application, the operation content of the information processing apparatus can be provided so that the user of the information processing apparatus on the reference side can easily understand.

FIG. 1 is a diagram illustrating the information processing apparatus according to the first embodiment. FIG. 2 is a diagram illustrating the configuration of the information processing apparatus according to the second embodiment. FIG. 3 is a diagram illustrating the configuration of the information processing apparatus according to the second embodiment. FIG. 4 is a diagram illustrating the configuration of the reference processing unit according to the second embodiment. FIG. 5 is a diagram illustrating an example of data in the animation selection table according to the second embodiment. FIG. 6 is a diagram illustrating a flow of processing in the information processing apparatus according to the second embodiment. FIG. 7 is a diagram illustrating the configuration of the reference processing unit according to the third embodiment. FIG. 8 is a diagram illustrating an example of a click determined as unnecessary according to the third embodiment. FIG. 9 is a diagram illustrating a timeline for determining an unnecessary click according to the third embodiment. FIG. 10 is a diagram illustrating an example of a keyboard operation to be deleted according to the third embodiment. FIG. 11 is a diagram illustrating a process timeline in the information processing apparatus according to the third embodiment. FIG. 12 is a diagram illustrating a flow of processing in the information processing apparatus according to the third embodiment. FIG. 13 is a diagram illustrating a flow of processing in the information processing apparatus according to the third embodiment. FIG. 14 is a diagram illustrating the configuration of the reference processing unit according to the fourth embodiment. FIG. 15 is a diagram illustrating an example of a continuous operation according to the fourth embodiment. FIG. 16 is a diagram illustrating a process timeline in the information processing apparatus according to the fourth embodiment. FIG. 17 is a diagram illustrating an example of a continuous operation according to the fourth embodiment. FIG. 18 is a diagram illustrating a process timeline in the information processing apparatus according to the fourth embodiment. FIG. 19 is a diagram illustrating a flow of processing in the information processing apparatus according to the fourth embodiment. FIG. 20 is a diagram illustrating the configuration of the reference processing unit according to the fifth embodiment. FIG. 21 is a diagram for explaining the complement of the trajectory according to the fifth embodiment. FIG. 22 is a diagram for explaining trajectory interpolation according to the fifth embodiment. FIG. 23 is a diagram illustrating an example of the creation capture according to the fifth embodiment. FIG. 24 is a diagram illustrating an example of the creation capture according to the fifth embodiment. FIG. 25 is a diagram illustrating an example of the creation capture according to the fifth embodiment. FIG. 26 is a diagram for explaining trajectory interpolation according to the fifth embodiment. FIG. 27 is a diagram illustrating trajectory complementation according to the fifth embodiment. FIG. 28 is a diagram illustrating a process timeline in the information processing apparatus according to the fifth embodiment. FIG. 29 is a diagram illustrating a flow of processing in the information processing apparatus according to the fifth embodiment. FIG. 30 is a diagram illustrating a flow of processing in the information processing apparatus according to the fifth embodiment. FIG. 31 is a diagram illustrating the configuration of the reference processing unit according to the sixth embodiment. FIG. 32 is a diagram illustrating an example of an unnecessary keyboard input non-display process according to the sixth embodiment. FIG. 33 is a diagram illustrating an example of an unnecessary keyboard input non-display process according to the sixth embodiment. FIG. 34 is a diagram illustrating a flow of processing in the information processing apparatus according to the sixth embodiment. FIG. 35 is a diagram illustrating a computer that executes an operation content transmission program. FIG. 36 is a diagram for explaining the prior art.

  Hereinafter, an embodiment of the operation content transmission program disclosed in the present application will be described in detail. In addition, the technique which this application discloses is not limited by the Example demonstrated below as one Embodiment of the operation content transmission program which this application discloses.

  FIG. 1 is a diagram illustrating the information processing apparatus according to the first embodiment. The information processing apparatus stores an operation content transmission program disclosed in the present application. The operation content transmission program disclosed in the present application can be stored in the information processing apparatus as a remote desktop application, or can be stored as a plug-in in the information processing apparatus in which the remote desktop application has already been stored.

  The information processing apparatus 100 according to the first embodiment includes an operation reception unit 110, an operation content expression information generation unit 120, and a transmission unit 130 as illustrated in FIG.

  The operation reception unit 110 receives an operation from a user. The operation content expression information generation unit 120 generates operation content expression information that represents the content of the operation received by the operation reception unit 110. The transmission unit 130 transmits the operation content expression information generated by the operation content expression information generation unit 120 to other devices connected in a communicable state via the network.

  As described above, the information processing apparatus 100 according to the first embodiment receives an operation from a user, generates operation content expression information that expresses the content of the received operation in an easily understandable manner, and transmits the operation content expression information to another information processing apparatus. . For this reason, the operation content of the information processing apparatus 100 can be provided so that the user of the information processing apparatus on the reference side can easily understand.

[Configuration of Information Processing Apparatus (Example 2)]
FIG. 2 is a diagram illustrating the configuration of the information processing apparatus according to the second embodiment. Here, a case will be described in which information representing button operations such as a click operation and a shortcut operation executed in the information processing apparatus 100 is transmitted to the information processing apparatus 200.

  As illustrated in FIG. 2, the information processing apparatus 100 according to the second embodiment is connected to a state in which the information processing apparatuses 200 can communicate with each other via a network 10. As illustrated in FIG. 2, the information processing apparatus 100 includes a control unit 140, an input device 150, and an output device 160.

  As shown in FIG. 2, the input device 150 sends operation information corresponding to the content of the operation input from the user to the control unit 140. Note that the input device 150 includes, for example, a keyboard, a mouse, a touch panel, a microphone, and the like. The contents of the operation input include a click operation, a keyboard operation, a touch panel operation, a voice input operation, and the like.

  The output device 160 displays and outputs the operator capture received from the control unit 140. The output device 160 includes a display and a monitor.

  The control unit 140 includes an internal memory for storing a control program such as an OS (Operating System), a program that defines various processing procedures, and necessary data, and executes various processes using these. As illustrated in FIG. 2, the control unit 140 includes an input control unit 141, an output control unit 142, an operator processing unit 143, and a reference processing unit 144. The control unit 140 is an electronic circuit such as a CPU (Central Processing Unit) or an MPU (Micro Processing Unit).

  As shown in FIG. 2, the input control unit 141 sends the operation information received from the input device 150 to the operator processing unit 143 and the reference user processing unit 144.

  Upon receiving the operation information from the input control unit 141, the operator processing unit 143 creates an operator capture for the operator to refer to by processing the operation content corresponding to the operation information into information representing the operation content. . Here, the operator capture is a series of image information representing the contents of the operation. For example, the operator processing unit 143 creates information representing the character display corresponding to the keyboard operation and the cursor operation corresponding to the mouse operation to the extent that the operator can grasp as the operator capture.

  When receiving the operation information from the input control unit 141, the processing unit for reference 144 processes the operation content corresponding to the operation information into information that expresses the operation content of the user of the information processing apparatus 100 in an easily understandable manner. Create a reference capture. Then, as shown in FIG. 4, the processing unit for reference 144 has an animation selection unit 144A and a capture creation unit 144B. Here, the capture for the reference person is a series of image information expressed in an easy-to-understand manner so that the user of the information processing apparatus 200 can grasp the operation content. FIG. 4 is a diagram illustrating the configuration of the reference processing unit according to the second embodiment.

  The animation selection unit 144A has an animation selection table for selecting an animation corresponding to the operation information, and selects an animation to be used for processing the capture for the reference user. For example, as shown in FIG. 5, the animation selection table expresses each operation in an easy-to-understand manner in association with operations such as clicking, double-clicking, dragging, dragging release, and shortcut key input such as “Ctrl + C”. I remember the animation. Then, the animation selection unit 144A selects animation information corresponding to the operation information received from the input control unit 141 from the animation selection table, and sends the selected animation information to the capture creation unit 144B. Note that audio corresponding to the animation may be added to the animation information. FIG. 5 is a diagram illustrating an example of data in the animation selection table according to the second embodiment.

  The capture creation unit 144B creates a capture for a reference person using the animation information received from the animation selection unit 144A. For example, the capture creation unit 144B creates the capture for the reference by developing the animation information received from the animation selection unit 144A on the screen information. Further, the created capture for the reference person is sent to the output control unit 142.

  The output control unit 142 sends the operator capture received from the operator processing unit 143 to the output device 160. Further, the output control unit 142 transmits the capture for the reference received from the processing unit for the reference 144 to the information processing apparatus 200 via the network 10.

  The output device 160 displays and outputs the operator capture received from the control unit 140.

  Further, as illustrated in FIG. 2, the information processing apparatus 200 includes a control unit 210, an input device 220, and an output device 230. The input device 220 is the same device as the input device 150 described above, and sends operation information corresponding to the content of the operation input from the user to the control unit 210 as shown in FIG. The input device 220 includes, for example, a keyboard, a mouse, a touch panel, a microphone, and the like, similar to the input device 150 described above.

  The control unit 210 sends the reference capture received from the information processing apparatus 100 via the network 10 to the output apparatus 230. The output device 230 displays and outputs the reference capture received from the control unit 210. That is, the output device 230 displays and outputs information in which operations such as a click, a double click, a drag, a drag release, and “Ctrl + C” executed in the information processing device 100 are easily expressed by animation. Note that the output device 230 includes a display, a monitor, and the like.

  Next, a case where information representing a button operation when a user of the information processing apparatus 200 operates the information processing apparatus 100 by remote operation is transmitted to the information processing apparatus 200 will be described using FIG. 3. The point described below is different from the case where information representing button operations such as a click operation and a shortcut operation executed in the information processing apparatus 100 is transmitted to the information processing apparatus 200.

  As illustrated in FIG. 3, the input control unit 141 of the information processing apparatus 100 sends the operation information received from the information processing apparatus 200 to the operator processing unit 143 and the reference processing unit 144.

  When receiving the operation information from the information processing device 200 from the input control unit 141, the processing unit for operator 143 processes the operation information corresponding to the operation information into information that represents the operation content, thereby processing the information processing device 200 as an operator. Create an operator capture that can be referenced by other users.

  When receiving the operation information from the information processing apparatus 200 from the input control unit 141, the processing unit for reference 144 performs the following processing. In other words, the processing unit for reference 144 creates a capture for reference that easily expresses the operation content of the user of the information processing apparatus 200 by processing the operation content corresponding to the operation information into information.

  Since the processing of the animation selection unit 144A and the capture creation unit 144B is the same as the above-described processing, description thereof is omitted.

  The output control unit 142 transmits the operator capture received from the operator processing unit 143 to the information processing apparatus 200 via the network 10. Further, the output control unit 142 sends the capture for reference received from the processing unit for reference 144 to the output device 160.

  The output device 160 displays and outputs the capture for the reference received from the control unit 140. That is, in the output device 160, operations such as a click, a double click, a drag, a drag release, and “Ctrl + C” executed by the user of the information processing device 200 are easily understood by animation. Display the output information.

  As illustrated in FIG. 3, the control unit 210 of the information processing device 200 sends the operator capture received from the information processing device 100 via the network 10 to the output device 230. The output device 230 displays and outputs the operator capture received from the control unit 210.

[Processing by Information Processing Device (Example 2)]
FIG. 6 is a diagram illustrating a flow of processing in the information processing apparatus according to the second embodiment. As shown in the figure, when the operation input from the user is received by the input device 150 (Yes at Step S101), the animation selection unit 144A selects an animation used for processing of the capture for the reference (Step S102). .

  The capture creation unit 144B creates a capture for a reference person using the animation information selected by the animation selection unit 144A (step S103). The output control unit 142 transmits the reference capture created by the capture creation unit 144B to the information processing apparatus 200 via the network 10 (step S104).

  When the information processing apparatus 200 receives the reference capture from the information processing apparatus 100 (Yes in step S105), the information processing apparatus 200 displays and outputs the received reference capture (step S106). Then, the information processing apparatus 200 executes an operation process corresponding to the operation content of the reference capture that is displayed and output (step S107). For example, processing such as opening a file is executed in response to a mouse operation performed on the information processing apparatus 100.

[Effects of Example 2]
As described above, according to the second embodiment, a capture for a referer is generated using an animation that easily expresses a button operation such as a click operation or a shortcut operation, and is transmitted to the referrer side. For this reason, the operation content of the information processing apparatus 100 can be provided so that the user of the information processing apparatus 200 on the reference side can easily understand.

[Configuration of Information Processing Apparatus (Example 3)]
In the third embodiment, a case will be described in which an operation performed by the information processing apparatus 100 is suspended, and information expressed by deleting unnecessary operations from a series of suspended operations is transmitted to the information processing apparatus 200. FIG. 7 is a diagram illustrating the configuration of the reference processing unit according to the third embodiment. The information processing apparatus according to the third embodiment includes a control unit, an input device, and an output device that are the same as those of the information processing apparatus 100 according to the second embodiment. The reference processing unit 144 of the information processing apparatus according to the third embodiment is basically similar in configuration to the reference processing unit 144 (see FIGS. 2 and 3) according to the second embodiment. The difference is that it has an operation information holding unit 144C and an unnecessary operation determination unit 144D.

  The operation information holding unit 144C temporarily holds the operation information input by the user. For example, the operation information holding unit 144C holds by temporarily storing operation information including operation input coordinates and operation timing in addition to operation contents such as button operations. Then, the operation information holding unit 144C sequentially sends the held operation information to the unnecessary operation determination unit 144D while holding the operation information. Note that the hold in the operation information holding unit 144C is not limited to temporarily storing, but may be continuously stored.

  The unnecessary operation determination unit 144D determines whether or not the operation information received from the operation information holding unit 144C is unnecessary. If it is determined that the operation information is unnecessary, the operation information is deleted. FIG. 8 is a diagram illustrating an example of a click determined as unnecessary according to the third embodiment. The figure shows a plurality of tabs A, B, and C as objects that can be operated by the user. Then, as shown in FIG. 1A, the unnecessary operation determination unit 144D determines that an operation other than the tabs A, B, and C, that is, a click on a coordinate having no object, is an unnecessary operation. Then, the unnecessary operation determination unit 144D deletes the operation information held by the operation information holding unit 144C, for example, operation information indicating an operation to a coordinate having no object.

  Further, as shown in (2) of FIG. 8, the unnecessary operation determination unit 144D, when the tab B is clicked immediately after the tab A is clicked, from the cursor corresponding to the click on the tab A, The moving distance of the cursor corresponding to the click on B is calculated. If the calculated movement distance of the cursor is equal to or less than the set value, the unnecessary operation determination unit 144D determines that the click on the tab A is an unnecessary operation, and the operation held by the operation information holding unit 144C. Information, for example, operation information indicating a click operation on tab A is deleted. For example, FIG. 9 illustrates information transfer from the information processing apparatus 100 to the information processing apparatus 200 and elapsed time in the information processing apparatus 100 and the information processing apparatus 200. As shown in the figure, only a click on tab B is passed from information processing apparatus 100 to information processing apparatus 200, and only a click on tab B is displayed on information processing apparatus 200. FIG. 9 is a diagram illustrating a timeline for determining an unnecessary click according to the third embodiment.

  Further, the unnecessary operation determination unit 144D determines whether or not the plurality of operation information held by the operation information holding unit 144C is a continuous operation input within a predetermined time and corresponds to a predetermined combination. Depending on the determination result, it is determined that some operation information is unnecessary. For example, as shown in FIG. 10, the unnecessary operation determination unit 144D again performs the same key operation (Ctrl + C) within the copy operation reception time (see FIG. 11) from the key operation (Ctrl + C) corresponding to the copy command. ), It is determined that the first key operation (Ctrl + C) is unnecessary. Then, the unnecessary operation determination unit 144D deletes the operation information held in the operation information holding unit 144C, for example, the first key operation (Ctrl + C) corresponding to the copy command. FIG. 10 is a diagram illustrating an example of a keyboard operation to be deleted according to the third embodiment. FIG. 11 is a diagram illustrating a process timeline in the information processing apparatus according to the third embodiment.

  Further, for example, as shown in FIG. 10, the unnecessary operation determination unit 144D performs the key operation (Ctrl + V) corresponding to the paste command within the paste operation reception time (see FIG. 11) from the key operation (Ctrl + C). If there is no, it is determined that the key operation (Ctrl + C) is unnecessary. Then, the unnecessary operation determination unit 144D deletes the operation information held in the operation information holding unit 144C, for example, the first key operation (Ctrl + C) corresponding to the copy command.

  Then, as described above, the animation selection unit 144A selects an animation to be used for processing the capture for the reference for the operation information remaining without being deleted, and the capture creation unit performs the capture for the reference using the animation information. create.

[Processing by Information Processing Device (Example 3)]
12 and 13 are diagrams illustrating a flow of processing in the information processing apparatus according to the third embodiment. First, the flow of processing for determining and deleting unnecessary clicks will be described with reference to FIG. As shown in the figure, when a click from the user (hereinafter referred to as the first click) is received by the input device 150 (Yes in step S201), the operation information holding unit 144C displays the operation information input by the user. Temporarily hold (step S202).

  The unnecessary operation determination unit 144D uses the operation information held by the operation information holding unit 144C to determine whether there is an object at the coordinate at which the first click is received (step S203).

  If it is determined in step S203 that there is an object at the coordinate at which the first click is received (Yes in step S203), the unnecessary operation determination unit 144D clicks on a different coordinate within a certain time (hereinafter, the second click). ) Is received (step S204).

  In step S204, when the second click is not received within a certain time (No in step S204), the animation selection unit 144A selects an animation corresponding to the first click (step S205).

  The capture creation unit creates a capture for the reference person using the animation information selected by the animation selection unit 144A (step S206). The output control unit 142 transmits the capture for the reference created by the capture creation unit 144B to the information processing apparatus 200 via the network 10 (step S207).

  On the other hand, in step S204, when the second click is received within a certain time (Yes in step S204), the operation information holding unit 144C temporarily holds the operation information input by the user (step S208). ).

  The unnecessary operation determination unit 144D calculates the distance between the first click and the second click using the operation information held by the operation information holding unit 144C (step S209). Then, the unnecessary operation determination unit 144D determines whether or not the distance between the first click and the second click is greater than a set value (step S210).

  If it is determined in step S210 that the distance between the first click and the second click is greater than the set value (Yes in step S210), the animation selection unit 144A responds to the first click and the second click. The animation to be selected is selected (step S211). Then, as described above, the processing from step S206 is performed.

  On the other hand, if it is determined in step S210 that the distance between the first click and the second click is not greater than the set value (No in step S210), the unnecessary operation determination unit 144D corresponds to the first click. The operation information is deleted (step S212). Then, the animation selection unit 144A selects an animation corresponding to the second click (step S213). Then, as described above, the processing from step S206 is performed.

  On the other hand, when it is determined in step S203 that there is no object at the coordinates where the first click is detected (No in step S203), the unnecessary operation determination unit 144D deletes the operation information corresponding to the first click ( Step S214). And as mentioned above, the process below step S201 is performed.

  Next, the flow of a process for determining that it is unnecessary depending on a combination of specific operations will be described with reference to FIG. As shown in the figure, when the input device 150 receives a copy command from the user (Yes at Step S301), the operation information holding unit 144C temporarily stores the operation information corresponding to the copy command input by the user. (Step S302).

  The unnecessary operation determination unit 144D determines whether to detect the copy command again within the copy operation reception time (step S303).

  In step S303, when the copy command is not detected again within the copy operation reception time (No at step S303), the unnecessary operation determination unit 144D determines whether or not the paste command is detected within the paste operation reception time. Determination is made (step S305).

  In step S304, when a paste command is detected within the paste operation reception time (Yes in step S305), the animation selection unit 144A selects an animation corresponding to the copy command and the paste command (step S307).

  The capture creation unit creates a capture for a reference person using the animation information selected by the animation selection unit 144A (step S308). The output control unit 142 transmits the capture for the reference created by the capture creation unit 144B to the information processing apparatus 200 via the network 10 (step S309).

  On the other hand, if a paste command is not detected within the paste operation reception time in step S304 (No in step S305), the unnecessary operation determination unit 144D deletes the operation information suspended in step S302 (step S306). Then, as described above, the processing from step S301 is performed.

  On the other hand, when the copy command is detected again within the copy operation reception time in step S303 (Yes in step S303), the unnecessary operation determination unit 144D overwrites the operation information suspended in step S302 and adds new operation information. Hold (step S304). Then, as described above, the processing from step S303 is performed.

  In the processing in the information processing apparatus according to the third embodiment, the determination in step S210 is performed after the determination in step S204. However, the determination is not necessarily performed in this order. That is, in the processing in the information processing apparatus according to the third embodiment, the determination in step S204 may be performed after the determination in step S210.

[Effects of information processing apparatus (Example 3)]
As described above, according to the third embodiment, a capture for a reference is generated using an animation that is determined by deleting unnecessary operations and deleted, and is transmitted to the reference side. For this reason, the operation content of the information processing apparatus 100 can be provided to the information processing apparatus 200 on the reference side as information that is expressed so as to be easily understood by the user of the information processing apparatus 200 on the reference side.

[Configuration of Information Processing Apparatus (Example 4)]
In the fourth embodiment, a case will be described in which an operation executed by an information processing device is suspended and information expressed by leveling the interval between operations is transmitted to another information processing device. For example, in the fourth embodiment, a case will be described in which information expressed by leveling a continuous operation performed by an information processing apparatus is transmitted to another information processing apparatus. FIG. 14 is a diagram illustrating a configuration of the reference processing unit according to the second embodiment. The information processing apparatus according to the fourth embodiment includes a control unit, an input device, and an output device that are the same as those of the information processing apparatus according to the second embodiment described above. The processing unit for reference 144 of the information processing apparatus according to the fourth embodiment has basically the same configuration as the processing unit for reference 144 according to the second embodiment (see FIGS. 2 and 3). However, the operation information holding unit 144C and the leveling operation information calculation unit 144E are different.

  As illustrated in FIG. 14, the processing unit 144 for the information processing apparatus according to the fourth embodiment includes an operation information holding unit 144C, a leveling operation information calculation unit 144E, an animation selection unit 144A, and a capture creation unit 144B. And have.

  The leveling operation information calculation unit 144E calculates the leveling operation information using the operation information held by the operation information holding unit 144C. FIG. 15 is a diagram illustrating an example of a continuous operation according to the fourth embodiment. FIG. 16 is a diagram illustrating a process timeline in the information processing apparatus according to the fourth embodiment. For example, FIG. 15 shows (1) “click”, (2) “move”, (3) “click”, (4) “move”, (4) on the desktop screen of the information processing apparatus 100 according to the fourth embodiment. 5) “Click”, (6) “Move”, and (7) “Click” are illustrated as continuous operations with different time intervals. This continuous operation is assumed to be executed at the following time intervals. That is, for example, at time 1 (1) “click”, at time 2 (2) “move”, at time 3 (3) “click”, at time 4 (4) “move”, at time 5 (5) “Click”, (6) “Move” at time 6 to 12, and (7) “Click” at time 13 (see FIG. 16). At this time, in the information processing apparatus 200 according to the fourth embodiment, the information on the continuous operation executed by the information processing apparatus 100 according to the fourth embodiment is received in a state where the time intervals are expressed as follows. Passed. That is, for example, “click” at time 15, “movement” at time 16 to 18, “click” at time 19, “movement” at time 20 to 22, “click” at time 23, “movement” at time 24 to 26 ”And the time interval“ click ”at time 27 (see FIG. 16). The operations (1) to (7) shown in FIG. 16 correspond to the operations (8) to (14) shown in FIG. The leveling operation information calculation unit 144E performs an operation with a short time interval until the execution (operations (1) to (5) in FIG. 15) and an operation with a long time interval until the execution ((( Leveling operation information expressing a continuous operation in which operations 6) and (7)) are mixed at a fixed interval is calculated.

  FIG. 17 is a diagram illustrating an example of a continuous operation according to the fourth embodiment. FIG. 18 is a diagram illustrating a process timeline in the information processing apparatus according to the fourth embodiment. For example, in FIG. 17, in the information processing apparatus 100 according to the fourth embodiment, (1) “click”, (2) “move”, (3) “click”, (4) “move”, (5) Examples of continuous operations with different moving speeds among operations “click”, (6) “move”, and (7) “click”. It is assumed that this continuous operation is executed with the following movement amount (movement amount moved for a certain time at a certain speed). That is, for example, at time 1 (1) “click”, at time 2 (2) “move”, at time 3 (3) “click”, at time 4 (4) “move”, at time 5 (5) “Click”, (6) “Move” at time 6 to 12, and (7) “Click” at time 13 (see FIG. 18). At this time, in the information processing apparatus 200 according to the fourth embodiment, the information on the continuous operation executed by the information processing apparatus 100 according to the fourth embodiment is received in a state where the movement amount is expressed as follows as follows. Passed. That is, for example, “click” at time 15, “move” at time 16-17, “click” at time 18, “move” at time 19-23, “click” at time 24, “move” at time 25-26 ”, The movement speed between the“ click ”operations is leveled at time 27 (see FIG. 18). The operations (1) to (7) shown in FIG. 18 correspond to the operations (8) to (14) shown in FIG. The leveling operation information calculation unit 144E calculates leveling operation information in which a continuous operation in which a plurality of operations having different movement speeds between operations is mixed is expressed with a constant cursor movement speed.

[Processing by Information Processing Device (Example 4)]
FIG. 19 is a diagram illustrating a flow of processing in the information processing apparatus according to the fourth embodiment. As shown in the figure, when a plurality of continuous operations from the user are received within a certain time in the input device 150 (Yes in step S401), the operation information holding unit 144C receives the plurality of times input by the user. Is temporarily suspended (step S402).

  The leveling operation information calculation unit 144E calculates the leveled operation information using the operation information held by the operation information holding unit 144C (step S403). For example, the leveling operation information calculation unit 144E performs a continuous operation in which an early operation (operations (1) to (5) in FIG. 15) and a slow operation (operations (6) and (7) in FIG. 15) are mixed. The leveling operation information expressing the above information at a certain time interval is calculated. Further, the leveling operation information calculation unit 144E displays information on continuous operations in which a long movement amount (movement (4) in FIG. 17) and a short movement amount (movements (2) and (6) in FIG. 17) are mixed. Leveling operation information expressed at a constant cursor movement speed is calculated.

  Then, the animation selection unit 144A selects an animation corresponding to the leveling operation information calculated by the leveling operation information calculation unit 144E (step S404). The capture creation unit creates a capture for the reference person using the animation information selected by the animation selection unit 144A (step S405). The output control unit 142 transmits the capture for the reference created by the capture creation unit 144B to the information processing apparatus 200 via the network 10 (step S406).

[Effects of Information Processing Apparatus (Example 4)]
As described above, according to the fourth embodiment, a reference capture is generated in which the operation content of the information processing apparatus 100 is expressed at regular time intervals so that the user of the information processing apparatus 200 on the reference side can easily understand. Therefore, even for continuous operations with different operation intervals, the operation content of the information processing apparatus 100 can be provided so that the user of the information processing apparatus 200 on the reference side can easily understand.

  Further, as described above, according to the fourth embodiment, the capture for the reference person is created using the animation that expresses the cursor movement speed in the continuous operation by leveling. Therefore, even in a continuous operation with different operation speeds between operations, the operation content of the information processing apparatus 100 can be provided so that the user of the information processing apparatus 200 on the reference side can easily understand.

  In the above-described fourth embodiment, the leveling operation information calculation unit 144E has been described as an example in which the leveling operation information is calculated by sequentially editing the operation information held by the operation information holding unit 144C. Examples are not limited to this. For example, the leveling operation information calculation unit 144E collects the leveling information from the operation information held by the operation information holding unit 144C collectively when the timing at which the operation information is transmitted to the information processing device 200 is reached. You may create it.

[Configuration of Information Processing Apparatus (Example 5)]
In the fifth embodiment, a case where information expressed by omitting unnecessary cursor movement from the operation information of the cursor executed in the information processing apparatus is transmitted to another information processing apparatus will be described. FIG. 20 is a diagram illustrating the configuration of the reference processing unit according to the fifth embodiment. The information processing apparatus according to the fifth embodiment includes a control unit, an input device, and an output device that are the same as those of the information processing apparatus 100 according to the second embodiment. The reference processing unit 144 of the information processing apparatus according to the fifth embodiment is basically similar in configuration to the reference processing unit 144 (see FIGS. 2 and 3) according to the second embodiment. The difference is that the operation information holding unit 144C and the cursor trajectory calculation unit 144F are provided.

  As illustrated in FIG. 20, the processing unit 144 for a reference in the information processing apparatus according to the fifth embodiment includes an operation information holding unit 144C, a cursor locus calculation unit 144F, an animation selection unit 144A, and a capture creation unit 144B. Have.

  The cursor trajectory calculation unit 144F calculates the cursor trajectory using the operation information held by the operation information holding unit 144C. FIG. 21 and FIG. 22 are diagrams for explaining trajectory complementation according to the fifth embodiment. FIG. 23 to FIG. 25 are diagrams illustrating an example of the creation capture according to the fifth embodiment. For example, as shown in FIG. 21, on the desktop screen of the information processing apparatus according to the fifth embodiment, after (1) the “first click” operation, (2) the “move while moving” operation, Finally, an operation such as (3) “second click” operation may be executed. In such a case, the operation information holding unit 144C holds unnecessary operation information such as “move while moving” operation shown in (2) of FIG. Therefore, the cursor trajectory calculation unit 144F deletes operation information related to unnecessary cursor movement from the operation information held by the operation information holding unit 144C, and connects (complements) click operations as shown in FIG. Calculate the trajectory.

  The cursor trajectory calculated by the cursor trajectory calculation unit 144F may be indicated by a straight line connecting the shortest distances between the operation coordinates or may be indicated by a curve.

  The capture creation unit 144B creates captures as shown in FIGS. 23 to 25 based on the trajectory calculated by the cursor trajectory calculation unit 144F. For example, FIG. 24 shows a capture created by expanding the cursor animation on a straight line indicating the trajectory calculated by the cursor trajectory calculating unit 144F.

[Processing by Information Processing Device (Example 5)]
FIG. 29 is a diagram illustrating a flow of processing in the information processing apparatus according to the third embodiment. With reference to FIG. 29, a flow of processing for complementing the locus by omitting unnecessary cursor movement will be described. As shown in the figure, when the input device 150 receives a click from the user (hereinafter, “first click”) (Yes in step S501), the operation information holding unit 144C temporarily stores the operation information input by the user. Is temporarily suspended (step S502).

  After receiving the first click, the cursor trajectory calculation unit 144F determines whether or not to accept the next click (hereinafter referred to as the second click) within a certain time (step S503).

  In step S503, when the second click is received within a predetermined time (Yes in step S503), the operation information holding unit 144C holds the corresponding operation information (step S504). Then, the cursor trajectory calculation unit 144F calculates the cursor trajectory using the coordinate information of the first click and the second click held by the operation information holding unit 144C (step S505). Then, the animation selection unit 144A selects an animation corresponding to the first click to the second click (step S506).

  The capture creation unit creates a capture for the reference person using the animation information selected by the animation selection unit 144A (step S507). The output control unit 142 transmits the capture for the reference created by the capture creation unit 144B to the information processing apparatus 200 via the network 10 (step S508).

  On the other hand, if the second click is not received within the predetermined time in step S503 (No in step S503), the animation selection unit 144A selects an animation corresponding to the first click (step S509). Then, as described above, the processing from step S507 is performed.

[Effects of information processing apparatus (Example 5)]
As described above, according to the fifth embodiment, information regarding unnecessary cursor movement is deleted, and a capture for a reference is created using an animation that is complemented and expressed so that the locus of the cursor is easily understood. To the side. For this reason, the operation information of the information processing apparatus 100 is expressed by omitting unnecessary cursor movement so that the user of the information processing apparatus 200 on the reference side can easily understand. Can be provided.

  In the above-described fifth embodiment, a case has been described in which information expressed by omitting unnecessary cursor movement from the operation information of the cursor executed by the information processing apparatus is transmitted to another information processing apparatus. The present embodiment is not limited to this. For example, the cursor trajectory calculation unit 144F described above refers to the coordinate information of the previous cursor operation held in the operation information holding unit 144C even when an operation is accepted by an input device (such as a touch panel) where the cursor is not displayed. The cursor trajectory can also be calculated. FIG. 26 and FIG. 27 are diagrams for explaining trajectory complementation according to the fifth embodiment. FIG. 28 is a diagram illustrating a process timeline in the information processing apparatus according to the fifth embodiment.

  For example, when the user performs a cursor operation using the touch panel in the information processing apparatus 100 according to the fifth embodiment, as illustrated in FIG. 26, (1) even if the previous click operation is performed (2) The movement of the cursor is not displayed, and (3) a click operation may be executed. Therefore, as shown in FIG. 27, the cursor locus calculation unit 144F described above (1) refers to the coordinate information of the previous click operation, and (3) calculates the locus between the cursors until the click operation. Complement the trajectory between cursors.

  For example, as illustrated in FIG. 28, when (3) “click” is executed in the information processing apparatus 100 according to the fifth embodiment, the cursor trajectory calculation unit 144F displays (1) coordinate information of “previous click”. The trajectory is calculated with reference to FIG. The information processing apparatus 100 according to the fifth embodiment transmits information on the locus between cursors to the information processing apparatus 200 according to the fifth embodiment. The information processing apparatus 200 according to the fifth embodiment displays and outputs information received from the information processing apparatus 100 according to the fifth embodiment. In this manner, in the information processing apparatus 200 according to the fifth embodiment, the operation information in which the locus from (1) “previous click” to (3) “click” is complemented is displayed as an animation.

  Next, a flow of processing for complementing a locus when cursor movement is not displayed (when touch panel operation is performed) will be described with reference to FIG. FIG. 30 is a diagram illustrating a flow of processing in the information processing apparatus according to the fifth embodiment. As shown in the figure, when a click operation from the user is accepted in the input device 150 (Yes in step S601), the operation information holding unit 144C holds the operation information input by the user (step S602).

  The cursor locus calculation unit 144F determines whether or not the previous click coordinate is recorded in the operation information holding unit 144C (step S603).

  In step S603, when the previous click coordinates are recorded in the operation information holding unit 144C (Yes in step S603), the cursor trajectory calculation unit 144F calculates the cursor trajectory from the previous click coordinates and the current click coordinates. (Step S604). Then, the animation selection unit 144A selects an animation corresponding to the locus of the cursor and the click operation (step S605).

  The capture creation unit creates a capture for the reference person using the animation information selected by the animation selection unit 144A (step S606). The output control unit 142 transmits the reference capture created by the capture creation unit 144B to the information processing apparatus 200 via the network 10 (step S607).

  On the other hand, in step S603, when the previous click coordinates are not recorded in the operation information holding unit 144C (No in step S603), the animation selection unit 144A selects an animation corresponding to a single click (step S608). . Then, as described above, the processing from step S606 is performed.

  As described above, when a touch panel operation that does not display the movement between cursors is accepted, the reference capture is performed using an animation that complements the movement trajectory between the cursors so that the touch panel operation is easy to understand. Is created and sent to the referrer. For this reason, even in a touch panel operation in which movement between cursors is not displayed, the operation content of the information processing apparatus 100 is made easy for the user of the information processing apparatus 200 on the reference side to understand the information processing apparatus on the reference side. 200 can be provided.

[Configuration of Information Processing Apparatus (Example 6)]
In the sixth embodiment, a case where information expressed by omitting unnecessary keyboard input from a series of operations executed in the information processing apparatus 100 is transmitted to the information processing apparatus 200 will be described. FIG. 31 is a diagram illustrating the configuration of the reference processing unit according to the sixth embodiment. The information processing apparatus according to the sixth embodiment includes a control unit, an input device, and an output device that are the same as those of the information processing apparatus 100 according to the second embodiment. The reference processing unit 144 of the information processing apparatus according to the sixth embodiment is basically similar in configuration to the reference processing unit 144 (see FIGS. 2 and 3) according to the second embodiment. The difference is that it has an operation information holding unit 144C and a FIFO stack 144G.

  As illustrated in FIG. 31, the processing unit 144 for a reference in the information processing apparatus 100 according to the sixth embodiment includes an operation information holding unit 144C, an animation selection unit 144A, a capture creation unit 144B, and a FIFO stack 144G. .

  The operation information holding unit 144C sends the character information input from the keyboard to the FIFO stack 144G. Then, the operation information holding unit 144C sends the character information received from the FIFO stack 144G to the animation selection unit 144A.

  The FIFO stack 144G holds the character information received from the operation information holding unit 144C one character at a time, receives a deletion instruction for the held character information, and sequentially deletes the held keyboard information from the latest keyboard input. And when FIFO stack 144G receives the character information more than the number of possessed stacks, it will output in order from the character information previously suspended.

  FIGS. 32 and 33 are diagrams illustrating an example of a non-display process of unnecessary keyboard input according to the sixth embodiment. In FIG. 32, in the information processing apparatus according to the sixth embodiment, keyboard input is accepted in order of “C”, “A”, “T”, “Delete”, “Delete”, “U”, “P”. Shows the case. FIG. 33 illustrates a situation in which the processing unit 144 for the information processing apparatus according to the sixth embodiment temporarily holds the character information on the stack in the process of receiving the keyboard input and outputting the character information. Show.

  For example, as shown in FIG. 32, if the Delete key is input while the FIFO stack 144G holds “CAT” as character information, the latest character information “T” held is deleted. Further, for example, when the Delete key is input while “CA” is held as character information, the latest character information “A” held is deleted. Further, for example, when the “Delete” key is input twice while “CAT” is held as character information, the latest character information “T” and “A” held are deleted. Further, when character information “U” is input while “C” is reserved as character information, character information “U” is added and character information “CU” is reserved. Further, for example, when character information “P” is input while “CU” is reserved as character information, character information “CUP” is reserved with the addition of character information “P”. Therefore, when the key input for correcting the character information “CAT” to the character information “CUP” is received from the user, the FIFO stack 144G does not output the character information “CAT” before correction, and does not output it. Only the subsequent character information “CUP” is output. In addition, when receiving the character information of the fourth character, the FIFO stack 144G outputs “C” that has been previously suspended.

  The animation selecting unit 144C sends the character information received from the operation information holding unit 144C to the capture creating unit 144B. The capture creation unit 144B sends the character information received from the animation selection unit 144C to the output control unit 142. The output control unit 142 transmits the character information received from the capture creation unit 144B to another information processing apparatus via the network 10. Further, the output control unit 142 sends the character information received from the capture creation unit 144B to the output device. The output device displays and outputs the character information received from the capture creation unit 144B.

[Processing by Information Processing Apparatus (Example 6)]
FIG. 34 is a diagram illustrating a flow of processing in the information processing apparatus according to the sixth embodiment. As shown in the figure, when receiving a keyboard input (Yes in step S701), the FIFO stack 144G holds the character information in the FIFO stack (step S702). Then, the FIFO stack 144G determines whether or not to accept the next keyboard input within a certain time (step S703).

  In step S703, when the next keyboard input is received within a fixed time (Yes in step S703), the FIFO stack 144G determines whether or not the keyboard input is a deletion command (step S704).

  If the keyboard input is not a delete command in step S704 (No in step S704), the FIFO stack 144G determines whether there is an empty stack in the stack (step S705).

  If there is no empty stack in the stack in step S705 (No in step S705), the FIFO stack 144G outputs the first character information in the stack (step S706). Subsequently, the FIFO stack 144G moves the character information in the stack to the front stack (step S707). Then, the FIFO stack 144G holds the character information received in step S703 in an empty stack (step S708).

  On the other hand, if there is an empty stack in the stack in step S705 (Yes in step S705), the FIFO stack 144G holds the character information in the empty stack (step S708).

  On the other hand, if the keyboard input is a delete command in step S704 (Yes in step S704), the FIFO stack 144G deletes the latest character information in the stack (step S709).

  On the other hand, if the next keyboard input is not received within the predetermined time in Step S703 (No in Step S703), the FIFO stack 144G outputs the character information in the stack (Step S710). Then, as described above, the processing from step S701 is performed.

  When the delete instruction is received in a state where character information is not held in the stack, the FIFO stack 144G outputs the delete instruction and executes the delete instruction on the information processing apparatus 200 side.

[Effects of Information Processing Device (Example 6)]
As described above, according to the sixth embodiment, a reference capture is created using an animation expressed by omitting unnecessary keyboard input, and is transmitted to the reference side. For this reason, the operation content of the information processing apparatus 100 can be provided to the information processing apparatus 200 on the reference side as information that is expressed so as to be easily understood by the user of the information processing apparatus 200 on the reference side.

  Hereinafter, another embodiment of the operation content transmission program disclosed in the present application will be described.

(1) Device Configuration, etc. For example, each component of the information processing apparatus 100 shown in FIGS. 2 and 3 is functionally conceptual and does not necessarily need to be physically configured as illustrated. That is, the specific form of distribution / integration of the information processing apparatus 100 is not limited to that shown in the figure. For example, the functions of the operator processing unit 143 and the reference processing unit 144 are integrated and integrated. As described above, all or a part of the information processing apparatus 100 can be configured to be functionally or physically distributed and integrated in arbitrary units according to various loads and usage conditions.

(2) Operation content transmission program Various processes of the information processing apparatus 100 described in the above embodiment (for example, see FIGS. 6, 12, 13, 19, 29, 30, 34, etc.) are prepared in advance. It can also be realized by executing the program on a computer system such as a personal computer or a workstation. In the following, an example of a computer that executes an operation content transmission program having the same function as the information processing apparatus described in the above embodiment will be described with reference to FIG. FIG. 35 is a diagram illustrating a computer that executes an operation content transmission program.

  As shown in the figure, a computer 300 as an information processing apparatus is configured by connecting a communication control unit 310, an HDD 320, a RAM 330, and a CPU 340 via a bus 400.

  Here, the communication control unit 310 controls communication related to the exchange of various types of information. The HDD 320 stores information necessary for executing various processes by the CPU 340. The RAM 330 temporarily stores various information. The CPU 340 executes various arithmetic processes.

  As shown in FIG. 35, the HDD 320 includes an operation content transmission program 321 that exhibits the same function as each processing unit of the information processing apparatus 100 described in the above embodiment, and operation content transmission data 322. Pre-stored. Note that the operation content transmission program 321 may be appropriately distributed and stored in a storage unit of another computer that is communicably connected via a network.

  Then, the CPU 340 reads the operation content transmission program 321 from the HDD 320 and develops it in the RAM 330, so that the operation content transmission program 321 functions as an operation content transmission process 331 as shown in FIG.

  That is, the operation content transmission process 331 reads the operation content transmission data 322 and the like from the HDD 320, expands the operation content transmission data 322 and the like in an area allocated to itself in the RAM 330, and executes various processes based on the expanded data and the like.

  The operation content transmission process 331 is executed in, for example, the input control unit 141, the output control unit 142, the operator processing unit 143, and the reference processing unit 144 of the information processing apparatus illustrated in FIGS. Corresponds to processing.

  Note that the operation content transmission program 321 described above is not necessarily stored in the HDD 320 from the beginning.

  For example, each program is stored in a “portable physical medium” such as a flexible disk (FD), a CD-ROM, a DVD disk, a magneto-optical disk, and an IC card inserted into the computer 300. Then, the computer 300 may read and execute each program from these.

  Further, each program is stored in “another computer (or server)” connected to the computer 300 via a public line, the Internet, a LAN, a WAN, or the like. Then, the computer 300 may read and execute each program from these.

  The following supplementary notes are further disclosed with respect to the embodiments including the above examples.

(Supplementary note 1)
An operation acceptance procedure for accepting an operation from a user;
An operation content expression information generation procedure for generating operation content expression information expressing the content of the operation received by the operation reception procedure;
A transmission procedure for transmitting the operation content expression information generated by the operation content expression information generation procedure to other devices connected in a state where they can communicate with each other via a network;
The operation content transmission program characterized by performing this.

(Supplementary note 2)
Further executing an operation hold procedure for temporarily holding the operation accepted by the operation acceptance procedure,
The operation content transmission program according to appendix 1, wherein the operation content expression information generation procedure generates the operation content expression information that represents the content of the operation suspended by the operation suspension procedure.

(Appendix 3)
The operation content expression information generation procedure selects the corresponding operation information corresponding to the operation suspended by the operation suspension procedure from the storage unit storing the corresponding operation information corresponding to the operation, and the selected corresponding operation 3. The operation content transmission program according to appendix 1 or 2, wherein the operation content expression information expressing the content of the suspended operation is generated using information.

(Supplementary note 4)
Whether the operation suspended by the operation suspension procedure satisfies a predetermined condition, or the relationship between the suspended operation and the next operation accepted by the operation acceptance procedure after the suspended operation is predetermined. A determination procedure for determining whether or not the condition is satisfied;
When it is determined by the determination procedure that the predetermined condition is not satisfied, a deletion unit that deletes the operation suspended by the operation suspension procedure;
The operation content transmission program according to appendix 2, wherein the program is further executed.

(Additional remark 5) The said determination procedure determines whether the operation suspended by the said operation suspension procedure is operation which designates an operation corresponding | compatible object,
The appendix 3 is characterized in that, when the determination procedure determines that the operation is not an operation for designating an operation corresponding object, the operation suspended by the operation suspension procedure is deleted. The operation content transmission program described.

(Additional remark 6) The said determination procedure determines whether the next operation was received by the said operation reception procedure within the fixed time from the time of the said suspension start of the operation,
If the determination procedure determines that the next operation is received by the operation reception procedure and the determination procedure determines whether the operation position interval between the operation and the next operation is within a set interval. Determine
The operation content transmission program according to appendix 3, wherein the deletion procedure deletes the operation suspended by the operation suspension procedure when it is determined that the operation position interval is within the set interval. .

(Additional remark 7) The said determination procedure determines whether the next operation was received by the said operation reception procedure within the fixed time from the holding start of the operation hold | maintained by the said operation hold procedure,
In the computer,
Whether the combination of the pending operation and the next operation corresponds to a predetermined combination of operations when the next operation is received by the operation reception procedure and the determination procedure determines Further execute an operation combination determination procedure for determining
Appendix 3 wherein the operation content expression information generation procedure deletes the operation suspended by the operation suspension procedure when it is determined by the operation combination determination procedure that the combination is the predetermined operation The operation content transmission program described in 1.

(Supplementary note 8)
Further executing a continuous operation determination procedure for determining whether the operation suspended by the operation suspension procedure and the next operation accepted by the operation acceptance procedure after the suspended operation are continuous operations;
When it is determined by the continuous operation determination procedure that the operation is the continuous operation, the operation content expression information generation procedure is the operation content expressed by leveling the interval between the suspended operation and the next operation. The operation content transmission program according to appendix 2, wherein expression information is generated.

(Supplementary Note 9) If the operation content expression information generation procedure is determined to be the continuous operation by the continuous operation determination procedure, the interval between the suspended operation and the next operation is set according to the operation position. 9. The operation content transmission program according to appendix 8, wherein the operation content expression information expressed in a leveled manner is generated.

(Additional remark 10) The said operation content representation information generation procedure produces | generates the said operation content representation information which complemented and expressed the locus | trajectory between the said pending operation and the said next operation. The operation content transmission program described in 1.

(Supplementary Note 11) The operation hold procedure holds a plurality of the operations,
The operation content transmission program according to appendix 2, wherein the operation content expression information generation procedure generates the operation content expression information expressed by compressing the plurality of pending operations.

(Supplementary Note 12) The operation hold procedure holds a predetermined number of keyboard inputs accepted by the operation acceptance procedure,
In the computer,
A deletion instruction receiving procedure for receiving a deletion instruction for keyboard input held by the operation holding procedure;
Each time the delete instruction is accepted by the delete instruction acceptance procedure, an input deletion procedure for sequentially deleting from the latest keyboard input held by the operation hold procedure;
The operation content transmission program according to appendix 2, wherein the program is further executed.

DESCRIPTION OF SYMBOLS 10 Network 100 Information processing apparatus 110 Operation reception part 120 Operation content expression information generation part 130 Transmission part 140 Control part 141 Input control part 142 Output control part 143 Operator process part 144 Reference process part 144A Animation selection part 144B Capture creation Unit 144C operation information holding unit 144D unnecessary operation determining unit 144E leveling operation information calculating unit 144F cursor locus calculating unit 144G FIFO stack 150 input device 160 output device 200 information processing device 210 control unit 220 input device 230 output device 300 computer 310 communication control Part 320 HDD
321 Operation information transmission program 322 Operation information transmission data 330 RAM
331 Operation information transmission process 340 CPU
400 bus

Claims (10)

In a terminal that can communicate with other terminals,
When a click operation is performed on a screen shared with the terminal in the other terminal, a symbol image of the click operation indicating that the click operation has been performed is received from the other terminal and displayed on the terminal. Control means,
A terminal comprising: A method of controlling a terminal that can communicate with another terminal,
When a click operation is performed on a screen shared with the terminal in the other terminal, a symbol image of the click operation indicating that the click operation has been performed is received from the other terminal and displayed on the terminal. Execute control,
Terminal control method. A terminal control program capable of communicating with other terminals,
When a click operation is performed on a screen shared with the terminal in the other terminal, a symbol image of the click operation indicating that the click operation has been performed is received from the other terminal and displayed on the terminal. Execute control,
A control program that causes a terminal to execute processing. The control program according to claim 3, wherein the symbol image is displayed and output also on the other terminal. In a terminal that can communicate with the operated terminal,
A control means for transmitting a symbol image of the click operation to the operated terminal indicating that the click operation is performed when the click operation is performed on the screen shared with the operated terminal;
A terminal comprising: A method for controlling a terminal capable of communicating with an operated terminal,
When a click operation on a screen shared with the operated terminal is performed, a control for transmitting a symbol image of the click operation to the operated terminal indicating that the click operation has been performed is executed.
Terminal control method. A terminal control program capable of communicating with an operated terminal,
When a click operation on a screen shared with the operated terminal is performed, a control for transmitting a symbol image of the click operation to the operated terminal indicating that the click operation has been performed is executed.
A control program that causes a terminal to execute processing. The control program according to claim 7, wherein the symbol image is also displayed and output on the terminal. A terminal control program capable of communicating with other terminals,
In the other terminal, when an operation on a screen shared with the terminal is performed, a control is performed to display different symbol images on the terminal according to the type of the operation.
A control program that causes a terminal to execute processing. A terminal control program capable of communicating with an operated terminal,
When an operation on a screen shared with the operated terminal is performed, a control is performed to transmit a different symbol image corresponding to the operation to the operated terminal.
A control program that causes a terminal to execute processing.

Images