JP2011203888A - System and program for operation management - Google Patents

Abstract

PROBLEM TO BE SOLVED: To provide an operation management program intelligibly teaching a user about an operational procedure to a problem/issue which occurs in a computer terminal.SOLUTION: In an environment in which an indication source terminal is connected to an indication target terminal via a network, the indication target terminal obtains an operation indication from the indication source terminal, and also obtains an operational log of the indication target terminal. Then, using the operational log of the indication target terminal and the obtained operation indication, the indication target terminal generates an image indicative of operation transition so as to display it on the display device of the operated terminal. By the operation of the indication target terminal according to the operation indication, the image indicative of the operation transition is modified.

Description

  The present invention relates to a technique for managing user operations in a computer terminal. In particular, the present invention relates to a technique for displaying and managing remote computer terminal operation instructions on a terminal screen.

  Businesses and the like use a computer terminal (hereinafter referred to as “terminal”) to carry out business. As a result, there is now one terminal per person, which is indispensable for carrying out daily work. However, not only users who are familiar with terminal operations but also many users who are unfamiliar with the company. In this way, users who are unfamiliar with the operation of the terminal do not know how to deal with the operation of the terminal that is not a routine job or the terminal malfunction, so rely on the support of professional staff inside and outside the company Yes.

  As described above, in a support request for a problem that has occurred from a user unfamiliar with the operation of the terminal, a specialized staff operates the terminal each time to solve it. However, when a problem occurs, it is rare that a specialized staff is always nearby, and the specialized staff visits the location of the terminal to deal with it. Inefficient measures such as giving operation instructions are being taken. Furthermore, there are cases where support requests are repeatedly made from the same user for the same problem. When a problem occurs, professional staff dealing with the problem leads to deterioration in business efficiency. For this reason, it is required to improve the work efficiency by encouraging a user who is unfamiliar with the terminal to learn how to deal with the problem.

  For example, the system of Patent Document 1 discloses a technique for performing remote operation by connecting an operator terminal to a remote user terminal. By using this system, it is possible to operate the terminal instead of a user who is unfamiliar with the terminal operation from a remote place where specialized staff is present. The staff who perform the above-mentioned support can provide support and the like without going to the location of the terminal where the problem occurs, which is efficient.

  In the system of Patent Document 2, a technique for displaying the next operation to be performed on the operation screen is disclosed. By using this system, it is possible to use the history of operations performed by the user in the past, and estimate and display operations that will be performed in the near future (target operations) from the operations that the user is performing. Can do.

JP-A-2005-026856 JP-A-7-146742

  However, the system disclosed in Patent Document 1 can solve a problem caused by a remote operation of a professional staff, but since the user does not perform the operation himself, the user can be made familiar with the problem coping method. Can not.

  Therefore, the system of Patent Document 2 that displays the next operation to be performed from the user's operation is used. However, the operation environment using the terminal is various at each time, and an operation procedure suitable for every operation environment is prepared. In addition, since it is impossible to change the visual display according to changes in the operating environment, it is difficult to present an effective coping method.

  An object of the present invention is to solve the above-mentioned problems of the prior art. In other words, an operation procedure for a problem / issue that occurred in a terminal (instructed terminal) is displayed in association with the operation status of the terminal by an instruction from a remote terminal (instruction terminal), and the user of the instructed terminal The challenge is to provide technology that encourages students to learn how to deal with them.

  The present invention is an operation procedure display system in which an instruction terminal and an instructed terminal are connected via a network, and an operation instruction for acquiring, as operation instruction information, the content and order of operations on the instructed terminal from the instruction terminal An information acquisition unit, an operation log information acquisition unit that acquires operation log information indicating an operation of the indicated terminal, the operation instruction information and the operation log information are compared, and the operation log is used by using the operation order. An operation procedure image information generation unit that determines operation instruction information for instructing an operation following the information and generates operation procedure image information based on a result of the determination, and the operation procedure image information is displayed on the operation screen of the instructed terminal. An operation procedure display system comprising: a display control unit that performs control of combining and displaying.

  By configuring as in the present invention, the operation procedure image is displayed on the operation screen of the operated terminal based on the operation instruction and the operation of the operated terminal. You can easily understand the operations to be performed. Therefore, it is possible to prompt the user to master a method for dealing with the problem that has occurred.

  The operation instruction information in the present invention is information including an order and contents for performing an operation instruction.

  The operation procedure image information in the present invention is image image information indicating a transition of operation.

  The present invention is an operation procedure display system in which an instruction terminal and an instructed terminal are connected via a network, wherein the instructed terminal generates operation image information related to an operation image displayed by the instructed terminal, and An operation image information transmission unit that transmits to the instruction terminal, an operation instruction information acquisition unit that acquires, as operation instruction information, the content and order of operations performed on the instruction target terminal created by the instruction terminal, and an operation of the instruction terminal An operation log information acquisition unit that acquires the operation log information indicated, and compares the operation instruction information with the operation log information, and determines operation instruction information that instructs an operation subsequent to the operation log information using the operation order. An operation procedure image information generating unit that generates operation procedure image information based on the result of the determination, and combining the operation procedure image information with the operation screen to be displayed. A display control unit that performs control to be displayed in a synthesized manner on an operation screen of the instructed terminal, wherein the instructing terminal acquires operation image information from the instructed terminal, and the acquisition The commanded terminal operation image display unit to be displayed in a predetermined area according to the operated image information, the user input to the predetermined area is read, and the read input information and the commanded terminal operation image information An operation procedure display system comprising: an operation instruction input unit that generates instruction information for the instructed terminal; and an operation instruction information transmission unit that transmits the generated instruction information to the instructed terminal.

  By configuring as in the present invention, the instruction terminal generates operation instruction information using the operation screen of the instruction terminal, and the instruction terminal operates based on the operation instruction information and the operation of the operation terminal. By displaying the procedure image on the operation screen of the operated terminal, it is possible to display more according to the operation status of the specified terminal. As a result, it is possible to provide information that is easy for the user to understand, so that the user can be further encouraged to learn how to deal with the problem that has occurred.

  It is also possible to realize the above-described present invention by reading the program of the present invention into a terminal and executing it. In other words, a program used for an operation procedure display system in which an instruction terminal and an instructed terminal are connected via a network, and an operation for obtaining the operation contents and order for the instructed terminal from the instruction terminal as operation instruction information An operation procedure for generating operation procedure image information based on an instruction information acquisition function, an operation log information acquisition function for acquiring operation log information indicating an operation of the indicated terminal, and the operation instruction information and the operation log information An operation procedure display program for causing a computer to realize an image information generation function and a display control function for performing control for combining and displaying the operation procedure image information on the operation screen of the instructed terminal may be used.

  This operation procedure display program also has the same effect as the above-described operation procedure display system, and can be provided with the various feature configurations described above.

It is also possible to realize the above-described present invention by reading the program of the present invention into a terminal and executing it. That is, it is a program used for an operation procedure display system in which an instruction terminal and an instructed terminal are connected via a network, and generates operation image information relating to an operation image displayed by the instructed terminal and transmits the operation image information to the instruction terminal. Operation image information transmission function,
An operation instruction information acquisition function for acquiring, as operation instruction information, the content and order of operations for the indicated terminal created by the instruction terminal, and an operation log information acquisition function for acquiring operation log information indicating the operation of the indicated terminal The operation instruction information is compared with the operation log information, the operation instruction information for instructing the operation following the operation log information is determined using the operation order, and the operation procedure image is based on the determination result. An operation procedure image information generation function for generating information; and a display control function for performing control for combining the operation procedure image information with the operation screen to be displayed and combining the operation procedure image information with the operation screen of the instructed terminal. An instruction terminal operation image acquisition function for acquiring operation image information from the instruction terminal, and an instruction terminal to be displayed in a predetermined area according to the acquired operation image information An operation instruction input for reading the user's input for the image creation function and the predetermined area, and generating instruction information for the instructed terminal based on the read input information and the operation image information of the instructed terminal It is good also as an operation procedure display program which makes a computer implement | achieve a function and the operation instruction transmission function which transmits the produced | generated instruction information to the said commanded terminal.

  This operation procedure display program also has the same effect as the above-described operation procedure display system, and can be provided with the various feature configurations described above.

  According to the present invention configured as described above, since the instruction of the next operation corresponding to the operation status of the instructed terminal is displayed using the instruction information acquired from the instructing terminal, the user himself / herself is instructed by the instructed terminal. It is possible to perform the operation. As a result, the user of the instructed terminal can easily understand the operation to cope with the problem, so that the user of the operated terminal can be encouraged to learn how to deal with the problem. it can.

The figure which shows typically the concept of the system configuration | structure of this invention. The figure which shows typically the concept of the hardware constitutions of this invention. The figure which shows typically the functional block of the system of this invention. The flowchart which shows typically the processing process of the instruction | indication terminal A of this invention. The flowchart which shows typically the process of the commanded terminal B of this invention. The figure which shows operation instruction information typically. The figure which shows operation instruction information typically. The figure which shows display information typically. The figure which shows an operation procedure image typically. The figure which shows typically the relationship between an operation instruction tool icon and operation instruction content. The figure which shows typically the relationship between operation instruction content and operation instruction completion conditions. The figure which shows an example of operation log information typically. The figure which shows a series of operation log information typically. The figure which shows the operation screen of an instruction | indication terminal typically. The figure which shows typically the commanded terminal operation screen window displayed on the operation screen of the instruction terminal. The figure which shows typically the commanded terminal operation screen window displayed on the operation screen of the instruction terminal. The figure which shows typically the operation screen of the to-be-designated terminal B which synthesize | combined the operation procedure image. The figure which shows typically the operation screen of the commanded terminal B which synthesize | combined a series of operation procedure images. The figure which shows typically the content of the highlighting by elapsed time. The figure which shows typically the content of the highlight display by the relationship between an operation position and an operation instruction | indication position.

Example 1 Configuration
Hereinafter, embodiments of the present invention will be described with reference to the drawings. FIG. 1 is an overall configuration diagram of an operation procedure display system according to the present invention. As shown in FIG. 1, the present invention is configured in such a manner that an instruction terminal A is connected to an instructed terminal B via a communication network N (hereinafter referred to as “network N”).

  Network N is a CSMA / CD (Carrier Sense Multiple Access with Collision Detection) system with a cable that physically transmits information in a limited facility such as a company or school, and a relay device such as a LAN switch or hub. The network N is configured as an Ethernet (registered trademark) type LAN. In addition to the Ethernet (registered trademark) type LAN, the network N is constructed by an intranet using Internet technology, or a WAN (Wide Area). Network) technology may also be used.

  FIG. 2 schematically shows an example of the hardware configuration of the instruction terminal A. The instruction terminal A includes an arithmetic device 1 such as a CPU that executes arithmetic processing of a program, a storage device 2 such as a RAM and a hard disk for storing information, processing results of the arithmetic device 1 and information stored in the storage device 2 on the Internet. Communication device 5 that transmits and receives via a network such as a LAN, a display device 3 such as a display (operation screen), and an input device 4 such as a keyboard, a pointing device (mouse, pen tablet, etc.) and a numeric keypad. is doing. Each function (each unit) realized on the terminal is executed when a unit (program, module, or the like) that executes the process is read into the arithmetic unit 1. When using the information stored in the storage device 2 in the processing, each function reads the corresponding information from the storage device 2 and uses the read information in the processing in the arithmetic device 1 as appropriate. Further, the instruction terminal A may have its functions distributed to a plurality of terminals.

  The hardware configuration of the instructed terminal B is almost the same as that of the instructing terminal A, and as shown in FIG. 2, the arithmetic terminal 1, the storage device 2, the display device 3, the input device 4, and the communication device 5 are provided. is doing.

  FIG. 3 shows a functional block diagram of the instructing terminal A and the instructed terminal B that constitute the file management system of the present invention. Each component and each means in the present invention are logically distinguished from each other in function, and may be physically or practically the same area.

  Within the instruction terminal A, a network I / F 10 for transmitting and receiving various information to and from the instructed terminal B via the network N, and an instructed terminal operation image information acquisition unit that acquires operation image information of the instructed terminal B 11. An instruction terminal image display unit 12 that displays the acquired operation image information of the instruction target terminal B; an operation that accepts an input of an operation instruction from a user who uses the instruction terminal A (hereinafter referred to as “instruction user”) An operation instruction input unit 13 that generates instruction information, an operation instruction information transmission unit 14 that transmits operation instruction information to the instructed terminal B, and a terminal control unit 15 that performs various controls of the OS and applications in the instruction terminal A are provided.

  Inside the instructed terminal B, there are a network I / F 20 for transmitting and receiving various information to and from the instruction terminal A via the network N, and an operation instruction information acquisition unit for acquiring operation instruction information sent from the instruction terminal A. 21, an operation instruction information storage unit 22 that stores the acquired operation instruction information, an operation log information acquisition unit 23 that acquires operation log information indicating an operation at the instructed terminal B, and an operation log information storage that stores the acquired operation log information Unit 24, an operation procedure image information generation unit 25 that generates operation procedure image information from the operation instruction information and operation log information, and the generated operation procedure image information and the displayed operation image are combined and displayed on the display device. Display control unit 26 that performs control, operation image acquisition unit 27 that acquires an operation image displayed on the display device, and operation that transmits operation image information to the instruction terminal A And it includes an image information transmitting unit 28.

  Usually, each component in the instruction terminal A and the instruction target terminal B is executed by reading means (program, module, etc.) for executing the process into the hardware. You may comprise by the combination with hardware, and you may comprise only with the hardware which combined the logic etc.

  The operation of each component will be described below based on the functional block diagram constituting the present invention shown in FIG.

  First, the operation of each component included in the instruction terminal A will be described.

  The terminal control unit 15 controls various hardware and software in the instruction terminal A. In the present embodiment, terminal control refers to all operations and controls executed by applications, OS, middleware, firmware, and the like.

  The instructed terminal operation image information acquisition unit 11 acquires operation image information regarding the operation image displayed on the display device 3 of the instructed terminal B from the instructed terminal B via the network I / F 10. The acquired operation image information is notified to the commanded terminal image display unit 12.

  The operation image information includes an operation image displayed or displayed on the instructed terminal B, date information, display object information, and the like. It is also preferable to include information such as the size and shape of the operation image. The operation image is image data, and it is preferable to use a standard format of a still image or a moving image such as JPEG, PNG, BMP, or MPEG, but an original format may be used.

  The date information described above is the date and time when the operation image is displayed on the display device 3 of the instructed terminal B. Further, the date may be a numerical value.

  The display object information is information related to the display object included in the operation screen displayed on the instructed terminal B. The display object is, for example, an icon, a button, a window, or the like. The display object information includes display object identification information, display object coordinate information, related application identification information, and the like. The display object identification information uniquely identifies the display object, and includes a name, an ID, and the like. The display object coordinate information is coordinates of a region including the display object or coordinates indicating one point in the display object. In the present embodiment, the coordinate of the area including the display object (rectangular coordinates) is used.

  When the commanded terminal operation image display unit 12 acquires the operation image information from the commanded terminal operation image information acquisition unit 11, the terminal control unit instructs the display device 3 of the command terminal A to display the operation image of the commanded terminal B. 15 is performed. The operation image of the commanded terminal B is displayed in a predetermined area on the display device 3 of the command terminal A. In this embodiment, the instruction terminal A is displayed in a display area in a window (instructed terminal screen display window) on the display device 3 of the instruction terminal A.

  The operation of the commanded terminal operation image display unit 12 will be described in detail. The commanded terminal operation image display unit 12 performs image conversion so that the operation image of the commanded terminal B is displayed in the display area in the commanded terminal screen display window. That is, the size of the operation image of the commanded terminal B is converted into the size of the display area in the commanded terminal screen display window, and the converted image data is notified to the terminal control unit 15. Thereafter, the terminal control unit 15 displays an operation image on the display device 3 of the instruction terminal A. FIG. 14 schematically shows an example of display on the display device 3 of the instruction terminal A.

  The operation instruction input unit 13 acquires an operation instruction for the instructed terminal B performed by the instructing user from the input device 4 (for example, a keyboard or a pointing device), and generates operation instruction information. Thereafter, the generated operation instruction information is notified to the operation instruction information transmission unit 14.

  The operation instruction information is information including an order and contents for performing an operation instruction. The operation instruction information includes an operation order, operation instruction contents, instruction target information, accompanying information, instruction position information, operation instruction completion conditions, and the like. An example of the operation instruction information is schematically shown in FIGS.

  The above-mentioned operation order is an order indicating operation instructions, and may be a numerical value continuous in time series, or a time when an operation instruction is input or a time when an operation instruction is input It is possible to change to a numerical value.

  The above-mentioned operation instruction content is the content of an operation instructed to the instructed terminal B. Specifically, "keyboard character input", "mouse, right button 1 click", "button / icon selection activation", and the like are included. Any other information may be used as long as it indicates the content of the operation.

  The instruction target information is identification information indicating a target on which the instructed operation is performed. Specifically, application identification information, display object identification information, and the like are included.

  The accompanying information refers to additional information included according to the operation instruction content. Specifically, it is the content of the comment text. The accompanying information may be any information as long as it is necessary information according to the operation instruction content.

  The indicated position information indicates the position (one point or area) of the indicated terminal B on the screen.

  The operation instruction completion condition refers to a condition for determining whether or not the operation instruction information generated at the instruction terminal has been executed at the instructed terminal.

  The operation of the operation instruction input unit 13 will be described in detail with reference to FIG. First, the instructing user who operates the instruction terminal A selects (clicks) an operation instruction tool icon indicating an operation instruction with a pointing device or the like in the instructed terminal screen display window, and performs an operation (drag / drop) at an arbitrary position. ) To input operation instructions. By this operation, the operation instruction input unit 13 reads the information of the operation instruction tool icon (the contents of the operation instruction) and the position information (the position of the operation instruction) in the instructed terminal screen display window. An example of the relationship between the operation instruction tool icon and the operation instruction content is schematically shown in FIG.

  Next, the operation instruction input unit 13 sets the operation instruction content of the operation instruction information and the operation instruction completion condition. Specifically, the operation instruction content for the operation instruction tool icon is set as the operation instruction content of the operation instruction information. Then, the operation instruction completion condition corresponding to the operation instruction content is set as the operation instruction completion condition of the operation instruction information. An example of the relationship between the operation instruction content and the operation instruction completion condition is shown in FIG.

  Subsequently, the position information (operation instruction position) in the instructed terminal display screen window is converted into position information (instructed terminal position information) on the operation screen of the instructed terminal B. Then, the instructed terminal position information is set in the instructed position information of the operation instruction information. Furthermore, the display object information corresponding to the instructed terminal position information is acquired from the instructed terminal operation image display unit 12, and the instruction target information of the operation instruction information is set based on the acquired display object information.

  The determination method of the display object information corresponding to the above-described instructed terminal position information is preferably determined based on whether or not the instructed terminal position information is included in the display object coordinate information (region). Further, the display object information closest to the instructed terminal position information may be used.

  Then, the instruction order is added to the operation instruction information. The instruction order may be any value as long as it indicates the order of operation instructions. Further, this instruction order may be added in time series when the instructed terminal B receives operation instruction information, which will be described later.

  The operation instruction information transmission unit 14 acquires operation instruction information from the operation instruction information input unit 13 and transmits the operation instruction information to the instructed terminal B via the network I / F 10. In the present embodiment, every time operation instruction information is generated, it is transmitted to the instructed terminal B. However, it may be transmitted at a predetermined timing or at a constant cycle. Also, a plurality of operation instruction information may be transmitted together.

  Next, the operation of each component included in the instructed terminal B will be described.

  The operation instruction information acquisition unit 21 acquires operation instruction information sent from the instruction terminal A via the network I / F 20. The acquired operation instruction information is stored in the operation instruction information storage unit 22.

  The operation log information acquisition unit 23 generates operation log information indicating an operation performed on the instructed terminal B. The operation log information is generated based on the operation / control performed by the terminal control unit 29. The generated operation log information is notified to the operation procedure image information generation unit 25 and stored in the operation log information storage unit 24. The operation log information is usually generated every time an operation is executed. However, as long as the object of the present invention is achieved, it may be generated at a predetermined timing or at a constant cycle.

  The operation log information in the present embodiment is, for example, information indicating contents operated by a user (instructed user) operating the instructed terminal B or information indicating contents executed in the instructed terminal B, and includes terminal identification. It includes information, operation date / time, operation content, operation target information, additional information, operation position information, and the like. The information included in the operation log information is an example and is not limited, and only a part of the information may be used as long as the object of the present invention is achieved. Examples of operation log information are schematically shown in FIGS.

  The operation date and time includes the date and time when the operation was performed. A value obtained by digitizing the date and time may be used.

  The above-described operation content is content that is operated and executed in the instructed terminal B, and refers to control of applications, hardware, and the like that are processed in middleware or an OS. More specifically, keyboard character input, pointing device operations (button press, move, etc.), connection with external devices (printers, etc.), file operations (create, delete, copy, move, rename file, read file, File write, etc.), folder operations (create, delete, copy, move, folder name change, etc.), application operations (start, end, etc.), drive addition / deletion / detection, network connection / disconnection, IP address change, computer There is information indicating name change, storage medium writing, printing, copying to the clipboard, and the like. In addition, these are examples and are not limited.

  The operation target information refers to a processing target that is executed according to the operation content. In this embodiment, it is the operated application identification information, display object identification information, and the like. Application identification information here refers to information that can uniquely identify an application, and includes an application name, an identification number, a management number in the OS, and the like. In addition, these are examples and are not limited.

  The above-described operation position information refers to a position on the screen that is input from the input device 3 such as a pointing device or a keyboard. For example, in the case of a pointing device, it is the position where the button of the pointing device is pressed, and in the case of a keyboard, it is the position on the operation screen where information is reflected by keyboard input. Further, it may be a region (rectangular coordinates) such as a window corresponding to the operation target information or a selection range on the screen.

  The operation procedure image information generation unit 25 generates operation procedure image information of an operation procedure following the operation log information based on the acquired operation log information and stored operation instruction information. Then, the generated operation procedure image information is notified to the display control unit 26.

  The operation procedure image information mentioned above refers to image information indicating an operation following the acquired operation log information. The operation procedure image information includes display coordinate information, display target information, display accompanying information, and the like.

  The display coordinate information mentioned above refers to a position on the operation screen of the instructed terminal B, and is indicated by one point or a region (rectangular coordinates or the like).

  Said display object information means the information which points the image displayed as an operation procedure. Specifically, it is identification information for specifying an operation instruction tool icon, file identification information for an image indicating an icon, etc., and any information may be used as long as it specifies contents displayed as an operation procedure. .

  The display accompanying information refers to accompanying information used as necessary when displaying the transfer operation image. For example, there are sentences such as comments.

  The operation of the operation procedure image information generation unit 25 will be described in detail. The operation procedure image information generation unit 25 is an operation comparison unit that compares operation instruction information and operation log information, and an image generation unit that acquires operation instruction information and operation log information from the comparison result and generates image information of the operation procedure. .

  The operation comparison unit extracts operation instruction information (preceding operation instruction information) to be operated from the operation instruction information storage unit 22. Subsequently, the operation instruction completion condition of the preceding operation instruction information is compared with the operation content and operation target information of the acquired operation log information to determine whether the operation corresponds to the operation instruction information. Then, the image generation means is notified of the determination result and the instruction order of the operation instruction information. When the instruction order of the operation instruction information matches the operation instruction completion condition of the operation instruction information (when an operation corresponding to the operation instruction information is executed), the next operation instruction information following the previous operation instruction information ( The instruction order of the subsequent operation instruction information) is applied. If the operation instruction completion condition is not met, the instruction order of the preceding operation instruction information is applied.

  The image generation unit 25 extracts operation instruction information corresponding to the instruction order of the operation instruction information acquired from the operation comparison unit. Based on the current operation position (the operation position information included in the operation log information) and the instruction position information included in the operation instruction information, the image information such as the operation instruction tool icon and the comment is associated with the position on the screen, respectively. Generate image information associated with the information. As image information in which each piece of positional information is associated, it is preferable to use an arrow or line image as a display target. Further, an image surrounding each position may be displayed. The generated image information is notified to the display control unit 26 as operation procedure image information. An example of the operation procedure image information is schematically shown in FIG.

  The display control unit 26 issues a control instruction so that the operation procedure image information acquired from the operation procedure image information generation unit 25 is combined with the displayed operation image and displayed. The terminal control unit 29 displays on the display device 3 according to the control instruction.

  The operation image acquisition unit 27 acquires an operation image and display object information displayed on the display device 3 of the instructed terminal B, and generates operation image information. Then, the operation image information is notified to the operation image information transmission unit 28.

  The operation image information transmission unit 28 transmits to the instruction terminal A via the network I / F 20. The transmission timing is preferably set at a predetermined timing or periodically. Further, a process for reducing the amount of data for transmitting the operation image, such as not performing transmission when there is no change in the image, may be included.

  By adopting the above-described embodiment, the instructed user who uses the instructed terminal B can easily understand what operation should be performed next on the operation situation, and the operation It is possible to promote the proficiency of operation corresponding to the situation.

Example 1 Treatment Process
Next, an example of the processing process of the file management system of the present invention will be described with reference to the functional block diagram of FIG. 3, the flowcharts of FIG. 4 and FIG. In the following description, the instruction terminal “DEF67890” and the instructed terminal “ABC12345” are connected via the network N, and a part of the application “word processor A” is operated in the instructed terminal “ABC12345”. An example will be explained.

  First, the processing process of the instruction terminal “DEF67890” will be described.

  The instruction terminal “DEF67890” acquires the operation image information sent from the instruction terminal “ABC12345”, and converts the size into a predetermined area of the display device of the instruction terminal A (display area in the instruction terminal screen display window). Display (S101, S102). For example, the display is performed as shown in FIG. 14 on the display device 3 of the instruction terminal “DEF67890”. The acquisition and display of the operation image information is continuously executed every time it is sent from the instructed terminal B.

  The operation image size conversion will be specifically described. For example, the screen size of the instructed terminal “ABC12345” is (horizontal width) 1280 / (vertical width) 960 pixels, and the display area in the instructed terminal screen display window is (horizontal width) 640 / (vertical width) 480. Let it be a pixel. In such a case, the acquired operation image is reduced and displayed on the instructed terminal screen display window. That is, in this case, the vertical width and the horizontal width are converted to ½.

  When the instructing user operating the instruction terminal “DEF67890” inputs an operation instruction for the instructed terminal “ABC12345”, the operation instruction input unit 13 reads the input as an operation instruction (S103).

  The input and reading of operation instructions will be described in detail (see FIGS. 15 and 16). A user (instructing user) who operates the instruction terminal “DEF67890” selects (clicks) the operation instruction tool icon at the top of the instructed terminal screen display window with a pointing device, and arbitrarily selects a display area in the instructed terminal screen display window. Perform the operation (drag and drop) to place it at the position (specified position). The operation instruction input unit 13 detects the arranged operation, and reads information on the type and designated position of the operation instruction tool icon. For example, the instructing user selects a keyboard icon. Then, an operation is performed to place the icon at the coordinate position (400, 300) in the designated terminal screen of the designated terminal screen display window. At this arranged operation timing, the operation instruction input unit 13 reads the operation instruction content “keyboard character input icon” and position information (400, 300) indicating the coordinate position.

  Further, the instructing user may input incidental information, and the input information may be read. For example, a screen for making an inquiry to the instructing user, such as a screen for inputting a comment, can be displayed, and an arbitrary comment input by the instructing user can be read. Although not shown, it is assumed here that the comment “input necessary items” input by the instructing user has been read.

  The operation instruction input unit 13 further generates operation instruction information based on the read information (operation instruction content, position information, and accompanying information) (S104). Specifically, since the content of the operation instruction is “keyboard character input icon”, “keyboard character input icon” is set as the operation instruction content of the operation instruction information, and “operation instruction information Input "is set. It is assumed that the relationship between the operation instruction content and the operation instruction completion condition is as shown in FIG. The operation instruction content and the operation instruction completion condition are preferably stored in an operation instruction completion condition storage unit (not shown) and read out as necessary.

  Next, since the read position information (400, 300) is position information in the display area in the instructed terminal screen display window of the instructing terminal A, it is converted into the actual instructed terminal screen position information. The converted position information becomes position information (800, 600) on the instructed terminal screen. Subsequently, display object information corresponding to the position information (800, 600) is acquired from the instructed terminal operation image information acquisition unit 11. That is, when the display object information in the operation image information acquired from the instructed terminal “ABC12345” is FIG. 8, when a display object including the position information (800, 600) in the coordinate position (in the rectangular coordinates) is searched. The display object identification information “text input area (TB445565)” and the related application “word processor A” are acquired. Therefore, the related application “word processor A” and the display object identification information “text region (TB445556)” are set as the instruction target information of the operation instruction information, and the position information (800, 600) is set as the instruction position information.

  Then, along with these processes, the instruction order of the operation instruction information is set. Here, the instruction order “1” is set as the first operation instruction.

  Subsequently, the generated operation instruction information is transmitted to the instructed terminal “ABC12345” via the network I / F 10 (S105).

  Next, the process of the instructed terminal “ABC12345” will be described.

  The operation log information acquisition unit 23 acquires operation log information of the instructed terminal “ABC12345”, and notifies the operation procedure image information generation unit 25 of the operation log information (S201). Further, the operation log information acquisition unit 23 stores the acquired operation log information in the operation log information storage unit 24.

  Further, the operation instruction information acquisition unit 21 acquires the operation instruction information transmitted from the instruction terminal “DEF67890” via the network I / F 20 and stores it in the operation instruction information storage unit 22 (S202). The operation instruction information is stored in the operation instruction information storage unit 22 as shown in FIG.

  The operation procedure image information generation unit 25 generates operation procedure image information based on the operation instruction information in the operation instruction information storage unit 22 and the acquired operation log information (S203). Then, in accordance with the generated operation procedure image information, the display control unit 26 issues a control instruction to the terminal control unit 29 for an instruction to be combined with the operation screen (S204).

  The above process will be specifically described. When the instructed user of the instructed terminal “ABC12345” starts the application “word processor A”, the operation procedure image information generating unit 25 operates as the operation log information “Operation date and time“ November 5, 2008, 12:10 ”( 13 (1)) is acquired from the operation log information acquisition unit 23. Subsequently, the operation procedure “1” (see FIG. 6) is acquired as operation instruction information from the operation instruction information storage unit 22.

  Next, the operation procedure image information generation unit 25 extracts the operation instruction completion condition “input to the instruction target” of the operation instruction information and compares it with the operation content “activation” of the acquired operation log information. As a result of the comparison, it is determined that the operation instruction completion condition is not satisfied.

  The operation procedure image information generation unit 25 generates operation procedure image information (see FIG. 9) based on the operation instruction information because the operation instruction completion condition is not satisfied as a result of the comparison. Specifically, since the operation order of the operation instruction information is 1, display coordinate information (800, 600) / (810, 610) and display target information “number icon 1” are generated. Next, since the operation instruction content is “keyboard character input”, display coordinate information (810, 610) / (840, 640) and display target information “keyboard character input icon” are generated. Furthermore, since the accompanying information is “comment“ input necessary information ””, display coordinate information (840, 640) / (910, 670) and display accompanying information “comment“ input necessary information ”” are generated. .

  Further, display coordinate information (100, 550) / (800, 600), a display target, is displayed as a display that associates the operation position information (100, 550) of the operation log information with the instruction position information (800, 600) of the operation instruction information. Information “arrow image” and display accompanying information “no emphasis” are generated.

  The generated operation procedure image information is notified to the display control unit 26. Then, the display control unit 26 combines the operation procedure image with the currently operated operation image, and the operation screen is displayed on the display device 3 as shown in FIG.

  In the case of a system using a general graphic user interface (GUI) as a control for displaying operation procedure image information on the display device 3, the display control unit 26 operates a window manager or the like that controls the screen. This is realized by instructing display control based on the procedure image information. In addition, even if the system is not the above-described system, any method may be used as long as the control satisfies the object of the present invention.

  Subsequently, when the instructed terminal “ABC12345” inputs characters into the text input area of the word processor A, the operation procedure image information generation unit 25 newly sets the operation date “November 5, 2008, 12:13 as operation log information”. Minute ”(see FIG. 13B) is acquired from the operation log information acquisition unit 23. As described above, the operation procedure 1 (FIG. 6) is acquired as the operation instruction information from the operation instruction information storage unit 22.

  Then, the operation procedure image information generation unit 25 extracts the operation instruction completion condition “input to the instruction target” of the operation instruction information, the instruction target information “word processor A” and “text input area (TB445556), and acquires the acquired operation log The operation content of the information “keyboard character input”, operation target information “word processor A” and “text input area (TB445556) are compared. As a result of the comparison, it is determined that the operation instruction completion condition is satisfied.

  The operation procedure image information generation unit 25 acquires the next operation instruction information from the operation instruction information storage unit 22 according to the determination result that the operation instruction information has been operated, but the next operation instruction information is stored in the operation instruction information storage. Since it is not stored in the unit 22, information without display is generated as the operation procedure image information.

  As a result, the display control unit 26 causes the display device to display an operation screen in a format that does not synthesize the operation procedure image.

[Other Example 1]
In the above-described embodiment, the operation procedure image generation unit 25 extracts operation instruction information subsequent to the operation instruction information acquired from the operation comparison unit for a predetermined number of instruction orders, and generates operation procedure image information. It can also be done. By doing so, the instructed user can grasp a series of operations, and can easily promote understanding and learning. Specifically, when operation instruction information of three procedures as shown in FIG. 7 is stored, all three procedures are generated as operation procedure image information following the operation log information. The generated operation procedure image information is displayed on the display device 3 of the instructed terminal B as shown in FIG. Then, as the operation proceeds, the screen is displayed as shown in FIGS. 18C and 18D.

[Other Example 2]
In the above-described embodiment, the operation procedure image generation unit 25 associates the position information of the operation log information and the instruction position information of the operation instruction information when the comparison result in the operation comparison unit does not match the operation instruction completion condition. The operation procedure image information may be highlighted. For example, the arrow is thickened, and the arrow color is highlighted (such as red). This makes it easier to understand the next operation.

[Other Example 3]
In the embodiment described above, the operation procedure image generation unit 25 stores the determined time in the storage area (not shown) as the previous match time when the comparison result in the operation comparison unit matches the operation instruction completion condition. Then, the previous match time may be compared with the current time, and the operation procedure image information may be emphasized according to the comparison result (elapsed time). Specifically, when the elapsed time is long, the instructed user may be at a loss, and therefore, highlighting is performed so that the display becomes easier to understand. An example of emphasis by elapsed time is schematically shown in FIG.

[Other Example 4]
In the above-described embodiment, the operation procedure image generation unit 25 may generate the operation procedure image information according to the positional relationship between the operation position information of the operation log information and the instruction position information of the operation instruction information. For example, each distance is calculated, and if it is far away, it is emphasized more. An example of emphasis by positional relationship is schematically shown in FIG.

  The functions and configurations of the operation monitoring system of the present invention may be distributed in a timely manner at the instruction terminal A and the instruction terminal B. Note that there are various patterns of dispersion arrangement, and any arrangement form may be used. As described above, in the processing at the instruction terminal A and the instruction target terminal B, when using the functions of other terminals and servers, an information transmission / reception unit for transmitting / receiving information is appropriately provided to transmit an inquiry and receive an inquiry result. It is better to make it happen by doing.

A: Instructing terminal B: Instructed terminal 1: Arithmetic device 2: Storage device 3: Display device 4: Input device 5: Communication device 10: Network I / F (Indicating terminal A)
11: Instructed terminal operation image information acquisition unit 12: Instructed terminal operation image display unit 13: Operation instruction input unit 14: Operation instruction information transmission unit 15: Terminal control unit (instruction terminal)
20: Network I / F (instructed terminal B)
21: Operation instruction information acquisition unit 22: Operation instruction information storage unit 23: Operation log information acquisition unit 24: Operation log information storage unit 25: Operation procedure image information generation unit 26: Display control unit 27: Operation image acquisition unit 28: Operation Image information transmission unit 29: terminal control unit (instructed terminal)

Claims (4)

An operation procedure display system in which an instruction terminal and an instructed terminal are connected via a network,
An operation instruction information acquisition unit that acquires, as operation instruction information, the content and order of operations performed on the instructed terminal from the instruction terminal;
An operation log information acquisition unit that acquires operation log information indicating an operation of the instructed terminal;
The operation instruction information and the operation log information are compared, operation instruction information that instructs an operation following the operation log information is determined using the operation order, and operation procedure image information is determined based on a result of the determination. An operation procedure image information generation unit to generate;
An operation procedure display system, comprising: a display control unit configured to perform control so that the operation procedure image information is synthesized and displayed on an operation screen of the instructed terminal. An operation procedure display system in which an instruction terminal and an instructed terminal are connected via a network,
The instructed terminal is
An operation image information transmission unit that generates operation image information related to the operation image displayed by the instructed terminal and transmits the operation image information to the instruction terminal;
An operation instruction information acquisition unit that acquires, as operation instruction information, the content and order of operations for the indicated terminal created by the instruction terminal;
An operation log information acquisition unit that acquires operation log information indicating an operation of the instructed terminal;
The operation instruction information and the operation log information are compared, operation instruction information that instructs an operation following the operation log information is determined using the operation order, and operation procedure image information is determined based on a result of the determination. An operation procedure image information generation unit to generate;
A display control unit configured to synthesize the operation procedure image information with the operation screen to be displayed and perform control to synthesize and display the operation procedure image information on the operation screen of the instructed terminal;
The instruction terminal is
An instructed terminal operation image information acquisition unit for acquiring operation image information from the instructed terminal;
An instructed terminal operation image display unit to display in a predetermined area according to the acquired operation image information;
An operation instruction input unit that reads the user's input for the predetermined area and generates instruction information for the instructed terminal based on the read input information and the operation image information of the instructed terminal;
An operation procedure display system comprising: an operation instruction information transmitting unit that transmits the generated instruction information to the instructed terminal. A program used for an operation procedure display system in which an instruction terminal and an instructed terminal are connected via a network,
An operation instruction information acquisition function for acquiring, as operation instruction information, the content and order of operations performed on the instructed terminal from the instruction terminal;
An operation log information acquisition function for acquiring operation log information indicating an operation of the instructed terminal;
An operation procedure image information generation function for generating operation procedure image information based on the operation instruction information and the operation log information;
An operation procedure display program for causing a computer to realize a display control function for performing control to synthesize and display the operation procedure image information on the operation screen of the instructed terminal. A program used for an operation procedure display system in which an instruction terminal and an instructed terminal are connected via a network,
An operation image information transmission function for generating operation image information related to the operation image displayed by the instructed terminal and transmitting the operation image information to the instruction terminal;
An operation instruction information acquisition function for acquiring, as operation instruction information, the contents and order of operations for the indicated terminal created by the instruction terminal;
An operation log information acquisition function for acquiring operation log information indicating an operation of the instructed terminal;
The operation instruction information and the operation log information are compared, operation instruction information that instructs an operation following the operation log information is determined using the operation order, and operation procedure image information is determined based on a result of the determination. Operation procedure image information generation function to generate,
A display control function for performing control to synthesize the operation procedure image information on the operation screen to be displayed and to synthesize and display the operation procedure image information on the operation screen of the instructed terminal;
An instruction terminal operation image acquisition function for acquiring operation image information from the instruction terminal;
Instructed terminal operation image display function for displaying in a predetermined area according to the acquired operation image information;
An operation instruction input function for reading the user's input for the predetermined area and generating instruction information for the instructed terminal based on the read input information and the operation image information of the instructed terminal;
An operation procedure display program for causing a computer to realize an operation instruction transmission function for transmitting the generated instruction information to the instructed terminal.

Images