JP4944559B2 - History information display apparatus and method - Google Patents

Description

  The present invention relates to a history information display device and method capable of storing history information such as operations performed on the device.

  Devices such as POS (Point Of Sale) terminals, ATM (automated teller machines), or vending machines are operated by operators such as employees or users. An operator may perform an incorrect operation or an illegal operation, and a failure may occur in the apparatus due to the operation. In order to investigate the cause of the failure that has occurred, the operator may be asked to confirm the operating procedure, but if the time has passed or particularly many operations are involved, the operating procedure that was performed must be It is extremely difficult to grasp. Therefore, it is necessary to examine all possible operation procedures, and it takes a lot of time to investigate the cause.

  In order to investigate the cause in a short time, there is a device that makes it possible to accurately grasp the operation performed on the device by storing and displaying a history of operations and the like. For example, as a first conventional technique, there is a user operation log visualization device that can specify a position of a video clicked by the user from a user click operation log for the video. The user operation log visualization device reproduces a video that the user has performed a click operation, and the click position indicated by the log data in the video of the reproduction time indicated by the log data of the click operation performed by the user on the video. A mark indicating that is superimposed and displayed (for example, see Patent Document 1).

  As a second conventional technique, there is a failure analysis support device that can reproduce an operation performed by a user in order to investigate the cause of a failure. This failure analysis support device records a user's operation history and a history such as display on the operation panel, and automatically checks the operation input from the user on the operation panel when investigating the cause of the failure that occurred. (For example, see Patent Document 2).

  As a third conventional technique, there is a plant control monitoring device that executes a plant operation control operation by a touch operation on a screen of a display device. This plant control monitoring device stores the type of screen on which a touch operation is performed, the touch coordinates of the screen, the time, and the content of the operation, so that the performed operation can be reproduced on the screen (for example, a patent) Reference 3).

  As a fourth conventional technique, there is a recording / reproducing apparatus. This recording / reproducing apparatus reproduces the operation up to the occurrence of an error including the operation timing by storing the operated content in the memory including the operation continuation time (for example, Patent Document 4). reference).

  As a fifth conventional technique, there is a failure analysis support apparatus that can analyze a failure of a computer system, particularly an application. This failure analysis support apparatus records the operation procedure of an application as a log file in the customer side system, and reproduces the operation procedure in the development side system based on the recorded log file. Information recorded in the log file includes screen data, user operation, processing history, and processing time (see, for example, Patent Document 5).

JP 2004-110096 A JP 2002-157147 A JP-A-8-202440 Japanese Patent Laid-Open No. 9-134214 Japanese Patent Laid-Open No. 2000-10829

  However, in the first to third and fifth conventional techniques, an operation for reproducing an operation procedure using history information is performed to reproduce an image on the screen when the operation is performed. If all the video or image data necessary for the recording is not stored, there is a problem that it cannot be reproduced. The fourth conventional technique does not use a display device that displays an image necessary for operation, and Patent Document 4 does not describe handling of video or image data.

  SUMMARY OF THE INVENTION An object of the present invention is to provide a history information display device and method that can reproduce an operation procedure based on history information without storing all image data necessary for operation. is there.

The present invention includes a plurality of operation units for inputting predetermined information;
History information generating means for generating history information representing the operation unit operated among the plurality of operation units in time series, each time the operation unit is operated;
First display means for displaying at least image information relating to the application ;
Obtaining means for obtaining image information displayed on the first display means;
Storage means for storing history information generated by the history information generation means and image information acquired by the acquisition means;
Second display means for displaying image information and history information;
Control means,
The control means
Each time history information is generated by the history information generation means, the generated history information is stored in the storage means, and when history information is generated by the history information generation means ,
When processing is started by interruption by the operation unit or the first display unit, or interruption by an application, the image information displayed on the first display unit is acquired by the acquisition unit, and the acquired image information is , The image information is stored in the storage means in association with the history information generated when the image information is acquired,
When processing by an interrupt by the operation unit or the first display unit or an interrupt by an application has already been started , the image information displayed on the first display unit is displayed by the operation corresponding to the history information. Only when the information is changed, the image information displayed on the first display means is acquired by the acquisition means, and the acquired image information is associated with the history information generated when the image information is acquired. Memorize it in the memory means,
When display instruction information for instructing display of history information is input by the operation unit, the history information stored in the storage means is displayed in time series on the second display means, and an image associated with the history information is displayed. When there is information, the history information display device is characterized in that the history information is displayed on the second display means together with the image information associated with the history information.

According to the present invention, predetermined information is input by the plurality of operation units, and history information that represents the operation units operated among the plurality of operation units by the history information generation unit in time series is displayed on the operation unit. Generated by the first display means, the image information displayed on the first display means is acquired by the acquisition means, and the history information generation means is acquired by the storage means. The history information generated by the above and the image information acquired by the acquisition unit are stored, and the image information and the history information are displayed by the second display unit. Further, each time history information is generated by the history information generation means by the control means, the history information generated by the history information generation means is stored in the storage means, and when history information is generated by the history information generation means , When processing is started by interruption by the operation unit or the first display unit, or interruption by an application, the image information displayed on the first display unit is acquired by the acquisition unit, and the acquired image information is The image information is stored in the storage means in association with the history information generated when the image information is acquired, and when processing by the interrupt by the operation unit or the first display means or the interrupt by the application has already been started, Image information displayed on the first display means by the operation corresponding to the history information Only when it is changed, the image information displayed on the first display means is acquired by the acquisition means, image information acquired by the acquiring means, history information generated when the image information is acquired When the display instruction information for instructing the display of history information is input by the operation unit, the history information stored in the storage means is displayed on the second display means in time series. If there is image information associated with the history information, the history information is displayed on the second display unit together with the image information associated with the history information. In other words, the image information that was displayed when the operation was performed is acquired, captured, stored together with the history information, and the stored image information is displayed along with the history information during failure analysis, so it is necessary to perform the operation Even if not all image information, that is, image data is stored, the operation procedure can be reproduced based on the history information stored together with the image information.

The present invention also provides communication means for transmitting and receiving information to and from other devices connected via a communication line;
Processing means for executing a predetermined process,
The history information generating unit generates the history information including transmission / reception history information that represents information transmitted / received by the communication unit in time series and processing history information that represents information related to processing executed by the processing unit in time series. It is characterized by that.

  According to the present invention, information is transmitted / received to / from other devices connected via a communication line by the communication means, predetermined processing is executed by the processing means, and information is transmitted / received by the communication means by the history information generating means. The transmission / reception history information that represents information in time series and the processing history information that represents information related to processing executed by the processing means in time series are generated in the history information. As well as information related to processing executed inside the apparatus, for example, information related to processing executed by an application program, related image information can be stored together with history information.

  In the invention, it is preferable that the control unit stores the image information acquired by the acquisition unit in a storage unit in a predetermined format.

  According to the present invention, since the image information acquired by the acquisition unit is stored in the storage unit in a predetermined format by the control unit, a viewer that can display image information in a predetermined format, for example, JPEG format. If there is, the stored image information can be displayed.

The present invention also includes a plurality of operation units for inputting predetermined information;
History information generating means for generating history information that represents the operation unit operated among the plurality of operation units in time series,
First display means for displaying at least image information relating to the application ;
When history information is generated by the history information generation means ,
When processing is started by interruption by the operation unit or the first display unit, or interruption by an application, the image information displayed on the first display unit is acquired by the acquisition unit, and the acquired image information is , The image information is stored in the storage means in association with the history information generated when the image information is acquired,
When processing by an interrupt by the operation unit or the first display unit or an interrupt by an application has already been started , the image information displayed on the first display unit is displayed by the operation corresponding to the history information. An acquisition means for acquiring image information displayed on the first display means only when it has been changed;
Second display means for displaying image information and history information;
In response to the history information generated by the history information generation means, the history information generated by the history information generation means is displayed in time series on the second display means, and the acquisition means when the history information is generated And a control means for displaying the history information on the second display means together with the image information obtained by the obtaining means when the history information is generated when the history information is generated. An information display device.

According to the present invention, predetermined information is input by a plurality of operation units, and history information generating means generates history information representing the operation units operated among the plurality of operation units in time series, When the image information is displayed by the first display means, and the history information is generated by the history information generation means by the acquisition means, the processing is started by an interruption by the operation unit or the first display means, or an interruption by the application. Sometimes, the image information displayed on the first display means is acquired by the acquisition means, and the acquired image information is stored in the storage means in association with the history information generated when the image information is acquired. , the operation unit or the interruption by the first display means or when the processing by the interrupt by the application has already been started, is By the operation corresponding to the history information, only when the image information displayed on the first display means is changed, the image information displayed on the first display unit is acquired, the second display means Thus, image information and history information are displayed. Further, in response to the history information generated by the history information generation unit, the control unit displays the history information generated by the history information generation unit on the second display unit in time series, and the history information is generated. If there is image information acquired by the acquisition means at the time, the history information is displayed on the second display means together with the image information acquired by the acquisition means when the history information is generated. That is, the image information that was displayed when the operation was performed is acquired or captured, and the captured image information is displayed together with the history information, so all the image information that is necessary to perform the operation, that is, the image data, is displayed. Even if it is not stored, the operation procedure can be reproduced in real time based on the history information.

The present invention also provides history information generation for generating history information that represents an operated operation unit in time series when one of the operation units is operated among a plurality of operation units for inputting predetermined information. Process,
Every time history information is generated in the history information generation step, the history information generated in the history information generation step is stored in the storage unit, and when history information is generated in the history information generation step ,
When processing is started by an interruption by the operation unit or the first display unit, or an interruption by an application, the acquisition unit acquires the image information displayed on the first display unit, and the acquired image information is displayed as the image information. In association with the history information generated when the information is acquired, it is stored in the storage means,
When processing by an interrupt by the operation unit or the first display unit or an interrupt by an application has already started , the image information displayed on the first display unit is changed by the operation corresponding to the history information. Only when the image information displayed on the first display unit that displays at least the image information related to the application is acquired, and the acquired image information is associated with the history information generated when the image information is acquired A storage step of storing in the storage unit,
When display instruction information for instructing display of history information is input by the operation unit, the history information stored in the storage unit is displayed on a second display unit different from the first display unit in time series, A history information display method characterized by including a display step of displaying history information together with image information associated with the history information on the second display unit when there is image information associated with the history information. is there.

According to the present invention, in the history information generation step, when any one of the plurality of operation units for inputting predetermined information is operated, the history indicating the operated operation unit in time series Every time history information is generated in the history information generation step, the history information generated in the history information generation step is stored in the storage unit, and history information is generated in the history information generation step. When the processing is started by an interruption by the operation unit or the first display unit, or an interruption by an application, the image information displayed on the first display unit is acquired by the acquisition unit, and the acquired image information is , Stored in the storage means in association with the history information generated when the image information was acquired, interrupted by the operation unit or the first display means, or interrupted by the application When the treatment with has already been started by the operation corresponding to the subsequent history information, only when the image information displayed on the first display means is changed, the displaying image information regarding at least an application 1 The image information displayed on the display unit is acquired, and the acquired image information is stored in the storage unit in association with the history information generated when the image information is acquired. Further, in the display step, when display instruction information for instructing display of history information is input by the operation unit, the history information stored in the storage unit is chronologically different from the first display unit. When there is image information displayed on the display unit and associated with the history information, the history information is displayed on the second display unit together with the image information associated with the history information. In other words, the image information that was displayed when the operation was performed is acquired, captured, stored together with the history information, and the stored image information is displayed along with the history information during failure analysis, so it is necessary to perform the operation Even if not all image information, that is, image data is stored, the operation procedure can be reproduced based on the history information stored together with the image information.

  According to the present invention, the operation procedure can be reproduced based on the history information stored together with the image information without storing all the image information necessary for performing the operation, that is, the image data. If the history information display device according to the present invention is used, the second display means for displaying the history information is a device that does not store image information necessary for operation, for example, a support device constituted by a personal computer. Even if it is provided, the operation procedure can be reproduced based on the history information and the failure analysis can be performed.

  In addition, according to the present invention, information input / output at a part other than the operation unit and information related to processing executed inside the apparatus, for example, processing executed by an application program, are also stored together with history image information. Since the data can be stored, the failure analysis can be more accurately performed based on the stored history information and image information.

  In addition, according to the present invention, if there is a viewer that can display image information in a predetermined format, for example, JPEG format, the stored image information can be displayed, so a personal computer that can use a commercially available viewer, etc. However, it is possible to perform failure analysis by reproducing the operation procedure.

  Further, according to the present invention, the operation procedure can be reproduced in real time based on the history information without storing all the image information, that is, the image data necessary for performing the operation. If such a history information display device is used, the second display means for displaying history information is provided in a device that does not store image information necessary for operation, for example, a support machine constituted by a personal computer. However, the operation procedure can be reproduced in real time based on the history information. Further, even when the support machine is installed at a location away from the target machine provided with the operation unit, that is, at a remote place, the operation procedure can be reproduced in real time.

  Further, according to the present invention, the operation procedure can be reproduced based on the history information stored together with the image information without storing all the image information necessary for the operation, that is, the image data. Therefore, if the history information display method according to the present invention is used, the second display unit that displays the history information is, for example, a support machine configured by a personal computer that does not store image information necessary for operation. Even if it is provided, the failure analysis can be performed by reproducing the operation procedure based on the history information.

FIG. 1 schematically shows a schematic configuration of a log display system 1 according to an embodiment of the present invention. A log display system 1 that is a history information display device includes a target machine 10 and a support machine 20. The history information display method is processed by the log display system 1. The target machine 10 is configured by a POS (Point Of Sales) terminal used in distribution or a gas station, for example, and includes an input / output unit 11 and a log file unit 15. The support machine 20 is constituted by a personal computer, for example, and includes a display unit S25. The target machine 10 and the support machine 20 are a network such as a LAN (Local Area Network).
30 or a public line. Although only one target machine 10 is shown in FIG. 1, a plurality of target machines 10 are connected.

  The input / output unit 11 of the target machine 10 includes, for example, a touch panel on which the operator operates the target machine 10 and a liquid crystal display that displays information for the operator. The log file unit T15 is configured by, for example, a hard disk device, and stores history information (hereinafter referred to as “log”) such as operations performed on the input / output unit 11 by the operator. The display unit S25 of the support machine 20 is configured by a liquid crystal display that displays information for an operator of the support machine 20, for example.

  When the operator operates the input / output unit 11, the target machine 10 generates a log representing the operation performed by the operator, and stores the generated log in the log file unit T15. When receiving the log read and transmitted from the log file unit T15, the support device 20 analyzes the operation performed on the target device 10 based on the received log, and displays the analysis result on the display unit S25. . On the display unit S25, for example, the touch panel of the input / output unit 11 of the target machine 10 is displayed as an image, and an image of an operator's hand or the like who operates the touch panel is synthesized and displayed, and operations performed on the target machine 10 Is reproduced on the display unit S25.

  FIG. 2 is a perspective view showing an external appearance of the target machine 10 shown in FIG. The target machine 10 shown in FIG. 2 is an example of a POS terminal installed at a gas station, and is operated by an employee and used for gasoline refueling designation or settlement. The target device 10 shown in FIG. 2 includes a touch panel unit 111 and a key unit 112 for inputting information, a display unit T113 for displaying information, a printer 31, and a magnetic card reader / writer 33. The printer 31 and the magnetic card reader / writer 33 do not need to be incorporated in the target machine 10 and may be externally attached.

  FIG. 3 is a block diagram showing an example of the configuration of the target machine 10 shown in FIG. The target machine 10 includes an input / output unit 11, a log recording control unit 12, a system timer unit 13, an application unit 14, a log file unit T15, a display control unit 16, a control unit 17, a CPU (Central Processing Unit) (not shown), and an illustration. Not including memory. A printer 31, a scanner 32, a magnetic card reader / writer 33, a password input device 34, a weighing machine 35, a change machine 36, an oil level gauge 37, and a car wash machine 38 are connected to the target machine 10.

  The input / output unit 11 is a communication unit that transmits and receives data to and from a device built in the target machine 10 and an external device, and includes a touch panel unit 111, a key unit 112, a display unit T113, a LAN communication unit 114, and a parallel communication unit. 115, a serial communication unit 116, a wireless communication unit 117, and an SS (Service Station) -LAN communication unit 118. The built-in devices are, for example, the touch panel unit 111, the key unit 112, and the display unit T113, and the external devices are, for example, the printer 31, the scanner 32, the magnetic card reader / writer 33, the personal identification number input device 34, and the weighing machine 35. A change machine 36, an oil level gauge 37, and a car wash machine 38.

  The touch panel unit 111 is a touch panel for inputting information by an operator touching the screen. The key unit 112 is a key input device that inputs information when an operator presses a key. The display unit T113 is a display device such as a liquid crystal display and displays information.

  The LAN communication unit 114 is a communication unit that transmits / receives data to / from devices connected to the LAN 30, for example, the support device 20. The parallel communication unit 115 is a communication unit that transmits / receives data to / from a device such as a printer connected to the target machine 10 by a parallel interface. The serial communication unit 116 is a communication unit that transmits / receives data to / from the scanner 32 and the magnetic card reader / writer 33 connected to the target machine 10 through a serial interface. The wireless communication unit 117 is a communication unit that transmits and receives data to and from the personal identification number input device 34 that is connected to the target machine 10 by wireless. The SS-LAN communication unit 118 is a communication unit that transmits and receives data to and from the weighing machine 35, the change machine 36, the oil level gauge 37, and the car wash machine 38 that are connected to the target machine 10 by SS-LAN. Communication with external devices may be wired or wireless.

  The log recording control unit 12 includes a log generation unit 121, a character string conversion table unit T122, a log recording unit 123, and a log setting unit 124. Information from the input / output unit 11, the application unit 14, or the display control unit 16 is included in the log recording control unit 12. Based on this, a log is generated and recorded. When the log generation unit 121 receives a log instruction, that is, a log generation instruction from the input / output unit 11, the application unit 14, or the display control unit 16, the log generation unit 121 monitors whether the log target operation has occurred in the input / output unit 11. When a log target operation occurs, a log based on the log instruction or the generated log target operation is generated. The operation to be logged includes, for example, that an input is generated on the target machine 10 when an operator directly touches or pushes a device attached to the target machine 10 with a finger or the like, and an external device connected to each communication unit Such as occurrence of communication with the device, change in the state of the communication path, and occurrence of an error in each unit. The character string conversion table unit T122 is included in, for example, a memory (not shown), and stores a conversion table (described later) used by the log generation unit 121 to generate a log. The log recording unit 123 stores the log generated by the log generation unit 121 in the log file unit T15. The log setting unit 124 is included in, for example, a memory (not shown), and is set with a log target for generating a log, a log file for storing the log, and the like.

  The system timer unit 13 is a timer that measures the time of the target machine 10. When generating the log, the log generation unit 121 refers to the time indicated by the system timer unit 13 and leaves the time in the log. The application unit 14 is a part that realizes a function corresponding to the application of the target machine 10, and includes an image data unit 141 and an application control unit 142. The image data unit 141 is included in a memory (not shown), for example, and stores an image image to be displayed on the display unit T113 and an image management table 51 to be described later for managing the image image. The application control unit 142 is a function realized by a program that is executed according to the use of the target machine 10.

  The log file unit T15 is included in a memory (not shown), for example, and includes a standard log file 151 and a designated log file 152. The log file is a file obtained by collecting a plurality of logs. When a log output from one target device 10 is recorded in a log file, the log file can be divided into a plurality of files instead of only one. For example, it can be divided for each input / output device or for each operation. In the example shown in FIG. 3, first, the log file is roughly divided into two log files, that is, a standard log file 151 and a designated log file 152. The standard log file 151 is a log file for storing a log for each requested device, and the designated log file 152 is a log file for storing a log common to all devices. The standard log file 151 is divided into device-specific log files. Furthermore, the file is also divided when the file size of the log file reaches a system limit or an arbitrarily specified maximum value.

The display control unit 16 controls the display unit T113. For example, an image instructed from the application control unit 142 is displayed on the display unit T113. The control unit 17 is a function realized by a program stored in a memory (not shown) being executed by a CPU (not shown). The input / output unit 11, the log recording control unit 12, the application unit 14, and a display control unit 16 is controlled. The input / output unit 11, the log recording control unit 12, the application unit 14, and the display control unit 16 are also functions realized by executing a program stored in a memory (not shown) by a CPU (not shown). The memory (not shown) is, for example, ROM (Read Only Memory) or RAM (Random
This is a storage device constituted by a semiconductor memory such as an Access Memory) or a hard disk device.

  The printer 31 is, for example, a printing device, the scanner 32 is, for example, an original reading device or a barcode reading device, and the magnetic card reader / writer 33 is a device that reads and writes a magnetic card, and a password input device 34. Is an input device for inputting a personal identification number. The weighing machine 35, change machine 36, oil level gauge 37, and car wash machine 38 are devices used at a gas station, the weighing machine 35 is a device that measures the amount of oil supplied by a pump, and the change machine 36 is a change machine. The oil level gauge 37 is a device for measuring the amount of oil stored in the tank, and the car wash machine 38 is a device for washing the car.

  Input / output unit 11 includes hardware from touch panel unit 111, key unit 112, display unit T113, LAN communication unit 114, parallel communication unit 115, serial communication unit 116, wireless communication unit 117, and SS-LAN communication unit 118. Processing is started by software interrupt. Based on the interrupt factor, a log instruction for instructing log generation is created, and the created log instruction is sent to the log generation unit 121.

  FIG. 4 shows an example of the image management table 51 managed by the image data unit 141 shown in FIG. The image management table 51 is a table showing data for each display screen number that specifies a display screen to be displayed on the display unit T113. This data is data of the image itself displayed on the entire screen of the display unit T113, an image displayed on a part of the screen of the display unit T113, or metadata for generating an image. In FIG. 4, the data “start image data” is shown for the display screen number “0001”, the data “business image 1 data” is shown for the display screen number “0002”, and the display screen number “0003” is Data “business image 2 data” is shown.

  When the application control unit 142 instructs the display control unit 16 to specify a display screen number, the display control unit 16 causes the display unit T113 to display an image of the display screen number instructed from the application control unit 142. Then, the display control unit 16 creates a log instruction indicating the designated display screen number, and sends the created log instruction to the log generation unit 121.

  The log recording control unit 12 monitors whether or not a log target operation other than an interrupt occurs in the input / output unit 11. When a log target operation occurs, a log of the log target operation is generated, and the generated log is stored in the log file unit T15. Further, when receiving a log target log instruction set in the log setting unit 124 from the input / output unit 11, the application unit 14, or the display control unit 16, a log based on the log instruction is generated, and the log file unit T15 receives the log instruction. Remember. Whether to store in a standard log file or a specified log file in the log file unit T15 is determined based on the setting of the log setting unit 124.

  FIG. 5 shows a log instruction example 52 notified to the log generation unit 121 from the input / output unit 11 or the display control unit 16 shown in FIG. The log instruction basically indicates one log instruction per line, and FIG. 5 shows six log instructions. One log instruction is composed of a plurality of numerical values or character strings separated by commas. The first numerical value indicates an input / output unit number described later in FIG. 6, the second numerical value indicates an operation number described later in FIG. 7, and the third numerical value indicates a capture control flag described later in FIG. The numerical values or character strings after the fourth are details of the operation.

  For example, the log instruction “1, 1, 1, 142, 244” on the first line causes the operation of the operation number “1”, that is, the “touch” operation, to occur at the input / output number “1”, that is, the touch panel unit 111. There is an instruction to capture an image displayed on the display unit T113 with the control flag “1”, and the operation details are “142,244”, that is, the touched position is the coordinates (142,244). . The log instruction on the second line is “1, 2, 0, 145, 242”, the log instruction on the third line is “11, 11, 0, 01F45CCD4EF10E042”, and the log instruction on the fourth line is “21, 31, 1, 130 ", the log instruction on the fifth line is" 1, 1, 1, 582, 289 ", and the log instruction on the sixth line is" 1, 2, 0, 573, 295 ". .

  FIG. 6 is an input / output unit name definition table 53 stored in the character string conversion table unit T122 shown in FIG. The input / output part name definition table 53 is a table indicating a corresponding “input / output part name log character string” for each “input / output part number” for specifying the input / output part. On the right side of the input / output part name definition table 53, the names of the respective input / output parts are described as “Remarks: Corresponding input / output”. Since the character string in the input / output unit name log character string column of the table can be set arbitrarily, the input / output unit name log character string may be set to a character string that has nothing to do with it.

  The input / output unit number “001” indicates that the input / output unit name log character string is “operation” and the remarks are “touch panel”, that is, the touch panel unit 111. Similarly, the input / output unit name log character string and remarks for the input / output unit number are ““ serial1 ”” and “serial communication unit 1” for “011”, and “serial2” for “012”, respectively. "" And "Serial Communication Unit 2", "013" is "external" and "Serial Communication Unit 3", and "021" is "Display" and "Display Unit" Yes, “031” is “sslan” and “SS-LAN communication section”, and “100” is “core” and “application”.

  “Serial communication unit 1”, “Serial communication unit 2”, and “Serial communication unit 3” are all serial communication units 116, and show a case where a plurality of input / output channels are used in the same device. . An input / output unit number is assigned to each of a plurality of input / output channels to distinguish them.

  FIG. 7 is an action name definition table 54 stored in the character string conversion table unit T122 shown in FIG. The action name definition table 54 is a table indicating a corresponding “action name log character string” for each “action number” for specifying an action. On the right side of the action name definition table 54, each action name is described as “Remarks: Corresponding action”. Since the character string in the action name log character string column of the table can be arbitrarily set, the action name log character string may be set to a character string that is completely unrelated.

  The operation number “000” indicates that the operation name log character string is “message” and the remark is “information”. Similarly, the action name log string and remarks for the action number are “pressed” and “touch” for “001”, and “released” and “release” for “002”, respectively. Yes, “011” is “read” and “input”, “012” is “write” and “output”, and “021” is “error” and “Error”. “031” is “change” and “screen change”.

  FIG. 8 is a capture control table 66 stored in the character string conversion table unit T122 shown in FIG. The capture control table 66 is a table indicating a corresponding “capture log character string” for each value of the “capture control flag” indicating whether to capture an image of the screen displayed on the display unit T113. On the right side of the capture control table 66, “Remark: Corresponding input / output” indicates whether or not the screen is to be captured. That is, the capture control flag is a flag for controlling whether or not to capture a screen when an event associated with the input / output illustrated in FIG. 6 and the operation illustrated in FIG. 7 occurs. When the capture control flag is “1”, the full screen displayed on the display unit T113 at that time is captured, and the image data of the captured screen is saved or stored in the log file unit T15, and when the capture control flag is “0” Do not capture. For example, when a screen with an operation on the touch panel unit 111 is displayed or when the screen is changed due to an operation on the touch panel unit 111 or the key unit 112, a log instruction with a capture control flag of “1” is created Is done. When the screen does not change even when an operation is performed on the touch panel unit 111 or the key unit 112, a log instruction with a capture control flag “0” is created.

  FIG. 8 shows the capture log character string ““ ”for the capture control flag“ 0 ”, and the capture log character string“ “capture:% s” ”for the capture control flag“ 1 ”. . “Capture:% s” indicates the file name of the image data of the captured screen, and the file name is named by the log generation unit 121. The file name is named by unique information such as date / time such as year / month / day / hour / minute / second when captured. The image data stored in the log file portion T15 is recorded in, for example, JPEG (Joint Photographic Experts Group) format.

  FIG. 9 is an operation detail creation rule table 55 stored in the character string conversion table unit T122 shown in FIG. The operation detail creation rule table 55 is a table indicating “operation details log creation rule” for each combination of “input / output unit”, “operation”, and “capture control flag”. On the right side of the operation detail creation rule table 55, “remarks: meaning” describes the meaning determined by the combination of “input / output unit” and “operation”.

  For example, for the combination of the input / output unit “001”, the operation “001”, and the capture control flag “0”, the log creation rule for the operation details indicates that “the fourth and fifth arguments have coordinates“ x =% 04d, y = % 04d ”format and screen capture is not performed”, and the remark is “touch panel touched”. Similarly, an operation detail log creation rule and remarks for each combination of the input / output unit, the operation, and the capture control flag are for the combination of the input / output unit “001”, the operation “001”, and the capture control flag “1”. Are “the fourth and fifth arguments are in the format of coordinates“ x =% 04d, y =% 04d ”, screen capture% s” and “touch the touch panel”, the input / output unit “001”, the operation “002” ”And the capture control flag“ 0 ”are expressed as“ the fourth and fifth arguments are in the format of coordinates “x =% 04d, y =% 04d” and screen capture is not performed. ”And“ touch panel is released ”. Yes, for the combination of the input / output unit “001”, the operation “002”, and the capture control flag “1”, “the fourth and fifth arguments are coordinates“ x =% 04d, y =% 04d ”. For the combination of input / output unit “012”, operation “011”, and capture control flag “0”, the fourth argument is set to a hexadecimal number. , “No screen capture” and “Input via serial communication unit 1”, and the combination of the input / output unit “012”, the operation “011”, and the capture control flag “1” is set to “4th argument in hexadecimal. , “Screen capture% s” and “input via serial communication unit 1”, and for the combination of input / output unit “012”, operation “012”, and capture control flag “0”, the fourth argument is set to hexadecimal. , “No screen capture” and “Output by serial communication unit 1”, input / output unit “012”, operation “012”, and capture control flag “1” For the combination of “the fourth argument is a hexadecimal number, screen capture% s” and “output by the serial communication unit 1”, the input / output unit “100”, the operation “000”, and the capture control flag “0”. The combination is “output the fourth argument as characters and do not capture the screen” and “application information”.

  When the log generation unit 121 receives a log target log instruction set in the log setting unit 124 from the input / output unit 11, the application unit 14, or the display control unit 16, the log generation unit 121 first acquires the date and time from the system timer unit 13. Then, a date / time log character string representing the date / time is generated. Next, based on the first numerical value of the received log instruction, the input / output unit name log character string from the input / output unit name definition table 53 shown in FIG. 6 is shown in FIG. 7 based on the second numerical value. Based on the action name log character string from the action name definition table 54 and the third numerical value, the capture log character string is acquired from the capture control table 66 shown in FIG. Further, based on the first numerical value, the second numerical value, the third numerical value, and the fourth numerical value and the character string of the received log instruction, the operation details of the operation detail creation rule table 55 shown in FIG. In accordance with the log creation rule, an operation detail log representing the operation details is created. The acquired date / time log character string, input / output unit name log character string, operation name log character string, capture log character string, and created operation detail log are synthesized to generate a log corresponding to the log instruction. The generated log is stored in the log file unit T15.

  For example, when a log indicating that the operator touches the touch panel is generated, the instruction log is the instruction log “1, 1, 1, 142, 244” on the first line of the instruction log example 52 illustrated in FIG. is there. The number “001” indicating the input / output unit “touch panel” indicated by the first argument “1”, the number “001” indicating the operation “touch” indicated by the second argument “1”, and the third argument “1” are indicated. For the combination with the capture control flag for capturing the screen, referring to the operation detail creation rule table 55 shown in FIG. 9, the operation detail log creation rule “coordinates“ fourth and fifth arguments “x =% 04d, y = % 04d "format and screen capture% s" is obtained. Here, “% 04d” indicates a 4-digit decimal number, and is an example of a standard output format related to character output in a program using C language. Assuming that the date and time is 15: 15: 01.120 seconds on May 18, 2006, from the fourth argument “142” and the fifth argument “244”, the log is “2006/05/18, 15:05:01. 120, “operation”, “pressed”, “capture: 20060518150501120. jpg "," x = 00142, y = 0244 "".

  FIG. 10 shows a log example 56 stored in the log file part T15 shown in FIG. The log example 56 basically shows one log per line, that is, a log for one operation on the target machine 10, and FIG. 10 shows six logs. One log is composed of a plurality of numerical values or character strings separated by commas. The first numeric value or character string is the date and time when the operation to be logged occurred, the second numeric value or character string is the input / output part name, the third numeric value or character string is the operation name, the fourth numeric value or character string The presence or absence of image capture and when the image is captured, the file name of the captured image, the fifth numerical value, or the character string are operation details indicating details of each operation. In the example shown in FIG. 10, five items are illustrated, but in addition to these, information related to the target machine 10 such as a program name, a user name, the number of characters of the log, or a machine name related to the log, and a use situation Or you may include the information etc. which specify a place. Furthermore, when the information amount of one log increases, the log may be divided into two or more lines.

FIG. 10 shows a log example 56 corresponding to the instruction log example 52 shown in FIG. The first line includes “2006/05/18, 15: 05: 01.120,“ operation ”,“ pressed ”,“ capture: 200605518150501120. jpg ”,“ x = 0142, y = 0244 ”, and the second line contains“ 2006/05/18, 15:05: 01.541, “operation”, “released”, “
”,“ X = 0145, y = 0242 ””, and the third line contains “2006/05/18, 15: 05: 02.951,“ serial1 ”,“ read ”,“ ”,“ 01F45CCD4EF10E042 ”. "" Is shown on the fourth line, "2006/05/18, 15: 05: 04.092," display "," change "," capture: 20060518150504092. jpg ”,“ display = 0130 ”and the fifth line contains“ 2006/05/18, 15: 05: 08.735, “operation”, “pressed”, “capture: 200605518150508735. jpg ”,“ x = 0582, y = 0289 ””, and the sixth line includes “2006/05/18, 15: 05: 09.090,“ operation ”,“ released ”,“ ”,“ x = 0573, y = 0295 ””.

  In the example shown in FIG. 10, an example in which information specifying the date and time is included in the log is shown. When the information for specifying the date and time is not included in the log, the log is recorded in the log file of the log file unit T15. In this case, the data is stored in the order in which the logs are generated or in the order in which the operations to be logged occur. When information for specifying the date and time is included in the log, the order may be arbitrary.

  FIG. 11 shows a log event conversion table 57 used by the application unit 14 shown in FIG. 3 to create a log instruction. The log event conversion table 57 is a table indicating a “log character string” corresponding to each “event” generated in the application control unit 142. In the log character string column, an arbitrary log character string can be set according to the event. Therefore, the application can be recorded as a log independent of the input / output unit 11, that is, only the application information can be recorded as a log.

  FIG. 11 shows the log character string ““ Program A start ”” for the event “Start of program A”, and the log character string ““ Program A end (end code =%) for the event “End of program A” ”. 03d) "" is displayed, the log character string "" employee code =% 06d "" is displayed for the event "designation of employee to operate", and the log character string "" is specified for the event "start of checkout process" Checkout process start "" is shown.

  FIG. 12 shows a log instruction example 58 notified from the application unit 14 shown in FIG. 3 to the log generation unit 121 and a log example 59 based thereon. For example, when the target machine 10 is a terminal used in a restaurant composed of a plurality of employees, in order to identify the operator of the terminal, the application uses the employee information, for example, the employee code to identify the employee. to manage. The operation of the touch panel is an operation related to the employee who uses the terminal, and there is a case where the input / output operation performed on the touch panel and the employee information are associated with each other and recorded in a log. When the log recording control unit 12 is not configured to know the employee information, the application control unit 142 records information that exists only in the application, for example, employee information as an arbitrary character string in order to record in the log. The log generation unit 121 is instructed by a log instruction.

  Each log instruction shown in the log instruction example 58 includes a plurality of numerical values or character strings separated by commas, as in the example shown in FIG. The first numerical value indicates the input / output unit number shown in FIG. 6, the second numerical value indicates the operation number shown in FIG. 7, and the third numerical value and the character string are details of the operation. Details of the operation are information corresponding to the event shown in FIG. For example, the log instruction “100, 0,“ Program A start ”” on the first line is an input / output number “100”, that is, an application, generates an operation with an operation number “0”, that is, “information”. “Program A started”, that is, program A has started. The log instruction on the second line is “100, 0,“ employee code =% 06d ”, 138”, and the log instruction on the third line is “100,0,“ program A end (end code =% 03d) ”. , 0 ".

  Each log shown in the log example 59 is a log corresponding to the log instruction shown in the log instruction example 58. Similarly to the example shown in FIG. 10, a plurality of numerical values or character strings separated by commas are used. Composed. The first numeric value or character string is the date and time when the operation to be logged occurred, the second numeric value or character string is the input / output part name, the third numeric value or character string is the operation name, the fourth numeric value or character string These are the operation details which show the content of each operation | movement in detail. For example, “2006/05/26, 10: 13: 59.022,“ core ”,“ message ”,“ Program A start ”” is indicated on the first line, and “2006/05” is indicated on the second line. 05/26, 10: 14: 21.924, “core”, “message”, “employee code = 000138” ”is shown on the third line,“ 2006/05/26, 10:20:11 311, “core”, “message”, “program A end (end code = 000)”.

  FIG. 13 is a block diagram showing an example of the configuration of the support machine 20 shown in FIG. The support machine 20 includes a log reading unit 21, a buffer unit 22, a log analysis unit 23, a display unit S25, an operation unit 26, a character string conversion table unit S27, a log reproduction control unit 28, a CPU (not shown), and a memory (not shown). . The support machine 20 is connected to the target machine 10 via the LAN 30.

  The log reading unit 21 reads a log from the log file unit T15 included in the target machine 10. The buffer unit 22 stores the log read by the log reading unit 21. The log analysis unit 23 performs log analysis. The display unit S25 is configured by a liquid crystal display, for example, and displays an image. The operation unit 26 is configured by, for example, a keyboard or a mouse, and is an input device for inputting instructions regarding log reproduction and display contents. The character string conversion table unit S27 is included in, for example, a memory (not shown), and stores a later-described conversion table referred to by the log analysis unit 23 in order to specify an operation from the log character string.

  The log reproduction control unit 28 is a function realized by a program stored in a memory (not shown) being executed by a CPU (not shown), and includes a log reading unit 21, a buffer unit 22, a log analysis unit 23, and a display unit S25. And the operation unit 26 are controlled. The log analysis unit 23 is also a function realized by a program stored in a memory (not shown) being executed by a CPU (not shown). A memory (not shown) is a storage device configured by a semiconductor memory such as a ROM or a RAM or a hard disk device, for example. The buffer unit 22 is included in a memory (not shown).

  FIG. 14 shows a playback screen 70 displayed on the display unit S25 shown in FIG. The reproduction screen 70 includes a screen display unit 71, a key operation display unit 72, an input / output display unit 73, and a reproduction pointer 74. The screen display unit 71 is an area for displaying a captured screen image displayed on the display unit T113 of the target machine 10. The key operation display part 72 is an area for displaying an image representing the key part 112 of the target machine 10. The input / output display unit 73 is input / output information excluding information input by the touch panel unit 111 and the key unit 112 among the information input / output to / from the input / output unit 11 of the target machine 10. This is an area for displaying information input / output by the communication unit or information of the application unit 14. The reproduction pointer 74 is a pointer that indicates the relative position of the currently reproduced log when all logs are reproduced.

  When the log reproduction is performed, the log reproduction control unit 28 acquires, from the log file unit T15, image data (hereinafter, also referred to as “screen image”) displayed on the display unit T113 on the target machine 10 and captured. And displayed on the screen display unit 71. When coordinates are designated on the target machine 10 with a touch panel or a mouse, the designated coordinate position is specified by combining and displaying a pointer such as a finger, an arrow, or a symbol on the screen display unit 71. When the key input in the key unit 112 of the target machine 10 is operated, the input value is displayed on the key operation display unit 72 so as to be specified by the pointer. Further, information communicated by each communication unit included in the input / output unit 11 of the target machine 10 or information of the application unit 14 is displayed as a character string on the input / output display unit 73.

  FIG. 15 shows a search method definition table 60 used in the log reproduction control unit 28 shown in FIG. The search method definition table 60 is a table for determining a log search method based on a designated reproduction condition. A “search method” is indicated for each “reproduction condition designation”. FIG. 15 shows a search method “comparison between date and time of log line and specified date / time” for a playback condition specification “specify playback start date / time”, and a search method ““ Employee code = “Search for matches with character string” is displayed, and the search method “Search for matches between input / output unit log character string and operation details character string” for playback condition specification “specific communication content of external device” is displayed. It is shown.

  When the operator instructs log reproduction from the operation unit 26, the log reproduction control unit 28 displays on the display unit S25 a screen for selecting the log file name of the log to be reproduced by the display unit S25. When the log file name is selected by the operation unit 26, the log file having the selected log file name is read from the log file unit T15 included in the target machine 10 into the buffer unit 22 by the log reading unit 21. When there are a plurality of selected log file names, the log files of all selected log file names are read into the buffer unit 22 and the logs are sorted by date and time.

  Next, the log reproduction control unit 28 displays a screen for inputting reproduction conditions on the display unit S25. The playback conditions include the playback conditions shown in FIG. 15, for example, a condition that a log at an arbitrary date and time from the start to the end of the log is played, or a log that matches a specified character string in the log You can specify the condition to do. When the reproduction condition is designated, a log satisfying the designated reproduction condition is searched.

  FIG. 16 shows the input / output unit specifying table 63 stored in the character string conversion table unit S27 shown in FIG. The input / output unit identification table 63 is a table indicating “input / output unit number” corresponding to “input / output unit name log character string”. On the right side of the input / output unit identification table 63, the names of the respective input / output units are described as “Remarks: Corresponding input / output unit”. The input / output unit identification table 63 is a table used when the log analysis unit 23 performs analysis, and is a table for performing conversion opposite to the conversion by the input / output unit name definition table 53 illustrated in FIG.

  FIG. 16 shows the input / output unit name log character string ““ operation ””, the input / output unit number “001” and the remarks “touch panel”, and the input / output unit name log character string ““ serial1 ””. On the other hand, the input / output unit number “011” and the remark “serial communication unit 1” are shown, and the input / output unit number “012” and the remarks “serial communication” are input to the input / output unit name log character string ““ serial2 ””. Part 2 ”, the input / output part name log character string“ “extserial” ”, the input / output part number“ 013 ”and the remarks“ serial communication part 3 ”are shown, and the input / output part name log character string“ An input / output part number “021” and a remark “display part” are shown for “display”, and an input / output part number “031” and a remark for the input / output part name log character string ““ sslan ””. "SS-L N communication unit "is shown, to the input-output unit name log character string" "core" ", input-output unit number" 100 "and remarks" application "is shown.

  FIG. 17 shows an action specifying table 64 stored in the character string conversion table unit S27 shown in FIG. The action specifying table 64 is a table indicating “action number” corresponding to “action name log character string”. Each operation name is described as “Remarks: Corresponding operation” on the right side of the operation specifying table 64. The action specifying table 64 is a table for performing conversion opposite to the conversion by the action name definition table 54 shown in FIG.

  FIG. 17 shows the operation number “000” and the remarks “information” for the operation name log character string ““ message ””, and the operation number “ “001” and the remark “touch” are indicated, the operation number “002” and the remark “release” are indicated for the operation name log character string ““ released ””, and the operation name log character string ““ read ”” is displayed. On the other hand, the operation number “011” and the remark “input” are indicated, and the operation name “012” and the remark “output” are indicated for the operation name log character string ““ write ””. An operation number “021” and a remark “error” are displayed for ““ error ””, and an operation number “031” and a remark “screen change” are displayed for the operation name log character string ““ change ””. Has been .

  FIG. 18 shows an operation analysis table 65 stored in the character string conversion table unit S27 shown in FIG. The action analysis table 65 is a table indicating “meaning of action detail log” for each combination of “input / output unit” and “action”, and is recorded as an action detail character string in the log. This is used to specify what operation is performed in the section. On the right side of the operation analysis table 65, the meaning of each log is described as “Remarks: Meaning of Log”. The operation analysis table 65 is a table used when the log analysis unit 23 performs analysis, and the combination of the input / output unit and the operation is the reverse of the conversion performed in the operation detail creation rule table 55 shown in FIG. It is for performing conversion.

  In FIG. 18, for the combination of the input / output unit “001” and the operation “001”, the meaning of the operation detail log is “x =% 04d, y =% 04d” in which the numerical values are coordinates X, Y ”and , Remarks are shown as "touch panel coordinates (X, Y) touched". Similarly, the meaning and remarks of the operation detail log for each combination of the input / output unit and the operation are as follows: “x =% 04d, y =% for the combination of the input / output unit“ 001 ”and the operation“ 002 ”. The numerical value is “X, Y” and “separated by touch panel coordinates (X, Y)” in the “04d” format, and the combination of the input / output unit “012” and the operation “011” is “communication in hexadecimal format”. "Content" and "There was input in communication with an external device in the serial communication unit 1", and the combination of the input / output unit "012" and the operation "012" is "communication content in hexadecimal format" and " "Serial output to external device in serial communication unit 1". For combinations of input / output unit "012" and operation "021", "error code in decimal format" and "error in serial communication unit 1" The combination of the input / output unit “021” and the operation “031” is “display“% 04d ”format, numerical value is screen number D” and “display unit displays screen D”. The combinations of the input / output unit “031” and the operation “011” are “communication contents in hexadecimal format” and “the SS-LAN communication unit has received input in communication with an external device”. The combination of the part “031” and the operation “012” is “communication content in hexadecimal format” and “output to the external device via communication in the SS-LAN communication part”, and operates with the input / output part “100”. The combination with “000” is “application information character string” and “application recorded information”.

  The log reproduction control unit 28 analyzes what the operation indicated by the log is performed by the log analysis unit 23 for the log searched according to the reproduction condition. The log analysis unit 23 extracts the input / output unit number corresponding to the log input / output name from the input / output unit identification table 63 shown in FIG. 16, and the operation number corresponding to the log operation name is the operation shown in FIG. The operation corresponding to the combination of the input / output unit number and the operation number extracted from the specification table 64 is specified by the operation analysis table 65 shown in FIG.

  When the log analyzed by the log analysis unit 23 is a log of each communication unit or application unit 14 included in the input / output unit 11 of the target machine 10, the log reproduction control unit 28 includes information indicated in the log operation details. Is converted into a character string and displayed on the input / output display unit 73. When the log is an operation log for the touch panel unit 111 or the key unit 112, an operation that is operated among the operation buttons or keys in the screen image displayed on the display unit S25 based on the position indicated by the operation details of the log. As indicated by a button or key, a pointer such as a finger for indicating the operation position of the operation is combined with the displayed screen image and displayed.

  When the log indicates that the screen has been captured, specifically, when the log includes the character string “capture:”, the log reading unit 21 determines the log of the display control unit 16. The screen image having the file name indicated by “capture:” of the log is acquired from the log file unit T15 included in the target machine 10 and the acquired screen image is displayed on the screen display unit 71. The log of the touch panel unit 111 or the key unit 112 is displayed by combining pointers and then displaying the captured screen image on the screen display unit 71. For the log of each communication unit or application unit 14 included in the input / output unit 11, after the information shown in the operation details of the log is displayed, the captured screen image is displayed on the screen display unit 71.

  The log reproduction control unit 28 sequentially reproduces the logs read into the buffer unit 22 in time series. The user can stop the log that is sequentially played back by the operation unit 26 at an arbitrary time, and can restart the log from the stop time. By adjusting the time to display the next log after displaying one log based on the date and time of the log, it can be reproduced as an operation in real time. High speed playback is possible by shortening the time, or slow playback is possible by lengthening the time.

In the above-described embodiment, the target machine 10 is exemplified by a POS terminal used in distribution or a gas station, but is not limited to this.
Automated teller machine), vending machines, kiosk terminals, safety monitoring devices at self-gas stations, POS terminal training support devices for remote locations, and information devices such as personal computers or portable terminals that are operated by human operation Any device can be used. The remote POS terminal training support apparatus is an apparatus for previously storing an operation performed by the lecturer as a log and reproducing the operation procedure of the lecturer using the operation log during the training.

  Further, the log display system 1 is configured by connecting the target machine 10 and the support machine 20 by connecting them via the LAN 30. However, the function of the support machine 20 is included in the target machine 10 and the target machine 10 and the support machine 20 are connected. 20 may be integrated. When there are a plurality of target machines 10, only one target machine 10 may be integrated.

  FIG. 19 shows a schematic configuration of a log display system 2 which is another embodiment of the present invention. The log display system 2 that is a history information display device stores a log file in a storage device outside the target machine, and includes a target machine 10a, a support machine 20, and a network disk 40 that are respectively connected via a LAN 30. The history information display method is processed by the log display system 2. The support machine 20 is the same as the support machine 20 shown in FIG. 3, and is not shown. The target machine 10a is obtained by eliminating the log file portion T15 of the target machine 10 shown in FIG. The log transmission unit 18 is the same as the LAN communication unit 114 shown in FIG. 3 and transmits the log generated by the log generation unit 121 to a network disk 40 connected to a network such as the LAN 30 or a public line.

  The network disk 40 is connected to the LAN 30 and includes a log file unit N41 and a log communication unit N42. The log file unit N41 is configured by a storage device such as a hard disk device, for example, and stores the log received by the log communication unit N42 from the target machine 10a. The log communication unit N42 is a communication unit that transmits and receives data to and from other devices connected to the LAN 30, such as the target device 10a and the support device 20. Thus, log recording can be performed without providing a storage area in the target machine 10a.

  FIG. 20 shows a schematic configuration of a log display system 3 which is still another embodiment of the present invention. The log display system 3 that is a history information display device is a system that eliminates a log file, and includes a target machine 10b and a support machine 20a that are respectively connected by a LAN 30. The history information display method is processed by the log display system 3. The target machine 10b is the same as the target machine 10a shown in FIG. As will be described in detail with reference to FIG. 21, the support device 20a is provided with a log receiving unit S29 in place of the log reading unit 21 and the buffer unit 22 of the support device 20 shown in FIG. The target device 10b transmits the generated log to the support device 20a by the log transmission unit 18 without storing the generated log.

  FIG. 21 is a block diagram illustrating an example of the configuration of the support machine 20a illustrated in FIG. A log receiving unit S29 is provided instead of the log reading unit 21 and the buffer unit 22 of the support machine 20 shown in FIG. The log receiver S29 of the support machine 20a receives the log transmitted from the target machine 10b and sends it to the log analyzer 23. The log analysis unit 23 analyzes the log received from the log reception unit S29 and sends the analysis result to the log reproduction control unit 28. The log reproduction control unit 28 performs display based on the analysis result received from the log analysis unit 23. That is, the log display system 3 can display the operation performed on the target machine 10b on the display unit S25 of the support machine 20a in real time. Therefore, it is possible to monitor the operation of the target machine 10b at a location away from the target machine 10b. It becomes easy to use for the purpose of monitoring logs.

  FIG. 22 is a flowchart of the input / output log instruction creation processing of the input / output unit 11 shown in FIG. When the input / output unit 11 performs processing related to the log instruction, the process proceeds to step A1. In step A1, a hardware or software interrupt is awaited. In step A2, it is determined whether or not an interrupt has occurred. If there is an interrupt, the process proceeds to step A3. If there is no interrupt, the process returns to step A1. In step A3, an interrupt is processed. In step A4, a log instruction is created based on the processing content that generated the interrupt. In step A5, the log generation unit 121 is notified of the log instruction and the process ends.

  FIG. 23 is a flowchart of the log instruction creation process of the application unit 14 shown in FIG. When the application unit 14 performs display on the screen of the display unit T113, the process proceeds to step B1. In order to perform screen display, the display control unit 16 is notified of the display image number, thereby specifying the screen to be displayed. This designation is performed by an arbitrary application operating on the target machine 10.

  In step B1, image data specified by the image management table 51 shown in FIG. 4 is acquired from the image data unit 141 based on the display image number. In step B2, the image data is adjusted according to the display unit T113. The adjustment means that the image is the whole or a part of the image, and the image is enlarged, reduced, or superimposed according to the display capability of the display unit T113. In step B3, the adjusted image data is displayed on the display unit T113. In step B4, a log instruction is created based on the display image number. In step B5, the generated log instruction is notified to the log generation unit 121 and the process ends.

  FIG. 24 is a flowchart of the log monitoring process of the log recording control unit 12 shown in FIG. The log recording control unit 12 monitors each unit in the input / output unit 11, and proceeds to Step C1 to generate a log of the operation to be logged. In step C 1, the log setting is acquired from the log setting unit 124. In the log setting, all of the operations related to the log, for example, operations related to the input / output unit 11, or errors are set, and the log target operation can be selected by setting the log target in the log setting. In step C2, the operation of the input / output unit 11 is confirmed. That is, the operation of each unit in the input / output unit 11 is monitored. In step C3, it is determined whether or not there is a log target operation. If there is a log target operation, the process proceeds to step C4. If there is no log target operation, the process returns to step C2.

  In step C4, a log is generated for the operation to be logged. In step C5, it is determined whether or not a recording destination log file is specified in the log setting. If specified, the process proceeds to step C7, and if not specified, the process proceeds to step C6. In step C6, the generated log is recorded in the standard log file 151 and the process ends. In step C7, the generated log is recorded in the designated log file 152 and the process ends.

  FIG. 25 is a flowchart of the log recording process of the log recording control unit 12 shown in FIG. When the log instruction from the input / output unit 11 or the display control unit 16 is monitored, the process proceeds to Step D1. In step D1, a log instruction is waited. In step D2, it is determined whether or not there is a log instruction. If there is a log instruction, the process proceeds to step D3, and if there is no log instruction, the process returns to step D1. In step D3, the log setting is acquired from the log setting unit 124. In step D4, it is determined whether or not the log instruction is a log instruction to be logged. If it is a log target, the process proceeds to step D5, and if it is not a log target, the process returns to step D1.

  In step D5, a log is generated for the detected operation to be logged. In step D6, it is determined whether or not a recording destination log file is specified in the log setting. If specified, the process proceeds to step D8, and if not specified, the process proceeds to step D7. In step C7, the generated log is recorded in the standard log file 151 and the process ends. In step C8, the generated log is recorded in the designated log file 152 and the process ends.

  Both flowcharts shown in FIG. 24 and FIG. 25 are processes by the log recording control unit 12, but operate in separate tasks. However, the start of each flowchart may be connected to the end of another flowchart to continuously operate as one task.

FIG. 26 is a flowchart of the log generation processing of the log generation unit 121 illustrated in FIG.
Called when generating a log in step C4 shown in FIG. 24 or step D5 shown in FIG. 25, the process proceeds to step E1. Therefore, the process is started in a state where the log instruction or the log target operation is specified.

  In step E1, the current date and time is acquired from the system timer unit 13. The date / time does not necessarily have to be the date / time by the system timer unit 13, and any unique date / time that can specify the date / time when the operation to be logged has occurred may be used. The unique date and time is, for example, the elapsed time since the target machine 10 started operating, the date and time according to the clock of the server machine on the same network, or the operating time of the server.

  In step E2, a date / time log character string is created from the acquired date / time. In step E3, the input / output unit log character string corresponding to the input / output unit number is acquired with reference to the input / output unit name definition table 53 shown in FIG. In step E4, the action log character string corresponding to the action number is acquired with reference to the action name definition table 54 shown in FIG. 7, and the capture log character string is further obtained from the capture control table 66 shown in FIG. get. In step E5, with reference to the operation detail creation rule table 55 shown in FIG. 9, the operation detail log character string creation rule corresponding to the combination of the input / output unit number, the operation number, and the capture control flag, that is, the operation detail log Get creation rules.

  In step E6, it is determined whether or not the capture control flag is “1”. If the capture control flag is “1”, the process proceeds to step E9. If the capture control flag is not “1”, the process proceeds to step E7. In step E7, an operation detail log character string is created based on the acquired operation detail log creation rule. In step E8, the date / time log character string created in step E2, the input / output unit log character string obtained in step E3, the operation log character string and capture log character string obtained in step E4, and the operation detail log created in step E6 Generate a log by combining the strings, and exit.

  In step E9, the screen is captured. That is, the screen displayed on the display unit 113 is captured by the display control unit 16, and the image data of the screen captured by the display control unit 16, that is, the screen image is acquired from the display control unit 16. In step E10, the date and time acquired in step E1 is used as the file name, and the screen image acquired from the display control unit 16 is stored, that is, stored in the log file unit T15, and the process proceeds to step E7. For example, the file name of the screen image captured at 20: 22: 23.000 on July 19, 2006 is “2006071920223000.jpg”.

  FIG. 27 is a flowchart of the log reproduction process of the log reproduction control unit 28 shown in FIG. For example, when the log reproduction function is selected by the operation unit 26, the process proceeds to step F1. In step F1, a log file name selection screen for selecting a log file name to be reproduced is displayed on the display unit S25. In step F2, the operation unit 26 waits for a log file name to be selected. If the log file to be played back is specified before the function to play back the log is selected, for example, before moving to Step F1, Step F1 and Step F2 may be skipped.

  In step F3, it is determined whether a plurality of log files have been selected. When a plurality of log files are selected, the process proceeds to step F19, and when one log file is selected, the process proceeds to step F4. In step F4, the selected log file is read into the buffer unit 22. In step F5, the date and time when the log recording was started and the date and time when the log recording was completed, that is, the date and time of the last recording were acquired from the buffer unit 22. Since the logs in the buffer unit 22 are sorted in order of date and time, the date and time of the first row and the date and time of the last row are acquired.

  In step F6, a reproduction condition input screen for inputting reproduction conditions is displayed. The reproduction condition is, for example, a condition that a log having an input date and time from the start to the end of the log is reproduced, or a condition that a log that matches or includes the inputted character string is reproduced. In step F7, it is determined whether or not a reproduction condition is specified. If the reproduction condition is designated, the process proceeds to step F8, and if the reproduction condition is not designated, the process proceeds to step F20. In step F8, a log that matches the specified playback condition is searched from the logs in the buffer unit 22, and when the top log of the buffer unit 22 is the first line, the value of the line number of the searched log is “ The value obtained by subtracting “1” is assigned to the counter “n”.

  In step F9, "1" is added to the counter "n" and the pointer is advanced to the next line. In step F10, the log of the “n” line is read from the buffer unit 22 for one line. In step F11, the log analysis unit 23 analyzes the read log. The analysis reveals what the log was doing. In Step F12, it is determined whether or not another line log is necessary for reproduction. Since one operation may be divided and recorded in a log having two or more lines, it is determined whether or not another line is necessary. There are cases where playback is not possible if there are not enough logs. If another line log is necessary, the process returns to step F9, and if another line log is not necessary, the process proceeds to step F13.

  In Step F13, it is determined whether or not there is capture data, that is, whether or not the log includes a character string “capture:”. If the log includes the character string “capture:”, it is determined that there is capture data, and the process proceeds to step F14. If the log does not include the character string “capture:”, it is determined that there is no capture data. Proceed to F15. In step F14, the corresponding capture data screen is acquired. That is, a screen image having a file name indicated by “capture:” of the log is acquired from the log file unit T15 included in the target machine 10 by the log reading unit 21. In step F15, a reproduction screen image to be displayed is generated from the acquired screen image and the operation indicated by the log. In step F16, the generated reproduction screen image is displayed on the display unit S25.

  In step F17, it is determined whether all the logs in the buffer unit 22 have been read. If all the logs have not been read, the process proceeds to step F18, and if all the logs have been read, the process ends. The log file selection screen can also be displayed by returning to the start at the end. In step F18, the process waits for wait w seconds and returns to step F9. In step F19, all the selected log files are read into the buffer unit 22, the logs are sorted using the date and time of each log line as a key, and the process proceeds to step F5. In Step F20, “0” is substituted into the counter “n”, and the process proceeds to Step F9.

  As described above, predetermined information is input by the plurality of operation units, and history information that represents the operation units operated among the plurality of operation units in time series by the history information generation unit is operated by the operation unit. Generated by the first display means, the image information displayed on the first display means is acquired by the acquisition means, and generated by the history information generation means by the storage means The recorded history information and the image information acquired by the acquiring means are stored, and the image information and the history information are displayed by the second display means. Further, every time history information is generated by the control information generation means by the control means, the history information generated by the history information generation means is stored in the storage means, and when history information is generated by the history information generation means. When a predetermined image acquisition condition representing a condition for acquiring an image is satisfied, the image information displayed on the first display unit is acquired by the acquisition unit, and the image information acquired by the acquisition unit is The history information stored in the storage means when the display instruction information for instructing the display of the history information is input by the operation unit in association with the history information generated when the information is acquired. Are displayed in time series on the second display means, and there is image information associated with the history information, the history information is associated with the history information, and It is displayed on the second display means. In other words, the image information that was displayed when the operation was performed is acquired, captured, stored together with the history information, and the stored image information is displayed along with the history information during failure analysis, so it is necessary to perform the operation Even if not all image information, that is, image data is stored, the operation procedure can be reproduced based on the history information stored together with the image information. Therefore, if the history information display device according to the present invention is used, the second display means for displaying the history information is a device that does not store image information necessary for operation, for example, a support constituted by a personal computer. Even if it is provided in the machine, the failure analysis can be performed by reproducing the operation procedure based on the history information.

  The plurality of operation units are, for example, operation buttons of the touch panel unit 111 or keys of the key unit 112, the history information generation unit is, for example, the log generation unit 121, and the first display unit is, for example, the display control unit 16 and the display unit Part T113, the acquisition unit is, for example, the log generation unit 121, the storage unit is, for example, the log file unit T15, the second display unit is, for example, the display unit S25, and the control unit is, for example, log recording The control unit 12 and the log reproduction control unit 28, the communication line is, for example, the LAN 30, and the communication means are, for example, the LAN communication unit 114, the parallel communication unit 115, the serial communication unit 116, the wireless communication unit 117, and the SS-LAN. The communication unit 118, and the processing means is, for example, the application unit 14. The predetermined image acquisition condition is a condition that the capture control flag is “1”, for example, and the predetermined format is, for example, the JPEG format.

  Further, the communication means transmits / receives information to / from other devices connected via the communication line, the processing means executes predetermined processing, and the history information generating means transmits the information transmitted / received by the communication means. Since the history information is generated by including in the history information transmission / reception history information represented in series and processing history information representing information related to processing executed by the processing means, information input / output in a part other than the operation unit, and For information related to processing executed in the apparatus, for example, processing executed by an application program, related image information can be stored together with history information. Therefore, failure analysis can be performed more accurately based on the stored history information and image information.

  Furthermore, the operation information includes the plurality of operation units, and image information displayed on the first display unit when any one of the operation units is operated is history information generated by the history information generation unit. If the control means is instructed to acquire an image, the image information displayed on the first display means is related to the history information generated by the history information generating means by the communication means and the processing means. Since the acquisition of the image is instructed to the control means, and the predetermined image acquisition condition is that the acquisition of the image is instructed by the operation means, the communication means, or the processing means, the history information stored for each means Of these, image information can be stored only for history information of conditions suitable for each means. Therefore, it is not necessary to store image information for all history information, and the amount of image information to be stored can be reduced. The operation means is, for example, the touch panel unit 111 or the key unit 112.

  Furthermore, since the image information acquired by the acquisition unit is stored in the storage unit in a predetermined format by the control unit, if there is a viewer that can display image information in a predetermined format, for example, JPEG format, The stored image information can be displayed. Therefore, the failure analysis can be performed by reproducing the operation procedure even with a personal computer or the like that can use a commercially available viewer.

  Furthermore, predetermined information is input by the plurality of operation units, and history information that generates time-sequential operation units operated among the plurality of operation units is generated by the history information generation unit, When the image information is displayed by the display means, and when the history information is generated by the history information generation means by the acquisition means, if a predetermined image acquisition condition representing a condition for acquiring the image is satisfied, the first display means Is acquired, and the second display means displays the image information and the history information. Further, in response to the history information generated by the history information generation unit, the control unit displays the history information generated by the history information generation unit on the second display unit in time series, and the history information is generated. If there is image information acquired by the acquisition means at the time, the history information is displayed on the second display means together with the image information acquired by the acquisition means when the history information is generated. That is, the image information that was displayed when the operation was performed is acquired or captured, and the captured image information is displayed together with the history information, so all the image information that is necessary to perform the operation, that is, the image data, is displayed. Even if it is not stored, the operation procedure can be reproduced in real time based on the history information. Therefore, if the history information display device according to the present invention is used, the second display means for displaying the history information is a device that does not store image information necessary for operation, for example, a support constituted by a personal computer. Even if it is provided in the machine, the operation procedure can be reproduced in real time based on the history information. Further, even when the support machine is installed at a location away from the target machine provided with the operation unit, that is, at a remote place, the operation procedure can be reproduced in real time.

  Furthermore, according to the history information display method according to the present invention, when one of the plurality of operation units for inputting predetermined information is operated in the history information generation step, the operated operation is performed. History information that represents a part of the history information is generated, and each time history information is generated in the history information generation step in the storage step, the history information generated in the history information generation step is stored in the storage unit. When the history information is generated in the generation process, if a predetermined image acquisition condition representing a condition for acquiring the image is satisfied, the image information displayed on the first display unit that displays the image information is acquired. The acquired image information is stored in the storage unit in association with the history information generated when the image information is acquired. Further, in the display step, when display instruction information for instructing display of history information is input by the operation unit, the history information stored in the storage unit is chronologically different from the first display unit. When there is image information displayed on the display unit and associated with the history information, the history information is displayed on the second display unit together with the image information associated with the history information. In other words, the image information that was displayed when the operation was performed is acquired, captured, stored together with the history information, and the stored image information is displayed along with the history information during failure analysis, so it is necessary to perform the operation Even if not all image information, that is, image data is stored, the operation procedure can be reproduced based on the history information stored together with the image information. Therefore, if the history information display method according to the present invention is used, the second display unit that displays the history information is, for example, a support machine configured by a personal computer that does not store image information necessary for operation. Even if it is provided, the failure analysis can be performed by reproducing the operation procedure based on the history information.

  The history information generation process is, for example, an input / output log instruction creation process, a log instruction creation process, a log monitoring process, a log recording process, and a log generation process, and the storage process is, for example, a log monitoring process and a log recording process The display process is, for example, a log reproduction process.

1 schematically shows a schematic configuration of a log display system 1 according to an embodiment of the present invention. It is a perspective view which shows the external appearance of the target machine 10 shown in FIG. It is a block diagram which shows an example of a structure of the target machine 10 shown in FIG. 4 shows an example of an image management table 51 managed by the image data unit 141 shown in FIG. A log instruction example 52 notified from the input / output unit 11 or the display control unit 16 shown in FIG. It is the input / output part name definition table 53 memorize | stored in the character string conversion table part T122 shown in FIG. It is the action name definition table 54 memorize | stored in the character string conversion table part T122 shown in FIG. It is the capture control table 66 memorize | stored in the character string conversion table part T122 shown in FIG. It is the operation detail creation rule table 55 memorize | stored in the character string conversion table part T122 shown in FIG. The log example 56 memorize | stored in log file part T15 shown in FIG. 3 is shown. 3 is a log event conversion table 57 used by the application unit 14 shown in FIG. 3 to create a log instruction. A log instruction example 58 notified from the application unit 14 shown in FIG. 3 to the log generation unit 121 and a log example 59 based thereon are shown. It is a block diagram which shows an example of a structure of the support machine 20 shown in FIG. The reproduction | regeneration screen 70 displayed on display part S25 shown in FIG. 13 is shown. 14 shows a search method definition table 60 used by the log reproduction control unit 28 shown in FIG. An input / output unit specifying table 63 stored in the character string conversion table unit S27 shown in FIG. 13 is shown. The operation | movement specific table 64 memorize | stored in the character string conversion table part S27 shown in FIG. 13 is shown. The motion analysis table 65 memorize | stored in the character string conversion table part S27 shown in FIG. 13 is shown. 2 shows a schematic configuration of a log display system 2 which is another embodiment of the present invention. The schematic structure of the log display system 3 which is further another form of implementation of this invention is shown.

It is a block diagram which shows an example of a structure of the support machine 20a shown in FIG. It is a flowchart of the input / output log instruction | indication creation process of the input / output part 11 shown in FIG. It is a flowchart of the log instruction | indication preparation process of the application part 14 shown in FIG. It is a flowchart of the log monitoring process of the log recording control part 12 shown in FIG. It is a flowchart of the log recording process of the log recording control part 12 shown in FIG. It is a flowchart of the log generation processing of the log generation unit 121 shown in FIG. 14 is a flowchart of log reproduction processing of the log reproduction control unit 28 illustrated in FIG. 13.

Explanation of symbols

1-3 Log display system 10 Target machine 11 Input / output unit 12 Log recording control unit 13 System timer unit 14 Application unit 15 Log file unit T
DESCRIPTION OF SYMBOLS 16 Display control part 17 Control part 18 Log transmission part 20 Support machine 21 Log reading part 22 Buffer part 23 Log analysis part 25 Display part S
26 Operation section 27 Character string conversion table section S
28 Log reproduction control unit 30 LAN
31 Printer 32 Scanner 33 Magnetic card reader / writer 34 PIN number input device 35 Weighing machine 36 Change machine 37 Oil level gauge 38 Car wash machine 40 Network disk 41 Log file part N
42 Log receiver N
51 Image Management Table 53 Input / Output Unit Name Definition Table 54 Operation Name Definition Table 55 Operation Detail Creation Rule Table 57 Log Event Conversion Table 60 Search Method Definition Table 63 Input / Output Unit Specification Table 64 Operation Specification Table 65 Operation Analysis Table 66 Capture Control Table 70 Playback screen 71 Image display section 72 Key operation display section 73 Input / output display section 74 Playback pointer 111 Touch panel section 112 Key section 113 Display section T
114 LAN communication unit 115 Parallel communication unit 116 Serial communication unit 117 Wireless communication unit 118 SS-LAN communication unit 121 Log generation unit 122 Character string conversion table unit T
123 log recording unit 124 log setting unit 141 image data unit 142 application control unit 151 standard log file 152 specified log file

Claims (5)

A plurality of operation units for inputting predetermined information;
History information generating means for generating history information representing the operation unit operated among the plurality of operation units in time series, each time the operation unit is operated;
First display means for displaying at least image information relating to the application ;
Obtaining means for obtaining image information displayed on the first display means;
Storage means for storing history information generated by the history information generation means and image information acquired by the acquisition means;
Second display means for displaying image information and history information;
Control means,
The control means
Each time history information is generated by the history information generation means, the generated history information is stored in the storage means, and when history information is generated by the history information generation means ,
When processing is started by interruption by the operation unit or the first display unit, or interruption by an application, the image information displayed on the first display unit is acquired by the acquisition unit, and the acquired image information is , The image information is stored in the storage means in association with the history information generated when the image information is acquired,
When processing by an interrupt by the operation unit or the first display unit or an interrupt by an application has already been started , the image information displayed on the first display unit is displayed by the operation corresponding to the history information. Only when the information is changed, the image information displayed on the first display means is acquired by the acquisition means, and the acquired image information is associated with the history information generated when the image information is acquired. Memorize it in the memory means,
When display instruction information for instructing display of history information is input by the operation unit, the history information stored in the storage means is displayed in time series on the second display means, and an image associated with the history information is displayed. When there is information, a history information display device characterized in that history information is displayed on the second display means together with image information associated with the history information. A communication means for transmitting and receiving information to and from other devices connected via a communication line;
Processing means for executing a predetermined process,
The history information generating unit generates the history information including transmission / reception history information that represents information transmitted / received by the communication unit in time series and processing history information that represents information related to processing executed by the processing unit in time series. The history information display device according to claim 1, wherein:   The history information display device according to claim 1, wherein the control unit causes the storage unit to store the image information acquired by the acquisition unit in a predetermined format. A plurality of operation units for inputting predetermined information;
History information generating means for generating history information that represents the operation unit operated among the plurality of operation units in time series,
First display means for displaying at least image information relating to the application ;
When history information is generated by the history information generation means ,
When processing is started by interruption by the operation unit or the first display unit, or interruption by an application, the image information displayed on the first display unit is acquired by the acquisition unit, and the acquired image information is , The image information is stored in the storage means in association with the history information generated when the image information is acquired,
When processing by an interrupt by the operation unit or the first display unit or an interrupt by an application has already been started , the image information displayed on the first display unit is displayed by the operation corresponding to the history information. An acquisition means for acquiring image information displayed on the first display means only when it has been changed;
Second display means for displaying image information and history information;
In response to the history information generated by the history information generation means, the history information generated by the history information generation means is displayed in time series on the second display means, and the acquisition means when the history information is generated And a control means for displaying the history information on the second display means together with the image information obtained by the obtaining means when the history information is generated when the history information is generated. Information display device. When any one of the plurality of operation units for inputting predetermined information is operated, a history information generation step for generating history information representing the operated operation unit in time series,
Every time history information is generated in the history information generation step, the history information generated in the history information generation step is stored in the storage unit, and when history information is generated in the history information generation step ,
When processing is started by interruption by the operation unit or the first display unit, or interruption by an application, the image information displayed on the first display unit is acquired by the acquisition unit, and the acquired image information is , The image information is stored in the storage means in association with the history information generated when the image information is acquired,
When processing by an interrupt by the operation unit or the first display unit or an interrupt by an application has already been started , the image information displayed on the first display unit is displayed by the operation corresponding to the history information. Only when the image information is changed, at least image information displayed on the first display unit that displays image information related to the application is acquired, and the acquired image information is converted into history information generated when the image information is acquired. A storage step of storing in the storage unit in association with each other;
When display instruction information for instructing display of history information is input by the operation unit, the history information stored in the storage unit is displayed on a second display unit different from the first display unit in time series, A history information display method comprising: a step of displaying the history information on the second display unit together with the image information associated with the history information when there is image information associated with the history information.

Images