JP2011232867A - Operation analysis device, information processor, operation analysis method and operation analysis program - Google Patents

Abstract

PROBLEM TO BE SOLVED: To provide an operation analysis device for reproducing and analyzing a failure that occurred on an image forming apparatus, capable of enhancing a reproducibility of the failure.SOLUTION: An operation analysis device includes a microcomputer 213 that acquires an operational signal that is exchanged between a display panel operated by a user and a main control part 146 to generate an operational information, which is stored in connection with a time stamp that indicates an acquisition timing, and reproduces the operation by the user based on the stored information, and a control application 231 that stores an instruction inputted to an image forming apparatus 1 through a network with a PC230 operated by a user in connection with a time stamp, and reproduces the operation of the PC230 based on the stored information.

Description

  The present invention relates to a motion analysis device, an information processing device, a motion analysis method, and a motion analysis program, and more particularly to a motion analysis device that analyzes a motion by reproducing a user operation.

  In recent years, there has been a tendency to digitize information, and image processing apparatuses such as printers and facsimiles used for outputting digitized information and scanners used for digitizing documents have become indispensable devices. Such an image processing apparatus is often configured as a multifunction machine that can be used as a printer, a facsimile, a scanner, or a copier by providing an imaging function, an image forming function, a communication function, and the like.

  In such an image processing apparatus, a history of user operations is stored, and when a failure occurs, the user's operations are reproduced based on the stored operation history in order to investigate the cause of the failure. A method has been proposed (see, for example, Patent Document 1).

  In the technique disclosed in Patent Document 1, for the purpose of improving the efficiency of debugging work, a key operation reproduction method for recording / reproducing a key operation performed by an operation unit in an image forming apparatus and an image including the reproduction means. A forming apparatus is disclosed, and a configuration is disclosed in which a plurality of key event information over time in an operation unit is recorded, and reproduction of a specific key operation is repeatedly executed based on the information, thereby automatically reproducing the operation. Yes.

  However, in the method disclosed in Patent Document 1, in order to realize the recording / reproduction of the operation by the user, the software for controlling the apparatus is modified. For this reason, the operation at the time of reproducing the operation is different from the operation at the time of normal operation, and the reproducibility of the fault generated by software is low.

  In addition to operations on the keys, touch panel, and power switch on the operation unit, the user performs operations on the image forming apparatus, and in MFP (Multi Function Peripheral), printout from a PC (Personal Computer) or network access Etc. Problems that occur in the image forming apparatus are not only based on operations on the image forming apparatus, but also occur when operations on the image forming apparatus and operations via a network from a PC are performed in combination. There is.

  In the method disclosed in Patent Document 1, since only operations performed by the user with respect to the image forming apparatus are targeted for operation recording, the operations on the image forming apparatus and the network from the PC as described above are used. It is not reproduced when the operation is performed in combination.

  The present invention has been made in consideration of the above circumstances, and an object thereof is to improve the reproducibility of a failure in an operation analysis device for reproducing and analyzing a failure that has occurred in an image forming apparatus.

  In order to solve the above-described problem, an aspect of the present invention is an operation analysis apparatus that analyzes a user's operation on an image forming apparatus having an operation unit and reproduces an operation of the image forming apparatus. A connection unit connected so as to be able to acquire a signal between the operation control unit that controls the operation unit, and an exchange between the operation unit and the operation control unit when the user operates the operation unit An operation signal acquisition unit that acquires an operation signal that is a received signal via the connection unit, operation information based on the acquired operation signal, and timing information indicating a timing at which the operation signal is acquired Operation reproduction information storage processing unit to be stored in a storage medium as operation reproduction information, network command information based on a command transmitted to the image forming apparatus via a network, and the command A network command reproduction information storage processing unit that associates timing information indicating the transmitted timing and stores it in a storage medium as network command reproduction information, and reproduces the operation of the image forming apparatus based on the stored operation reproduction information An operation reproduction unit; and a network command reproduction unit that reproduces the operation of the image forming apparatus based on the stored network command reproduction information. The connection unit acquires the operation signal by the operation signal acquisition unit. The operation unit and the operation control unit are connected to each other, and when the operation reproduction unit reproduces the operation, the operation unit and the operation control unit are disconnected. The timing counting is started in response to the start of reproduction of the operation of the image forming apparatus, and the timing indicated by the timing information Reached After generates a command transmitted via the network based on the network command information associated with the timing information, and transmits to the image forming apparatus via a network.

  According to another aspect of the present invention, there is provided an information processing apparatus included in an operation analysis apparatus that analyzes an operation of a user on an image forming apparatus having an operation unit and reproduces an operation of the image forming apparatus. By operating the operation unit, an operation signal that is a signal exchanged between the operation unit and the operation control unit can be acquired as a signal between the operation unit and the operation control unit that controls the operation unit. The operation reproduction information generated by associating the operation information indicating the operation by the user with the timing information indicating the timing at which the operation signal is acquired is acquired through the connection unit connected as described above. A storage medium, network command information based on a command transmitted to the image forming apparatus via a network, and timing indicating a timing at which the command is transmitted A network command reproduction information storage processing unit that associates the information with the information and stores it in the storage medium as network command reproduction information, and an operation that transmits the stored operation reproduction information to the operation reproduction unit that reproduces the operation of the image forming apparatus A reproduction information transmission unit; and a network command reproduction unit that reproduces the operation of the image forming apparatus based on the stored network instruction reproduction information. The operation reproduction information transmission unit reproduces the operation of the image forming apparatus. The operation reproduction information is transmitted in response to the start, and the network instruction reproduction unit starts counting the timing in response to the start of reproduction of the operation of the image forming apparatus, and when the timing indicated by the timing information is reached, the timing Sent over the network based on network command information associated with the information To generate a decree, via the network and transmits to the image forming apparatus.

  According to still another aspect of the present invention, there is provided an operation analysis method for reproducing an operation of the image forming apparatus by analyzing a user's operation on the image forming apparatus having an operation unit, wherein the operation signal acquisition unit includes the operation The operation unit and the operation control unit are operated by a user operating the operation unit via a connection unit that is connected so as to acquire a signal between the operation unit and the operation control unit that controls the operation unit. The operation reproduction information storage processing unit associates the operation information based on the acquired operation signal with the timing information indicating the timing at which the operation signal is acquired. Network instruction information based on an instruction stored in a storage medium as operation reproduction information and transmitted by the network instruction reproduction information storage processing unit to the image forming apparatus via the network The operation reproduction unit reproduces the operation of the image forming apparatus based on the stored operation reproduction information based on the stored operation reproduction information in association with timing information indicating the timing at which the instruction is transmitted. The network command reproduction unit reproduces the operation of the image forming apparatus based on the stored network command reproduction information, and the connection unit is configured to acquire the operation signal when the operation signal acquisition unit acquires the operation signal. The operation unit and the operation control unit are connected to each other, and when the operation reproduction unit reproduces the operation, the operation unit and the operation control unit are disconnected. Timing counting is started in response to the start of reproduction of the operation of the image forming apparatus. When the timing indicated by the timing information is reached, the timing is started. Generating the transmitted command via the network based on the network command information associated with the grayed information via the network and transmits to the image forming apparatus.

  According to still another aspect of the present invention, there is provided an operation analysis program for analyzing a user operation on an image forming apparatus having an operation unit and reproducing the operation of the image forming apparatus, the operation unit and the operation unit being A user operates the operation unit via a connection unit that is connected so as to be able to acquire a signal between the operation control unit to be controlled, and exchanges between the operation unit and the operation control unit. Acquiring an operation signal that is a signal, associating operation information based on the acquired operation signal with timing information indicating a timing at which the operation signal is acquired, and storing the operation information as operation reproduction information in the storage medium; and Associating network command information based on a command transmitted to a forming apparatus via a network with timing information indicating a timing at which the command is transmitted Storing in a storage medium as network instruction reproduction information, reproducing the operation of the image forming apparatus based on the stored operation reproduction information, and the image forming apparatus based on the stored network instruction reproduction information And the step of storing the operation reproduction information in the storage medium connects the operation unit and the operation control unit by controlling the connection unit. The step of reproducing the operation of the image forming apparatus based on the operation reproduction information includes a step of controlling the connection unit to disconnect the operation unit and the operation control unit. And reproducing the operation of the image forming apparatus based on the network command reproduction information includes the operation of the image forming apparatus. Starting timing counting in response to the start of reproduction and generating a command transmitted via the network based on network command information associated with the timing information when the timing indicated by the timing information is reached And a step of transmitting the generated command to the image forming apparatus via a network.

  According to the present invention, it is possible to improve the reproducibility of a failure in an operation analysis apparatus for reproducing and analyzing a failure that has occurred in an image forming apparatus.

1 is a block diagram illustrating a hardware configuration of an image forming apparatus according to an embodiment of the present invention. 1 is a diagram illustrating a functional configuration of an image forming apparatus according to an embodiment of the present invention. FIG. 2 is a diagram illustrating a functional configuration of a display panel included in the image forming apparatus according to the embodiment of the present invention. It is a figure which shows the function structure of the touchscreen contained in the display panel which concerns on embodiment of this invention. 5 is a flowchart illustrating an operation of a controller of a touch panel included in the display panel according to the embodiment of the present invention. 5 is a flowchart illustrating an operation of a controller of a touch panel included in the display panel according to the embodiment of the present invention. It is a figure which shows the structure of the key switch which concerns on embodiment of this invention. It is a timing chart which shows the control signal in the press detection of the key switch concerning the embodiment of the present invention. It is a timing chart which shows the timing of pressing of the key switch which concerns on embodiment of this invention, and the detected key. It is a figure which shows the functional structure of the operation | movement analysis apparatus which concerns on embodiment of this invention, and a connection relationship with an image forming apparatus. It is a flowchart which shows the whole operation | movement of the motion analysis apparatus which concerns on embodiment of this invention. It is a flowchart which shows the whole operation | movement of the recording process of the operation | movement analysis apparatus which concerns on embodiment of this invention. It is a flowchart which shows the recording process of the key switch operation of the motion analysis apparatus which concerns on embodiment of this invention. It is a flowchart which shows the recording process of the touch panel operation of the motion analysis apparatus which concerns on embodiment of this invention. It is a flowchart which shows the whole operation | movement of the reproduction | regeneration processing of the operation | movement analysis apparatus which concerns on embodiment of this invention. It is a flowchart which shows the reproduction process of the key switch operation of the motion analysis apparatus which concerns on embodiment of this invention. It is a flowchart which shows the reproduction process of the touch panel operation of the motion analysis apparatus which concerns on embodiment of this invention. It is a figure which shows the structure of the light emission part which concerns on embodiment of this invention. It is a figure which shows GUI of the control application displayed on PC concerning embodiment of this invention. It is a flowchart which shows the synchronous process of the microcomputer and PC which concern on embodiment of this invention.

  Hereinafter, embodiments of the present invention will be described in detail with reference to the drawings. In the present embodiment, an operation analysis apparatus that reproduces a failure occurring in an image forming apparatus as an MFP (Multi Function Peripheral) including functions of a printer, a scanner, a copier, etc. and analyzes the operation will be described as an example. To do.

  FIG. 1 is a block diagram illustrating a hardware configuration of an image forming apparatus 1 that is an object of motion analysis. As shown in FIG. 1, the image forming apparatus 1 according to the present embodiment includes an engine that executes image formation in addition to the same configuration as an information processing terminal such as a general server or a PC (Personal Computer). That is, the image forming apparatus 1 according to the present embodiment includes a CPU (Central Processing Unit) 10, a RAM (Random Access Memory) 20, a ROM (Read Only Memory) 30, an engine 40, a HDD (Hard Disk Drive) 50, and an I / O. F60 is connected via the bus 90. Further, an LCD (Liquid Crystal Display) 70 and an operation unit 80 are connected to the I / F 60.

  The CPU 10 is a calculation unit and controls the operation of the entire image forming apparatus 1. The RAM 20 is a volatile storage medium capable of reading and writing information at high speed, and is used as a work area when the CPU 10 processes information. The ROM 30 is a read-only nonvolatile storage medium and stores a program such as firmware. The engine 40 is a mechanism that actually executes image formation in the image forming apparatus 1.

  The HDD 50 is a non-volatile storage medium that can read and write information, and stores an OS (Operating System), various control programs, application programs, and the like. The I / F 60 connects and controls the bus 90 and various hardware and networks. The LCD 70 is a visual user interface for the user to check the state of the image forming apparatus 1. The operation unit 80 is a user interface such as a keyboard and a mouse for the user to input information to the image forming apparatus 1.

  In such a hardware configuration, a program stored in a recording medium such as the ROM 30 or the HDD 50 or an optical disk (not shown) is read out to the RAM 20 and operates according to the control of the CPU 10 to constitute a software control unit. A functional block that realizes the functions of the image forming apparatus 1 according to the present embodiment is configured by a combination of the software control unit configured as described above and hardware.

  Next, the functional configuration of the image forming apparatus 1 according to the present embodiment will be described with reference to FIG. FIG. 2 is a block diagram illustrating a functional configuration of the image forming apparatus 1 according to the present embodiment. As shown in FIG. 2, the image forming apparatus 1 according to the present embodiment includes a controller 100, an ADF (Auto Document Feeder) 110, a scanner unit 120, a paper discharge tray 130, a display panel 140, and a paper feed table. 150, a print engine 160, a paper discharge tray 170, and a network I / F 180.

  The controller 100 includes a main control unit 101, an engine control unit 102, an input / output control unit 103, an image processing unit 104, and an operation display control unit 105. As shown in FIG. 2, the image forming apparatus 1 according to the present embodiment is configured as a multifunction machine having a scanner unit 120 and a print engine 160. In FIG. 2, the electrical connection is indicated by solid arrows, and the flow of paper is indicated by broken arrows.

  The display panel 140 is an output interface that visually displays the state of the image forming apparatus 1 and is an input when the user directly operates the image forming apparatus 1 or inputs information to the image forming apparatus 1 as a touch panel. It is also an interface (operation unit). The network I / F 180 is an interface for the image forming apparatus 1 to communicate with other devices via the network, and an Ethernet (registered trademark) or USB (Universal Serial Bus) interface is used.

  The controller 100 is configured by a combination of software and hardware. Specifically, a control program such as firmware stored in a ROM 30, a nonvolatile memory, and a nonvolatile recording medium such as the HDD 50 or an optical disk is loaded into a volatile memory (hereinafter referred to as a memory) such as the RAM 20, and is controlled by the CPU 10. The controller 100 is configured by a software control unit configured according to the above and hardware such as an integrated circuit. The controller 100 functions as a control unit that controls the entire image forming apparatus 1.

  The main control unit 101 plays a role of controlling each unit included in the controller 100, and gives a command to each unit of the controller 100. The engine control unit 102 serves as a drive unit that controls or drives the print engine 160, the scanner unit 120, and the like. The input / output control unit 103 inputs a signal or a command input via the network I / F 180 to the main control unit 101. The main control unit 101 also controls the input / output control unit 103 to access other devices via the network I / F 180.

  The image processing unit 104 generates drawing information based on the print information included in the input print job, under the control of the main control unit 101. The drawing information is information for drawing an image to be formed in the image forming operation by the print engine 160 as an image forming unit. The print information included in the print job is information that has been converted into a format that can be recognized by the image forming apparatus 1 by a printer driver installed in an information processing apparatus such as a PC. PDL (Page Description Language), Information such as Postscript, PCL (Printer Command Language), and RPCS (Refined Printer Command Stream). The operation display control unit 105 displays information on the display panel 140 or notifies the main control unit 101 of information input via the display panel 140.

  When the image forming apparatus 1 operates as a printer, first, the input / output control unit 103 receives a print job via the network I / F 180. The input / output control unit 103 transfers the received print job to the main control unit 101. When receiving the print job, the main control unit 101 controls the image processing unit 104 to generate drawing information based on the print information included in the print job.

  When drawing information is generated by the image processing unit 104, the engine control unit 102 executes image formation on a sheet conveyed from the paper feed table 150 based on the generated drawing information. That is, the print engine 160 functions as an image forming unit. As a specific mode of the print engine 160, an image forming mechanism using an ink jet method, an image forming mechanism using an electrophotographic method, or the like can be used. The document on which the image has been formed by the print engine 160 is discharged to the discharge tray 170.

  When the image forming apparatus 1 operates as a scanner, the operation display control is performed according to a user operation on the display panel 140 or a scan execution instruction input from an information processing terminal for an external client via the network I / F 180. The unit 105 or the input / output control unit 103 transfers a scan execution signal to the main control unit 101. The main control unit 101 controls the engine control unit 102 based on the received scan execution signal.

  The engine control unit 102 drives the ADF 110 and conveys the document to be imaged set on the ADF 110 to the scanner unit 120. Further, the engine control unit 102 drives the scanner unit 120 and images a document conveyed from the ADF 110. If no original is set on the ADF 110 and the original is set directly on the scanner unit 120, the scanner unit 120 images the set original according to the control of the engine control unit 102. That is, the scanner unit 120 operates as an imaging unit.

  In the imaging operation, an imaging element such as a CCD included in the scanner unit 120 optically scans the document, and imaging information is generated based on the optical information. The engine control unit 102 transfers the imaging information generated by the scanner unit 120 to the image processing unit 104. The image processing unit 104 generates image information based on the imaging information received from the engine control unit 102 according to the control of the main control unit 101. Image information generated by the image processing unit 104 is stored in a storage medium attached to the image forming apparatus 1 such as the HDD 40. That is, the scanner unit 120, the engine control unit 102, and the image processing unit 104 work together to function as a document reading unit.

  The image information generated by the image processing unit 104 is stored in the HDD 40 or the like as it is according to a user instruction or transmitted to an external device via the input / output control unit 103 and the network I / F 180. That is, the scanner unit 120 and the engine control unit 102 function as an image input unit.

  Further, when the image forming apparatus 1 operates as a copying machine, the image processing unit 104 generates drawing information based on imaging information received by the engine control unit 102 from the scanner unit 120 or image information generated by the image processing unit 104. To do. Based on the drawing information, the engine control unit 102 drives the print engine 160 as in the case of the printer operation.

  With respect to such an image forming apparatus 1, the motion analysis apparatus according to the present embodiment is connected so as to be able to acquire a signal inside the display panel 140. First, the configuration of the display panel 140 will be described with reference to FIG. FIG. 3 is a diagram illustrating a functional configuration as an operation unit and a connection relationship with the operation display control unit 105 in the configuration of the display panel 140 according to the present embodiment.

  As shown in FIG. 3, the display panel 140 according to the present embodiment includes a controller 141, a touch panel 142, and a key switch 143. The controller 141 includes an ADC (Analog to Digital Converter) 144, a connector 145, and a main control unit 146. Including. The controller 141 is a control unit that controls a function as an operation unit in the display panel 140. The controller 141 processes a signal generated by the operation of the touch panel 142 and the key switch 143 by the user and transmits the signal as operation information to the operation display control unit 105. To do. Similar to the controller 100 of the image forming apparatus 1, the controller 141 according to the present embodiment includes a software control unit such as the CPU 10, the RAM 20, and a control program described with reference to FIG. 1 and hardware.

  Based on the serial control signal input from the main control unit 146, the ADC 144 converts the analog signal output from the touch panel 142 into a digital signal and inputs the digital signal to the main control unit 146. The connector 145 is used for taking out a signal between the ADC 144 and the main control unit 146 and a signal between the key switch 143 and the main control unit 146 and inputting the signal to the main control unit 146 from the outside. Interface. As shown in the figure, in the normal operation state of the image forming apparatus 1, each terminal of the connector 145 is bypassed, and the ADC 144 or the key switch 143 and the main control unit 146 are connected.

  The main control unit 146 converts a signal input from the ADC 144 or the key switch 143 into an operation signal in the image forming apparatus 1 and inputs the operation signal to the operation display control unit 105. In the present embodiment, the operation display control unit 105 and the main control unit 146 are connected by a USB interface.

  The touch panel 142 includes a display screen such as an LCD and a sensor that detects a user's touch position on the screen. The touch panel 142 outputs an analog signal corresponding to the coordinates of the position touched by the user, that is, a voltage value corresponding to the coordinates to the ADC 144. FIG. 4 shows a connection relationship between the touch panel 142, the ADC 144, and the main control unit 146. That is, peripheral circuits that supply voltage to the ADC 144 and the touch panel 142 function as a touch panel controller.

  As shown in FIG. 4, the touch panel 142 is provided with connection terminals on the high potential side and the low potential side for each of the X coordinate and the Y coordinate. These connection terminals are connected to the ADC 144 as Xp, Xn, Yp, and Yn, respectively, and the ADC 144 converts the voltage values of Xp and Xn and Yp and Yn into digital signals. The ADC 144 receives a control signal from the main control unit 146, and the ADC 144 acquires and converts the voltage value according to the control signal, and outputs the converted digital signal to the main control unit 146. .

  In addition, the ADC 144 outputs a detection signal (hereinafter referred to as a touch detection signal) according to a touch and release detection state of the touch panel by the user to the main control unit 146 as an interrupt signal. The touch detection signal according to the present embodiment is “Low” when the user is touching the touch panel 142, and is “High” when the user is not touching.

  Next, the touch position recognition operation of the touch panel by the main control unit 146 will be described with reference to FIG. As shown in FIG. 5, when the touch detection signal becomes “Low” (S501 / YES), the main control unit 146 inputs the control signal to the ADC 144 and executes the coordinate measurement process of the touch position (S502). When the coordinate measurement process is completed, the main control unit 146 waits for 10 ms (S503). When the touch detection signal is no longer “Low” while waiting for 10 ms (S504 / NO), the main control unit 146 performs touch release processing (S508), and repeats the processing from S501.

  On the other hand, if the touch detection signal is “Low” even after waiting for 10 ms, the main control unit 146 executes the coordinate measurement process again (S505). When the process of S505 is completed, the main control unit 146 determines whether or not the coordinate measurement for three times is completed and whether or not the variation of the measurement value for three times is within a predetermined value (S506). If the coordinate measurement for three times has not been completed yet or if the variation in the measurement for three times exceeds a predetermined value (S506 / NO), the main control unit 146 repeats the processing from S503. On the other hand, if the coordinate measurement for three times is completed and the variation of the measurement value is within the predetermined value (S506 / YES), the main control unit 146 determines the coordinate by the average value of the measurement (S507), The processing from S501 is repeated.

  When the processing shown in FIG. 5 is repeated and the coordinates are continuously determined without executing the touch release processing, the main control unit 146 displays on the touch panel 142 based on the determined coordinate values. It recognizes continuous pressing of the same button and dragging operation. Through such processing, the main control unit 146 recognizes an operation on the touch panel 142 by the user and outputs an operation signal to the operation display control unit 105.

  Next, the coordinate measurement process of S502 and S505 will be described with reference to FIG. As shown in FIG. 6, when starting the coordinate measurement process, the main control unit 146 transmits a coordinate detection command as a control signal to the ADC 144 (S601). This coordinate detection command is a response signal in response to the touch detection signal becoming “Low” in S501 of FIG. When a digital signal is received from the ADC 144 as a response to S601 (S602 / YES), the main control unit 146 stores the received data (S603). The main control unit 146 repeats the processing from S601 to S603 eight times (S604 / NO), discards the first to third data, and checks whether the variation in the fourth to eighth data is within a predetermined value. (S605).

  If the variation of the fourth to eighth data is within a predetermined value as a result of the processing in S605, the fourth to eighth data average value is set as the definite value of the coordinate measurement result (S606), and the processing is terminated. On the other hand, if the fourth to eighth data variations exceed a predetermined value, the main control unit 146 repeats the processing from S601. With such a process, the coordinate measurement process is completed.

  The key switch 143 is a hard switch composed of a plurality of keys. FIG. 7 shows a connection relationship between the hard switch included in the key switch 143 and the main control unit 146. As shown in FIG. 7, eight key switches are connected to each of the key press detection control signal lines SCAN <b> 0 to 3 connected to the main control unit 146. The other end of the switch is connected to one of the key press detection signal lines KEY0 to KEY7, and 32 key switches as a whole are connected and arranged on the matrix.

  As shown in FIG. 7, the key press detection signal lines KEY0 to KEY7 are connected to a high potential via a resistor, so that they are “High” when the key switch is “OFF”. In a state of waiting for a key input by the user, the main control unit 146 sets all signal states of SCAN0 to 3 that are signals of the key press detection control signal lines to “Low”. Thus, when any key switch is pressed by the user, the key of the key press detection signal line connected to the key switch becomes “Low”.

  The main control unit 146 recognizes that one of the key switches has been pressed by the user when one of the KEYs becomes “Low”. Further, when the KEY that has become “Low” becomes “High” again, it is recognized that the pressed key switch has been released. The main control unit 146 operates to determine which key switch is pressed by generating an interrupt process when one of the keys becomes “Low” (hereinafter, referred to as a key switch pressing determination operation). Execute. The operation will be described below.

  8 and 9 are timing charts showing the timing of each signal in the key switch pressing determination operation by the main control unit 146. FIG. FIG. 8 shows a signal state after the main control unit 146 starts the key switch pressing determination operation when any of the KEYs becomes “Low”. As shown in FIG. 8, when an interrupt process occurs due to any of KEY 0 to 7 being “Low”, the main control unit 146 sets SCAN 0 to 3 to “High” and then sets SCAN 0 to 3 to SCAN 0 to 3. The signal states of KEY0 to KEY7 are confirmed as “Low” one by one in order. A signal that becomes “Low” in order after all of SCAN0 to SCAN3 become “High” is a response signal in response to any of KEY0 to KEY7 becoming “Low”.

  The main control unit 146 confirms the signal states of the KEYs 0 to 7 after 1 ms has elapsed since the falling edge of the SCAN. The main control unit 146 can recognize the key switch pressed by the user by the combination of the SCAN set to “Low” and the key set to “Low” accordingly. That is, when any of the KEYs 0 to 7 becomes “Low”, the key switch connected to the KEY that becomes “Low” and the SCAN that is set to “Low” is pressed. I understand that.

  After recognizing the pressed key switch, the main control unit 146 executes a process (hereinafter referred to as a pressed key switch recognition process) of shifting SCAN0 to 3 from “High” to “Low” once each. As shown in FIG. 8, all of the SCANs 0 to 3 are set to “Low” again to return to the standby state for detecting key press or key release. Then, the second press key switch recognition process is executed at the timing when 10 ms has elapsed from the first interrupt detection timing. As a result, the recognition result is adopted only when the recognition results of the first press key switch recognition process and the second press key switch recognition process match.

  FIG. 9 is a timing chart showing determination of pressing and release of the key switch. The main control unit 146 monitors the key switch state change by executing the above-described pressed key switch recognition process every 200 ms even if the key release is not detected after the key switch is pressed. For example, even if any one key switch is pressed and then a key switch connected to the same key press detection signal line as the pressed key switch is pressed, the key of “KEY” that is already “Low”. Since the signal state does not change, the main control unit 146 cannot recognize the subsequent pressing of the key switch. As described above, such a problem can be solved by executing the pressing-key switch recognition process every 200 ms.

  Next, the configuration of the motion analysis apparatus 2 according to the present embodiment and the connection mode with the display panel 140 will be described with reference to FIG. As illustrated in FIG. 10, the motion analysis apparatus 2 according to the present embodiment includes a user operation analysis / reproduction unit 210, a USB protocol analyzer 220, and a PC 230.

  The user operation analysis / reproduction unit 210 receives a signal input from the touch panel 142 via the ADC 144, a signal input by the key switch 143, and a control signal from the main control unit 146, that is, the main control unit 146 and the ADC 144 or the key switch 143. In addition to acquiring and recording an operation signal exchanged with the user, a user operation is reproduced in response to a control signal from the main control unit 146 instead of the touch panel 142 and the key switch 143.

  The user operation analysis / reproduction unit 210 includes a switch circuit 211, an FPGA (Field Programmable Gate Array) 212, and a microcomputer 213. The switch circuit 211 is a connection portion with a signal line drawn from the connector 145 of the display panel 140. As shown in FIG. 10, the switch circuit 211 is connected to the connector 145 so that the ADC 144 and the key switch 143 side (hereinafter referred to as input). And the main control unit 146 (hereinafter referred to as the control side) can be connected or disconnected.

  The switch circuit 211 is connected to the FPGA 212. When the input side and the control side are connected, the switch circuit 211 acquires signals from both the input side and the control side and inputs them to the FPGA 212. In a state where the input side and the control side are disconnected, the switch circuit 211 acquires a control signal on behalf of the input side, inputs the control signal to the FPGA 212, and inputs a signal output from the FPGA to the main control unit 146. .

  The FPGA 212 is provided in the user operation analysis / reproduction unit 210 so that the microcomputer 213 absorbs a load when a signal exchanged between the input side and the control side is taken in, and in particular, the main control unit 146. And ADC 144 are provided to absorb the processing load of signals exchanged between them. As described above, signals exchanged between the main control unit 146 and the ADC 144 are control signals output from the main control unit 146, digital signals and detection signals output from the ADC 144, and the like. It is a peculiar signal. When all of these are directly acquired by the microcomputer 213, many interrupt processes occur, and the load on the microcomputer 213 becomes very high. On the other hand, the FPGA 212 receives these signals, acquires the signals to be recorded, and transmits them to the microcomputer 213, whereby the load on the microcomputer 213 can be reduced.

  The microcomputer 213 controls the user operation analysis / reproduction unit 210 to control the user operation analysis and signal recording on the touch panel 142 and the key switch 143 of the display panel 140 and the reproduction of the user operation to the main control unit 146. It is. The microcomputer 213 acquires a signal via the switch circuit 211 and the FPGA 212 when recording the signal by a user operation. That is, the microcomputer 213 functions as an operation signal acquisition unit.

  Then, the microcomputer 213 stores operation reproduction information for reproducing an operation on the display panel 140 in the HDD 232 that is a storage medium included in the PC 230 based on the acquired signal. That is, the microcomputer 213 functions as an operation reproduction information storage processing unit. Further, the microcomputer 213 outputs a signal to the main control unit 146 according to the information stored in the HDD 232 of the PC 230 when reproducing the user operation on the main control unit 146 to reproduce the operation by the user. That is, the microcomputer 213 functions as an operation reproduction unit.

  The USB protocol analyzer 220 acquires and analyzes information exchanged between the main control unit 146 and the operation display control unit 105 and stores it in the HDD of the PC 230. Information exchanged between the main control unit 146 and the operation display control unit 105 is a control signal output by the main control unit 146 to control other parts when the user operates the key switch 143 or the like. It is.

  The information stored by the USB protocol analyzer is the same as the information exchanged between the main control unit 146 and the operation display control unit 105 in the reproduction of the user operation by the user operation analysis / reproduction unit 210. It is used for the purpose of confirming whether or not they match. This confirmation of matching is executed to confirm the accuracy of the operation reproduced by the user operation analysis / reproduction unit. That is, the USB protocol analyzer 200 also functions as a reproduction confirmation unit.

  The PC 230 includes the control application 231 and the HDD 232, and stores the information acquired by the microcomputer 213 and the USB protocol analyzer 220 in the HDD as described above. The storage of these information in the HDD 232 is processed by the control application 231.

  In addition to the information acquired by the microcomputer 213 and the USB protocol analyzer 220, the control application 231 performs processing such as printout and network access performed from the PC 230 to the image forming apparatus 1 (hereinafter referred to as external operation). The information indicating the instruction is acquired as network instruction information. Then, the control application 231 stores this network command information in the HDD 232 as network command reproduction information, similar to the information acquired by the microcomputer 213 and the USB protocol analyzer 220. That is, the control application 231 functions as a network command reproduction information storage processing unit.

  Further, the control application 231 transmits a command to the image forming apparatus 1 via the network based on the information stored in the HDD 232. Thereby, an external operation performed on the image forming apparatus 1 from the PC 230 is reproduced. That is, the control application 231 functions as a network command reproduction unit.

  In the present embodiment, the microcomputer 213 and the USB protocol analyzer 220 execute respective operations by receiving commands such as “start recording” and “start reproduction” from the PC 230. These commands are input when the user operates the PC 230. Further, the control application 231 executes the above-described recording / reproduction of the external operation in response to a user operation on the PC 230.

  Next, the operation of the motion analysis apparatus 2 according to the present embodiment will be described with reference to FIG. FIG. 11 is a flowchart showing the overall operation of the microcomputer 213 according to the present embodiment. As shown in FIG. 11, upon receiving a recording start command from the PC 230 (S1101 / YES), the microcomputer 213 sets the mode to the recording mode (mode = SCAN), and turns on the execution flag (Running = 1) (S1103). .

  On the other hand, when not a recording start command (S1101 / NO) but a playback command is received (S1102 / YES), the mode is set to a playback mode (mode = PLAY) (S1104). When the process of S104 or S1105 is completed, the microcomputer 213 confirms the mode, and if the recording mode (mode = SCAN) (S1105 / YES), the microcomputer executes the recording process (S1107). Details of the recording process will be described later.

  On the other hand, if not the recording mode (S1105 / NO) and the reproduction mode (mode = PLAY) (S1106 / YES), the microcomputer 213 executes the reproduction process (S1108). Details of the reproduction process will be described later. If the playback mode is not set (S1106 / NO), the microcomputer 213 assumes that the standby mode (mode = WAIT) is set (S1109), and repeats the processing from S1101. On the other hand, when the processing of S1107 or S1108 is completed, the microcomputer 213 repeats the processing from S1105. By such processing, control of the motion analysis apparatus 2 by the microcomputer 213 according to the present embodiment is executed.

  Next, the recording process of S1107 according to the present embodiment, that is, the recording process of a signal input when the user operates the touch panel 142 or the key switch 143 will be described with reference to FIG. FIG. 12 is a flowchart showing operations of the microcomputer 213 and the PC 230 in the recording process according to the present embodiment. The microcomputer 213 according to the present embodiment starts the recording process by receiving a recording start command from the PC 230.

  In this case, the microcomputer 213 controls the switch circuit 211 so that the input side and the control side of the connector 145 are connected. Accordingly, a signal input by the user operating the touch panel 144 or the key switch 143 is input to the main control unit 146 via the switch circuit 211 in the same manner as a normal operation. At the same time, the control signal output from the main control unit 146 is input to the ADC 144 or the key switch 143 via the switch circuit 211. A signal exchanged between the main control unit 146 and the ADC 144 or the key switch 143 is input to the microcomputer 213 via the switch circuit 211 and the FPGA 212.

  As shown in FIG. 12, the microcomputer that has started the recording process first starts a timer count and transmits a timer count start synchronization signal to the PC 230 (S1201). The microcomputer 213 confirms that the mode is the recording mode (S1202 / YES), and responds to signals input from the key switch 143 and the touch panel 142 until a recording end command is received from the PC 230 (S1203 / NO). This corresponds to the interrupt processing executed by the main control unit 146 (S1206). Thereafter, the processing from S1202 is repeated.

  On the other hand, when a recording end command is received from the PC 230 (S1203 / YES), the microcomputer 213 shifts to a standby mode (mode = WAIT) (S1204) and stops the timer count (S1205). Then, returning to the processing of S1202, when it is confirmed that the standby mode is set (S1202 / YES), the processing is terminated. On the other hand, the PC 230 that has received the timer count start synchronization signal from the microcomputer 213 starts the timer count in accordance with the synchronization signal (S1207).

  As described above, the recording start command is output in response to the user's operation on the PC 230, but as described above, from when the microcomputer 213 receives the recording start command until the timer count is actually started. Since the switch circuit 211 is switched, there is a time lag. Therefore, if the PC 230 starts the timer count immediately after the user performs a recording start operation on the PC 230, the timer count value of the PC 230 and the timer count value of the microcomputer 213 are shifted.

  On the other hand, when the PC 230 starts the timer count in accordance with the synchronization signal from the microcomputer 213, it is possible to prevent the timer count value from shifting. When the timer count is started, the PC 230 responds to operations on the PC 230 such as a print-out to the image forming apparatus 1 and network access until the user performs an operation to end recording (NO in S1208), and performs the operation. The recording process is repeated (S1211). Recording an operation on the PC 230 in S1211 is one of the sheets according to the present embodiment.

  When the user performs a recording end operation (S1208 / YES), the PC 230 transmits a recording end command to the microcomputer 213 (S1209). This is a command determined in S1203. Thereafter, the PC 230 stops the timer count (S1210) and ends the process.

  Next, interrupt processing corresponding to the operation of the key switch 143 will be described with reference to FIG. 13 as processing of S1206. The microcomputer 213 detects the interruption of the key switch operation at the fall of any of the key press detection control signal lines SCAN0 to SCAN3 or the rise of any of the key press detection signal lines KEY0 to 7 controlled by the main control unit 146.

  The falling edge of any one of the above SCAN0 to 3 is a case where the signal is changed from “High” to “Low”. Specifically, as described with reference to FIG. 7, when the user presses the key switch and one of the keys KEY 0 to 7 becomes “Low”, the main control unit 146 sets all the SCANs 0 to 3 to “High”. In this case, SCAN 0 to 3 are sequentially set to “Low” one by one to check the signal state of KEY 0 to 7 (hereinafter referred to as a key scan operation).

  On the other hand, the rise of KEY 0 to 7 is when the signal changes from “Low” to “High”. Specifically, as described with reference to FIG. 7, any one of the KEYs 0 to 7 that has become “Low” when the user presses the key switch again releases “High” when the user releases the key switch. This is the case.

  When the microcomputer 213 detects the falling edge of any one of the SCANs 0 to 3 (S1301 / YES), the microcomputer 213 recognizes which of the SCANs 0 to 3 has fallen, and sets the falling number to “(N)”. Note that the processing of S1301 occurs not only by a key scan operation in response to a user pressing a key switch, but also by a key scan operation every 200 ms by the main control unit 146 as described above.

  The microcomputer 213 that has detected the interruption waits for 500 μs (S1302), and then records the signal states of KEY0 to KEY7 as DATA (N) (S1303). For example, if the falling edge of SCAN0 is detected in S1301, it is recorded as DATA0. Note that when recording DATA (N), the microcomputer 213 records the count value of the timer in association with the data. The count value of the timer is used as information for determining the reproduction timing when reproducing the key operation.

  When the recording of DATA (N) is completed, the microcomputer 213 determines whether “(N)” is “3”, that is, whether the key scan operation by the main control unit 146 is completed for one cycle of SCAN0 to SCAN3. It is confirmed whether or not (S1304). If “(N)” is not “3” (S1304 / NO), the microcomputer 213 determines that the key scan operation for one cycle has not yet been completed, and ends the processing as it is. In this case, the microcomputer 213 returns to S1202 in FIG. 12, detects the falling edge of any one of the SCANs 0 to 3 again by the key scan operation that is continuously executed by the main control unit 146, and executes the process in FIG.

  If “(N)” is “3” (S1304 / YES), then the microcomputer 213 checks whether DATA0 to DATA3 are the same as DATA0 to 3 recorded last time (S1305). If DATA0 to DATA3 are the same as the previous data (S1305 /), the microcomputer 213 determines that the data of the key operation is not required to be recorded, discards the data (S1306), and ends the processing. . By such processing, the amount of key operation data recorded in the PC 230 can be reduced. In addition, as described with reference to FIG. 7, the main control unit 146 executes the key scan operation for two cycles at an interval of 10 ms. In this case as well, only one piece of information is recorded, and the amount of information can be reduced. .

  On the other hand, if DATA0 to 3 are different from the previous data, the microcomputer 213 transmits operation information indicating the operation of the key switch recognized by DATA0 to 3 recorded this time to the PC in association with the time stamp (S1307). Exit. In addition, when any of SCAN to 3 falls (S1301 / NO), and any of KEY0 to 7 rises is detected and KEY0 to 7 all become "High" (ALL High) (S1308 / YES) The microcomputer 213 recognizes that the key switch has been released, transmits information indicating the key release operation to the PC 230 in association with the time stamp (S1309), and ends the process. Note that the determination in S1308 is performed when a key scan operation is not being performed. In S1307 and S1309, the information transmitted by the microcomputer 213 is stored in the HDD of the PC 230 as reproduction information for reproducing one operation. That is, the microcomputer 213 functions as a reproduction information storage processing unit. With this process, the key switch operation recording process is completed.

  Next, interrupt processing corresponding to the operation of the touch panel 142 will be described with reference to FIG. 14 as processing of S1206. The microcomputer 213 detects an interruption of the touch panel operation based on a coordinate detection command input to the ADC 144 by the main control unit 146 as a control signal, that is, a signal output from the main control unit 146 in S601 of FIG.

  When the microcomputer 213 receives a coordinate detection command and detects an interrupt (S1401), the microcomputer 213 waits until a digital signal is received from the ADC 144 (S1402 / NO), and receives a digital signal (S1402 / YES). It is recorded as operation data (S1403). When the operation data is recorded, the microcomputer 213 determines whether or not the coordinate determination condition is satisfied by the same processing as S605 of FIG. 6 and S506 of FIG. 5 (S1404). If the coordinate determination condition is satisfied (S1404 / YES), the microcomputer 213 transmits the coordinate data obtained as an average value to the PC 230 as operation information indicating an operation on the touch panel 142 (S1405), and ends the process.

  In step S <b> 1405, the microcomputer 213 associates the coordinate data and the time stamp and transmits them to the PC 230. This information is stored in the HDD of the PC 230 as reproduction information for reproducing one operation. On the other hand, if the coordinate determination condition is not satisfied (S1404 / NO), the process is terminated as it is. In this case, the microcomputer 213 returns to S1202 in FIG. 12, and executes the process in FIG. 14 again according to the coordinate detection command that is continuously output from the main control unit 146. With such a process, the touch panel operation recording process is completed.

  13 and 14 are repeated according to the flow of FIG. 12, reproduction information for reproducing an operation on the touch panel 142 or the key switch 143 is accumulated in the HDD of the PC 230. By using the reproduction information accumulated in this way, a series of operations by the user can be reproduced.

13 and 14, the USB protocol analyzer 220 analyzes and records information exchanged between the main control unit 146 and the operation display control unit 105 (hereinafter referred to as internal information). And stored in the HDD of the PC 230. This internal information includes information exchanged between the main control unit 146 and the operation display control unit 105 and information on the timing of the exchange, and when the operation is reproduced based on the operation information recorded later, Is used to confirm whether or not is accurately reproduced.

  Next, the reproduction process of S1108 according to the present embodiment, that is, the process of reproducing the operation by the user according to the information stored in the PC 230 by the recording process will be described with reference to FIG. As shown in FIG. 15, first, in the PC 230, the control application 231 transmits reproduction data for the buffer size of the microcomputer 213 (S1515). That is, the control application 231 functions as an operation reproduction information transmission unit. As a result, the microcomputer 213 obtains reproduction data, which is operation information to be reproduced, from the PC 230 (S1501). The reproduction data exchanged in S1501 is information recorded by the microcomputer 213 by the above-described processing of FIGS. 12 to 14 and stored as reproduction information in the HDD of the PC 230. Information on the operation to be reproduced and the count value of the timer This is information associated with a time stamp corresponding to.

  When the reproduction data is acquired, the microcomputer 213 switches the switch circuit 211 to disconnect the input side and the control side of the controller 141, starts the timer count, and transmits a timer count start synchronization signal to the PC 230 (S1502). ). As described above, also in the reproduction process of the operation, the PC 230 starts the timer count in accordance with the synchronization signal from the microcomputer 213, so that the deviation of the timer count value between the microcomputer 213 and the PC 230 can be prevented.

  When the timer count is started, the microcomputer 213 compares the count value of the timer with the time stamp of the reproduction data in the operation of the display panel 140, and monitors the coincidence between them (S1503). If the timer counter matches the time stamp (S1503 / YES), the microcomputer 213 determines whether or not reproduction of the previous stage reproduction data has been completed (S1504), and if it has not been completed (S1504 / NO), it is completed. Wait until If the reproduction data is the first one and there is no previous reproduction data, the process proceeds directly to the next process.

  The reason for providing the process of S1504, that is, the process of waiting until the reproduction of the previous stage of reproduction data is completed mainly focuses on the state of the control means such as the CPU that controls the main control unit 146. Since the control means such as the CPU differs depending on the operation of the apparatus, the main control unit 146 does not always return a response with the same response time even when the same operation is performed. Therefore, the operation cannot be reproduced according to the time stamp of the reproduction data, and the operation may be delayed.

  In such a case, if the processing is performed according to the time stamp of the reproduction data, the subsequent operation is input before the previous operation is reproduced, and as a result, the recorded operation procedure is accurately reproduced. I can't do that. Therefore, in the motion analysis apparatus 2 according to the present embodiment, such a problem is solved by performing the process of S1504.

  If the reproduction of the previous stage reproduction data has been completed (S1504 / YES), the microcomputer 213 confirms whether or not the reproduction data of the time stamp that matches the timer counter value is key operation data (S1505). If it is key operation data (S1505 / YES), the microcomputer 213 reproduces the key operation based on the reproduction data (S1506). Details of reproduction of key operations will be described later.

  On the other hand, if the result of the confirmation in S1505 is panel operation data instead of key operation (S1505 / NO), the microcomputer 213 reproduces the panel operation based on the reproduction data (S1507). Details of the panel operation reproduction will be described later. When reproduction of the operation is started in S1506 or S1507, the microcomputer 213 determines whether or not end data indicating the end of the reproduction data has already been received (S1508). In S1503, if the timer counter has not reached the time stamp of the reproduction data (S1503 / NO), the process also proceeds to S1508.

  If the end data has already been received as a result of the determination in S1508 (S1508 / YES), the microcomputer 213 determines whether or not the end of the reproduction data has been reached (S1512). (S1508 / YES), a transition is made to the standby mode (mode = WAIT) (S1513), the timer is stopped and a timer stop synchronization signal is transmitted to the PC 230 (S1514), and the process is terminated. On the other hand, if the terminal data has not been reached (S1512 / NO), the processing from S1503 is repeated.

  If the termination data has not been received as a result of the determination in S1508 (S1508 / NO), the microcomputer 213 checks whether or not the free space of the buffer is equal to or larger than a predetermined amount (S1509). The process proceeds to S1512. On the other hand, when the free space of the buffer is equal to or larger than the predetermined amount (S1509 / YES), the microcomputer 213 notifies the free space of the buffer to the PC 230 (S1510). As a result of S1510, the reproduction data not yet received from the PC 230 is transmitted, and the microcomputer 213 acquires the reproduction data (S1511). Thereafter, the process proceeds to S1512.

  On the other hand, in the PC 230, after the process of S1515, the control application 231 starts a timer count according to the synchronization signal transmitted from the microcomputer 213 (S1516). When the timer count is started, the PC 230 compares the count value of the timer with the time stamp of the reproduction data in the operation on the PC 230 and monitors the coincidence (S1517), similarly to the microcomputer 213. If the timer counter matches the time stamp (S1517 / YES), the PC 230 reproduces the operation based on the reproduction data (S1518).

  After reproducing the operation on the PC in S1518, or when the timer counter has not reached the time stamp of the reproduction data in S1517 (S1517 / NO), the PC 230 has not yet transmitted to the microcomputer 213. It is determined whether there is data (S1509). If there is untransmitted reproduction data (S1509), the PC 230 determines whether or not there is a free space notification notified from the microcomputer 213 in S1510 (S1520), and if a free space notification is received (S1520 / YES), The reproduction data corresponding to the notified free space is transmitted (S1521).

  When the reproduction data is transmitted to the microcomputer 213, the PC 230 determines whether or not a timer stop synchronization signal transmitted from the microcomputer 213 is received in S1514 (S1522). Note that if there is no untransmitted data as a result of the determination in S1519 (S1519 / NO), or if no free space notification has been received (S1520 / NO), the process also proceeds to S1522.

  If it is determined in S1522 that the timer stop synchronization signal has not been received (S1522 / NO), the PC 230 repeats the processing from S1517. On the other hand, if the timer stop synchronization signal is received (S1522 / YES), the PC 230 stops the timer count (S1523) and ends the process.

  Next, the key operation reproduction process of S1506 will be described with reference to FIG. FIG. 16 is a flowchart showing key operation reproduction processing according to this embodiment. As shown in FIG. 16, the microcomputer 213 first sets any one of the KEYs 0 to 7 maintained at “High” to “Low” (S1601). This reproduces a state in which any one of KEYs 0 to 7 connected to the pressed key switch becomes “Low” when the user presses the key switch. At this time, which of the KEYs 0 to 7 is set to “Low” is not a problem in the configuration of the main control unit 146 according to the present embodiment. Alternatively, the same signal line may always be “Low”.

  By dropping any one of KEY0 to KEY7, as described in FIG. 7, the main control unit 146 performs the key scan operation, so that SCAN0 to DOWN3 are sequentially dropped. When the microcomputer 213 detects the falling edge of the SCAN (N) (S1602 / YES), the microcomputer 213 determines the DATA (N), that is, the operation signal from the information recorded as the reproduction data corresponding to the SCAN (N) where the falling edge is detected. Is generated and output (S1603).

  If “(N)” is any one of 0 to 2, since the main control unit 146 is executing a key scan operation, one of the SCANs 0 to 3 is “Low” and the others are “High”. The state continues (S1604 / NO). In this case, the microcomputer 213 repeats the processing from S1602. On the other hand, when the key scanning operation of the main control unit 146 is completed, the main control unit 146 sets all the SCANs 0 to 3 to “Low”. When the microcomputer 213 detects that all of the SCANs 0 to 3 are “Low” (S1604 / YES), the microcomputer 213 performs AND outputs of DATA0 to DATA3 to the KEYs 0 to 7 (S1605).

  As described in FIG. 7, the main control unit 146 performs the key scan operation for two cycles at 10 ms intervals. Therefore, it is necessary to cope with the key scan operation for two cycles in reproducing the key operation. Therefore, the microcomputer 213 repeats the processing of S1602 to S1605 until data output for two cycles is completed (S1606 / NO). When the processing for two cycles is completed (S1606 / YES), the key operation reproduction operation using the key operation data is ended. In addition to the processing shown in FIG. 16, when the key operation data is a key release operation, the microcomputer 213 outputs a signal corresponding to the key release operation instead of the processing of FIG.

  Next, the panel operation reproduction process of S1507 will be described with reference to FIG. FIG. 17 is a flowchart showing a panel operation reproduction process according to this embodiment. As shown in FIG. 17, the microcomputer 213 first transmits a signal that reproduces the touch detection signal (S1701). This reproduces the process in which the touch detection signal becomes “Low” in S501 of FIG.

  When the touch detection signal becomes “Low”, as described in FIG. 5, the main control unit 146 starts the coordinate measurement process, and outputs the coordinate detection command as described in FIG. When receiving the coordinate detection command from the main control unit 146 (S1702 / YES), the microcomputer 213 transmits the coordinate data recorded as the reproduction data (S1703). Thereby, the main control unit 146 acquires the coordinate data, and executes the processing of S602 and S603 in FIG.

  As described in FIGS. 5 and 6, the main control unit 146 performs eight detections three times at 10 ms intervals, that is, at least 24 coordinate detections in order to determine the coordinates. Accordingly, the microcomputer 213 repeats transmission of coordinate data as reproduction data in accordance with the coordinate detection command until the condition for the main control unit 146 to determine the coordinates is satisfied (S1704 / NO). Then, when the coordinate determination condition by the main control unit 146 is satisfied (S1704 / YES), the process ends. With this process, the panel operation reproduction process is completed.

  As described above, the processes of FIGS. 16 and 17 are repeated a plurality of times as long as key operation data or panel operation data is included in the reproduction data in the process of FIG. 15, that is, the operation reproduction process based on the reproduction data. Executed. Thereby, the operation recorded as reproduction data is automatically reproduced by the control of the microcomputer 213 without the user directly operating the display panel 140.

  As described above, in the reproduction processing according to the present embodiment, information generated when the touch panel 142 or the key switch 143 is operated is stored in the main control unit 146 or the controller 100 of the image forming apparatus 1 as in the related art. Instead of reproducing the operation by generating and transmitting it to the operation display control unit 105, the signal input to the main control unit 146 when the touch panel 142 and the key switch 143 are operated is acquired and recorded. The operation is reproduced by inputting the recorded signal to the main control unit 146. At the same time, printout print jobs input to the image forming apparatus 1 and operations such as network access are also stored on the PC 230 and input to the image forming apparatus 1 in synchronization with the operation on the display panel 140. . Thereby, the conditions at the time of failure occurrence can be reproduced more faithfully.

  Furthermore, when the user causes the microcomputer 213 and the PC 230 to execute the reproduction process of FIG. 15, the user can repeatedly execute an operation based on the reproduction information. In order for the microcomputer 213 and the PC 230 to automatically repeat the operation of FIG. 15 to reproduce a failure that has occurred in the image forming apparatus 1 and has a low reproducibility, it is necessary to repeat the same operation numerous times. In some cases, necessary operations can be simplified and the burden on the user can be reduced. It should be noted that the repetition of the reproduction of the operation based on the reproduction information can be executed by specifying the number of repetitions in addition to the case of executing the operation endlessly without specifying the number of times.

  16 and 17, the USB protocol analyzer 220 acquires and analyzes internal information exchanged between the main control unit 146 and the operation display control unit 105, and the above-described FIGS. It is confirmed whether or not it matches the internal information stored in the process of 14. As a result, it is possible to confirm that the operation is accurately reproduced when the two match, and to recognize that the operation is not accurately reproduced when the internal information is different.

  As described above, in the reproduction of the operation, the timing of the signal may be different depending on the state of the CPU or the like that controls the main control unit 146. Therefore, the timing of the information exchanged in the reproduction of the operation is the PC 230. The timing in the internal information stored in the HDD may be different. Therefore, the USB protocol analyzer 220 determines the match of the internal information in consideration of the case where the timing of the signal is deviated when determining the match of the internal information.

  As described above, in the present embodiment, it is possible to improve the reproducibility of a failure in an operation analysis device for reproducing and analyzing a failure that has occurred in the image forming apparatus. Also, as shown in FIG. 10, by providing an interface for connecting the two, such as a connector 145 provided on the image forming apparatus 1 side and a switch circuit 211 provided on the operation analysis apparatus 2 side, the apparatus Thus, there is no need for work such as emptying the housing, selecting the internal signal lines and connecting the signal extraction lines, and the work for the operation analysis can be performed more easily.

  In the above embodiment, as shown in FIG. 10, the USB protocol analyzer 220 compares the internal information in the operation recording process with the internal information in the operation reproduction process, thereby confirming the reproducibility of the operation. The case where it does is demonstrated as an example. In addition, various means can be used to confirm the reproducibility of the operation. In the following, another means for confirming the reproducibility of operations will be described.

  The image forming apparatus 1 is provided with light emitting units such as a plurality of LEDs (Light Emitting Diodes) at various locations in the apparatus, and emits light in response to a user operation. Therefore, it is possible to check the reproducibility of the operation by monitoring the control signal to each light emitting unit by the main control unit 146 in the same manner as the internal information in the USB protocol analyzer. Such an aspect will be described with reference to FIG.

  FIG. 18 is a diagram illustrating an example of a connection relationship of the light emitting unit 147 by the main control unit 146. In the example of FIG. 18, eight LEDs are connected to each of the LED scan signal lines LSC0 to LSC3 connected to the main control unit 146. The other end of the LED is connected to one of the LED control signal lines LEDC0 to LEDC7, and 32 LEDs as a whole are connected and arranged on the matrix.

  As shown in FIG. 18, LSC0 to LSC3 are connected to the bases of pnp transistors, respectively. The emitter of the pnp transistor is connected to a high potential, and eight LEDs are connected in parallel to the collector. The LEDs C0 to 7 are respectively connected to the bases of npn transistors. The emitter of the npn transistor is connected to the system ground, and four LEDs are connected in parallel to the collector.

  In such a configuration, the main control unit 146 causes the desired LED to emit light by setting the LSC connected to the LED to emit light to “Low” and the LEDC to “High”. In such a connection relationship, the operation analysis device 2 acquires and stores the signals between the pnp type transistor and the npn type transistor and the main control unit 146, and thus operates similarly to the USB protocol analyzer 220 described above. Reproducibility can be confirmed.

  In addition to such an aspect, for example, it is conceivable that the display of the display unit such as the LCD 70 provided in the display panel 140 changes according to an operation by the user. Therefore, the motion analysis apparatus 2 acquires a control signal for the main control unit 146 to control the display unit, and performs the same processing as that of the USB protocol analyzer 220 described above. The reproducibility of the operation can be confirmed.

  In the above-described embodiment, an example in which the start of operation recording and the reproduction of recorded operations are controlled via the dedicated control application 231 that operates on the PC 230 that operates as a part of the motion analysis apparatus 2 has been described as an example. . Details thereof will be described with reference to FIG. FIG. 19 is a diagram illustrating an example of a GUI (Graphical User Interface) 231a of the control application 231 displayed on the display unit of the PC 230 in order to control the reproduction of operations on the microcomputer 213 and the PC 230.

  As shown in FIG. 19, the GUI 231a includes a control button 231b and a sequence display unit 231c. The control button 231b is a user interface for the user to operate the PC 230 to give a command to the control application 231. The buttons included in the control button 231b include transmission of a recording start command in S1101 in FIG. 11, transmission of a reproduction command in S1102, transmission of a recording end command in S1203 in FIG. 12, transmission of a frame advance command for reproduction, and loop reproduction command. There are buttons for transmitting the playback data, transmitting the reproduction data acquisition command of S1501 in FIG. 15, and transmitting the stored operation information storage command.

  Of each of the above processes, the playback frame advance command does not automatically execute the playback data sequentially as described with reference to FIG. 15, but performs frame-by-step playback executed while stopping for each playback data. The command to be executed. Specifically, in the case of frame-by-frame playback, the microcomputer 213 does not reproduce the operation based on the operation information according to the count value of the timer, as described in S1502, S1503, S1516, and S1517 in FIG. Reproduce the operation in the order of the time stamp included in the information. At this time, instead of automatically reproducing the operation, the next time stamp operation is performed every time the above-described reproduction frame advance command is input by the user. By enabling such frame-by-frame playback, it is possible to improve user convenience in investigating the cause of a failure.

  The sequence display unit 231c is a display unit that indicates the contents of the reproduction data stored in the HDD 232 of the PC 230 by the processing of FIG. 12, that is, the operation reproduction information and the network instruction reproduction information. As shown in FIG. 19, the operation reproduction information and the network instruction reproduction information are used for one operation on the touch panel 142 or the key switch 143, operations on the PC 230 such as printout from the PC 230 to the image forming apparatus 1 and network access. Information for reproduction is accumulated information and is stored in the HDD 232 in association with a time stamp having a common time series.

  Among the reproduction information shown in FIG. 19, “ID” is identification information for identifying reproduction information for reproducing each operation. “Operation data type” and “value” are information indicating the contents of each operation, and are information processed as operation information in FIGS. 13 and 14. That is, the operation information included in the reproduction information transmitted to the PC 230 by the microcomputer 213 in S1307 of FIG. 13 or S1405 of FIG. 14, and the operation information recorded by the PC 230 in S1211 of FIG.

  The “operation data type” is information for identifying the type of operation on the touch panel 142, operation on the key switch 143, operation such as pressing or releasing a key on the key switch 143, printout on the PC, network access, and the like. . That is, the “operation data type” is information indicating whether the operation reproduction information is different from the network command information. “Value” is details in each operation, and is information indicating the coordinates on the panel in the case of a touch panel operation and the pressed key in the case of a key switch operation. The “time stamp” is information indicating each operation timing, and is associated with each operation information as described above.

  In such a GUI, the user can give a command to the user operation analysis / reproduction unit 210 by clicking each button displayed on the control button 231b to execute recording and reproduction of the user operation.

  As shown in the sequence display section 231c of FIG. 19, the HDD 232 of the PC 230 stores operation reproduction data on the PC 230 and operation reproduction data for the touch panel 142 and the key switch 143. . In S1515 of FIG. 15, the PC 230 transmits the reproduction data to the microcomputer 213, and the reproduction data transmitted at this time may be all the reproduction data stored in the HDD 232, or the reproduction data stored in the HDD 232 Of these, reproduction data other than the operation in the PC 230 may be used.

  Further, when recording and reproducing the operation in the present embodiment, the timer counter value in the PC 230 serving as a time stamp of a command such as printout from the PC 230 to the image forming apparatus 1 or network access, and the touch panel 142 or the key switch 143 are displayed. It is necessary that the timer counter value in the microcomputer 213 that is the time stamp of the operation information is accurately synchronized. For this reason, in this embodiment, a periodic synchronization process is performed. This synchronization processing will be described with reference to FIG.

  As shown in FIG. 20, the synchronization signal and timer counter value transmitted from the microcomputer 213 to the PC 230 serve as a trigger for starting the synchronization process. When the microcomputer 213 transmits a synchronization signal and a timer counter value to the PC 230 (S2001) and the control application 231 receives the PC 230 (S2005 / YES), the control application 231 uses the received timer counter value to set a timer counter on the PC side. The value is corrected (S2006). When the correction of the timer counter value is completed, the PC 230 transmits a response signal to the microcomputer 213 (S2007).

  When the microcomputer 213 transmits the synchronization signal and the timer counter value in S2001, after waiting for 10 seconds (S2002), the microcomputer 213 checks whether a response signal is received from the PC 230 during the standby 10 seconds (S2003). If there is a response within 10 seconds (S2003 / YES), it is recognized that the synchronization process has been completed normally, and the microcomputer 213 returns to S2001 and repeats the synchronization process.

  On the other hand, if there is no response within 10 seconds (S2003 / NO), it is recognized that the synchronization processing has not been completed normally, and the microcomputer 213 stops the operation recording or operation reproduction processing currently being executed, and waits. The mode is changed to mode (mode = WAIT) and the process is terminated (S2004).

  As described above, in the motion analysis apparatus 2 according to the present embodiment, the PC 230 and the microcomputer 213 are synchronized with each other at a predetermined period such as an interval of 10 seconds while the operation recording process and the operation reproduction process are being performed. Processing is executed. Therefore, synchronization between the timer counter value in the microcomputer 213 and the timer counter value in the PC 230 is maintained. As a result, when recording the operation, it is possible to prevent a deviation from occurring between the operation time stamp on the PC 230 and the operation time stamp on the touch panel 142 and the key switch 143. When reproducing the operation, the timing of a signal such as a printout or network access transmitted from the PC 230 to the image forming apparatus 1 via the network and the timing of the operation reproduction signal input from the microcomputer 213 to the display panel 140 are displayed. It is possible to prevent a deviation from occurring.

  In the above embodiment, the case where the PC 230 is used as an example of the configuration for controlling the operation of the motion analysis apparatus 2 has been described. For example, the user operation analysis / reproduction unit 210 or the USB protocol analyzer 220 is configured as a portable device such as a USB device or a serial interface connection device, and the notebook PC is used as the PC 230. This is effective in terms of carrying the analysis device 2. In addition, it is possible to use a dedicated information processing apparatus instead of the PC 230 as the control mechanism. Furthermore, such a dedicated information processing apparatus and the user operation analysis / reproduction unit 210 may be configured as an integrated device.

1 image forming apparatus,
2 motion analysis device,
10 CPU,
20 RAM,
30 ROM,
40 engines,
50 HDD,
60 I / F,
70 LCD,
80 operation unit,
90 bus,
100 controller,
101 Main control unit,
102 engine control unit,
103 I / O control unit,
104 image processing unit,
105 operation display control unit,
110 ADF,
120 scanner unit,
130 paper output tray,
140 display panel,
141 controller,
142 touch panel,
143 key switch,
144 ADC,
145 connector,
146 Main control unit,
147 light emitting unit,
150 paper feed table,
160 print engine,
170 paper output tray,
180 Network I / F,
210 User operation analysis / reproduction unit,
211 switch circuit,
212 FPGA,
213 microcomputer,
220 USB protocol analyzer,
230 PC,
231 control application,
231a GUI,
231b control button,
231c Sequence display section

JP 2006-221671 A

Claims (11)

An operation analysis apparatus that analyzes a user operation on an image forming apparatus having an operation unit and reproduces an operation of the image forming apparatus,
A connection unit connected so as to obtain a signal between the operation unit and an operation control unit that controls the operation unit;
An operation signal acquisition unit that acquires, via the connection unit, an operation signal that is a signal exchanged between the operation unit and the operation control unit when the user operates the operation unit;
An operation reproduction information storage processing unit for associating operation information based on the acquired operation signal with timing information indicating timing at which the operation signal is acquired and storing the operation information as operation reproduction information in a storage medium;
Network instruction reproduction information stored in a storage medium as network instruction reproduction information in association with network instruction information based on an instruction transmitted to the image forming apparatus via a network and timing information indicating a timing at which the instruction is transmitted A storage processing unit;
An operation reproduction unit that reproduces the operation of the image forming apparatus based on the stored operation reproduction information;
A network command reproduction unit that reproduces the operation of the image forming apparatus based on the stored network command reproduction information;
The connection unit is in a state in which the operation unit and the operation control unit are connected when the operation signal acquisition unit acquires the operation signal, and when the operation reproduction unit reproduces the operation, The state where the operation control unit is disconnected,
The network command reproduction unit starts counting the timing in response to the start of reproduction of the operation of the image forming apparatus, and when the timing indicated by the timing information is reached, based on the network command information associated with the timing information An operation analysis apparatus that generates a command transmitted via the network and transmits the command to the image forming apparatus via the network. The operation reproduction unit switches the connection state of the connection unit in response to the start of reproduction of the operation of the image forming apparatus and starts counting timing. When the timing indicated by the timing information is reached, the operation reproduction unit is associated with the timing information. Based on the operation reproduction information that is output to the operation control unit a signal to reproduce the operation of the operation unit by the user,
The network command reproduction information storage processing unit and the network command reproduction unit are configured by an information processing device, and the operation reproduction information storage processing unit, the connection unit, the operation signal acquisition unit, and the operation reproduction unit include the information Consists of hardware different from the processing device,
The operation reproduction unit starts counting the timing and outputs a synchronization signal of the timing count to the network instruction reproduction unit,
The motion analysis apparatus according to claim 1, wherein the network command reproduction unit starts counting timing according to the synchronization signal output from the operation reproduction unit. The operation reproduction unit notifies the information processing apparatus of a count value of a count of timing started in response to the start of reproduction of the operation of the image forming apparatus for each predetermined period;
The network instruction reproduction unit corrects the count value of the count at the timing started in response to the start of reproduction of the operation of the image forming apparatus based on the notified count value. Motion analysis device. The operation reproduction information storage processing unit notifies the network command reproduction information storage processing unit of a count value of timing for determining the timing at which the operation signal is acquired for each predetermined period,
The network command reproduction information storage processing unit corrects a timing count value for determining a timing at which a command is transmitted to the image forming apparatus via the network based on the notified count value. The motion analysis apparatus according to claim 2, wherein the motion analysis apparatus is characterized.   The motion analysis apparatus according to claim 1, wherein the operation reproduction information and the network instruction reproduction information are stored in association with common time-series timing information in the storage medium. The operation reproduction information and the network instruction reproduction information are stored in association with common time-series timing information in a storage medium provided in the information processing apparatus,
5. The motion analysis apparatus according to claim 2, further comprising an operation reproduction information transmission unit that transmits the operation reproduction information to the operation reproduction unit.   The operation reproduction information transmission unit transmits the operation reproduction information to the operation reproduction unit according to a capacity of a storage area for temporarily storing the operation reproduction information in hardware different from the information processing apparatus. The motion analysis apparatus according to claim 6. The operation reproduction unit periodically notifies the operation reproduction information transmission unit of a free space in a storage area for temporarily storing the operation reproduction information after starting the reproduction of the operation of the image forming apparatus,
The motion analysis device according to claim 7, wherein the operation reproduction unit transmits the operation reproduction information to the operation reproduction unit according to the notified free space. An information processing apparatus included in an operation analysis apparatus that analyzes a user operation on an image forming apparatus having an operation unit and reproduces an operation of the image forming apparatus,
An operation signal that is a signal exchanged between the operation unit and the operation control unit when a user operates the operation unit is a signal between the operation unit and the operation control unit that controls the operation unit. Operation reproduction information generated by associating the operation information indicating the operation by the user with the timing information indicating the timing at which the operation signal is acquired by acquiring through the connection unit connected so as to be acquired. A storage medium for storing
Network command reproduction for associating network command information based on a command transmitted to the image forming apparatus via a network with timing information indicating the timing at which the command is transmitted and storing it in the storage medium as network command reproduction information An information storage processing unit;
An operation reproduction information transmission unit that transmits the stored operation reproduction information to an operation reproduction unit that reproduces the operation of the image forming apparatus;
A network command reproduction unit that reproduces the operation of the image forming apparatus based on the stored network command reproduction information;
The operation reproduction information transmission unit transmits the operation reproduction information according to the start of reproduction of the operation of the image forming apparatus,
The network command reproduction unit starts counting the timing in response to the start of reproduction of the operation of the image forming apparatus, and when the timing indicated by the timing information is reached, based on the network command information associated with the timing information An information processing apparatus that generates a command transmitted via the network and transmits the command to the image forming apparatus via the network. An operation analysis method for reproducing an operation of the image forming apparatus by analyzing a user operation on the image forming apparatus having an operation unit,
When the user operates the operation unit via a connection unit that is connected so that the operation signal acquisition unit can acquire a signal between the operation unit and the operation control unit that controls the operation unit. Obtaining an operation signal which is a signal exchanged between the operation unit and the operation control unit;
The operation reproduction information storage processing unit associates the operation information based on the acquired operation signal with the timing information indicating the timing at which the operation signal is acquired, and stores it in the storage medium as operation reproduction information.
A network command reproduction information storage processing unit associates network command information based on a command transmitted to the image forming apparatus via a network and timing information indicating a timing at which the command is transmitted as network command reproduction information. Store it in a storage medium,
An operation reproduction unit reproduces the operation of the image forming apparatus based on the stored operation reproduction information,
A network command reproduction unit for reproducing the operation of the image forming apparatus based on the stored network command reproduction information;
The connection unit is in a state in which the operation unit and the operation control unit are connected when the operation signal acquisition unit acquires the operation signal, and when the operation reproduction unit reproduces the operation, The state where the operation control unit is disconnected,
The network command reproduction unit starts counting the timing in response to the start of reproduction of the operation of the image forming apparatus, and when the timing indicated by the timing information is reached, based on the network command information associated with the timing information An operation analysis method comprising generating a command transmitted via the network and transmitting the command to the image forming apparatus via the network. An operation analysis program for analyzing a user operation on an image forming apparatus having an operation unit and reproducing an operation of the image forming apparatus,
The operation unit and the operation control are performed by a user operating the operation unit via a connection unit that is connected so as to obtain a signal between the operation unit and an operation control unit that controls the operation unit. An operation signal that is a signal exchanged with a unit is acquired, and operation information based on the acquired operation signal is associated with timing information indicating a timing at which the operation signal is acquired, and is stored as operation reproduction information Memorizing steps,
Associating network command information based on a command transmitted to the image forming apparatus via a network with timing information indicating a timing at which the command is transmitted, and storing it in a storage medium as network command reproduction information;
Reproducing the operation of the image forming apparatus based on the stored operation reproduction information;
Regenerating the operation of the image forming apparatus based on the stored network instruction reproduction information, and causing the information processing apparatus to execute the step.
The step of storing the operation reproduction information in the storage medium includes the step of controlling the connection unit to connect the operation unit and the operation control unit,
The step of reproducing the operation of the image forming apparatus based on the operation reproduction information includes the step of controlling the connection unit to disconnect the operation unit and the operation control unit,
The step of reproducing the operation of the image forming apparatus based on the network command reproduction information includes a step of starting timing counting in response to the start of reproduction of the operation of the image forming apparatus, and a timing indicated by the timing information. Generating a command transmitted via the network based on network command information associated with the timing information, and transmitting the generated command to the image forming apparatus via the network. An operation analysis program characterized by including.

Images