JP5423348B2 - Motion analysis apparatus, motion analysis method, and motion analysis program - Google Patents

Description

  The present invention relates to a motion analysis apparatus, a motion analysis method, and a motion analysis program, and more particularly to a motion analysis apparatus that reproduces an operation performed by a user and analyzes the motion.

  In recent years, there has been a tendency to digitize information, and image processing apparatuses such as printers and facsimiles used for outputting digitized information and scanners used for digitizing documents have become indispensable devices. Such an image processing apparatus is often configured as a multifunction machine that can be used as a printer, a facsimile, a scanner, or a copier by providing an imaging function, an image forming function, a communication function, and the like.

  In such an image processing apparatus, a history of user operations is stored, and when a failure occurs, the user's operations are reproduced based on the stored operation history in order to investigate the cause of the failure. Have been proposed (see, for example, Patent Document 1 and Patent Document 2).

  In the technique disclosed in Patent Document 1, information on an event that occurs based on the operation content input by the user is recorded, the information recorded in this way is analyzed, and the user interface Run the program. Thus, the operation can be reproduced based on the history of the operation by the user.

  In the technique disclosed in Patent Document 2, operation history data including each operation item obtained by analyzing an operation code is recorded, and the operation history data recorded in such a manner is read to reproduce device driving. To do. Accordingly, it is possible to register and manage an operation history operated by a user who cannot be specified, and easily verify the driving state of each device based on a desired operation history.

  However, the methods disclosed in Patent Document 1 and Patent Document 2 are based on the premise that a configuration for recording and reproducing the operation contents is incorporated in the apparatus in advance. Therefore, it is difficult to apply to a conventional apparatus that does not have such a configuration, and if it is applied to a conventional apparatus, at least a software program for controlling the apparatus needs to be significantly changed.

  In addition, when reproducing the operation by the user by the methods disclosed in Patent Document 1 and Patent Document 2, the signal generated by the user operating the operation unit is reproduced by emulating based on the operation history. To do. Therefore, the function that operates based on the operation operates under conditions different from the normal operation, and the situation when the failure occurs cannot be faithfully reproduced.

  In addition, some failures that occur in the apparatus have low reproducibility. When analyzing such a failure, the user reproduces the failure by repeatedly performing an operation considered to be the cause of the failure. In such a case, when the technique described in Patent Document 1 or Patent Document 2 is used, the user needs to repeatedly perform an operation for selecting and executing an operation history to be executed from the recorded operation history. Therefore, the burden on the user is large and the processing becomes inefficient.

  The present invention has been made in consideration of the above circumstances, and in an operation analysis apparatus for reproducing and analyzing a failure occurring in an image forming apparatus, an operation for reproducing a failure with low reproducibility is simplified. In addition, it aims to reproduce the conditions at the time of failure more faithfully.

  In order to solve the above-described problem, an aspect of the present invention provides a motion analysis apparatus that analyzes a user's operation on an image forming apparatus having an operation unit and reproduces the operation, the operation unit and the operation unit being A connection unit connected so as to be able to acquire a signal between the operation control unit to be controlled, and a signal exchanged between the operation unit and the operation control unit when the user operates the operation unit An operation signal acquisition unit that acquires an operation signal via the connection unit, operation information based on the acquired operation signal, and timing information that indicates the timing at which the operation signal is acquired are stored as reproduction information in association with each other A reproduction information storage processing unit stored in a medium; and an operation reproduction unit that repeatedly reproduces an operation performed by a user based on the stored reproduction information, and the connection unit includes the operation signal acquisition unit. When the operation signal is acquired, the operation unit and the operation control unit are connected, and when the operation reproduction unit reproduces the operation, the operation unit and the operation control unit are disconnected. The operation reproduction unit starts counting the timing according to the operation reproduction command, and generates the operation signal based on the operation information associated with the timing information when the timing indicated by the timing information is reached. The generated operation signal is transmitted to the operation control unit via the connection unit.

  Here, the operation reproduction unit is associated with the timing information based on the count value of the timing and the timing indicated by the timing information according to the response signal of the operation control unit with respect to the transmitted operation signal. It is preferable that the operation signal is generated based on the operation information and transmitted to the operation control unit.

  The reproduction information storage processing unit may discard the operation signal acquired after the second time when the operation signal acquired continuously indicates the same state as the operation state of the operation unit. preferable.

  In addition, the operation reproducing unit, when reproducing the operation based on the operation information associated with the one timing information, when the timing count value reaches the timing indicated by the other timing information, the operation being reproduced It is preferable that the reproduction of the operation based on the operation information associated with the other timing information is started after the reproduction is completed.

  In addition, a control signal acquisition unit that acquires a control signal output by the user to operate the operation unit to control another part when the user operates the operation unit, and control information based on the acquired control signal A control information storage processing unit that stores in a storage medium in association with the reproduction information related to the operation by the user, and the control signal acquisition unit acquired when the operation reproduction unit reproduces the operation of the operation unit by the user A reproduction confirmation unit for confirming that the user's operation is accurately reproduced based on a difference between the control information based on the control signal and the control information stored in association with the reproduction information of the reproduced operation; It is preferable that it is further included.

  The control signal acquisition unit preferably acquires a signal that the operation control unit outputs to the control unit of the image forming apparatus main body when a user operates the operation unit.

  Further, it is preferable that the control signal acquisition unit acquires a signal output for the operation control unit to control the display unit of the image forming apparatus when a user operates the operation unit.

  Further, it is preferable that the control signal acquisition unit acquires a signal that the operation control unit outputs to control a light emitting unit provided in the image forming apparatus when a user operates the operation unit.

  Further, a power supply state detection unit that detects a state of power supplied to the control unit of the image forming apparatus main body and an external power supply unit that supplies power to the image forming apparatus from outside are connected to supply power from outside. A power supply switching unit that switches the state, and the reproduction information storage processing unit is a timing information that indicates operation information of power on / off based on the detected power state and timing when the power state is detected Is stored in a storage medium as reproduction information, and the operation reproduction unit controls the power supply switching unit when reproducing an operation by a user based on the reproduction information including operation information of turning on or off power. It is preferable to switch the power supply state from the outside.

  According to another aspect of the present invention, there is provided an operation analysis method for analyzing a user operation on an image forming apparatus having an operation unit and reproducing the operation, wherein the operation signal acquisition unit includes the operation unit and the operation unit. The operation unit is exchanged between the operation unit and the operation control unit by operating the operation unit via a connection unit connected so as to be able to acquire a signal between the operation control unit and the operation control unit. The reproduction information storage processing unit associates the operation information based on the acquired operation signal with the timing information indicating the timing at which the operation signal is acquired and stores it in the storage medium as reproduction information. And the operation reproduction unit repeatedly reproduces the operation by the user based on the stored reproduction information, and the operation reproduction unit acquires the operation signal by the operation signal acquisition unit. The operation unit and the operation control unit are connected, and when the operation reproduction unit reproduces the operation, the connection unit is controlled so that the operation unit and the operation control unit are disconnected. The timing is started in response to the operation reproduction command, and when the timing indicated by the timing information is reached, the operation signal is generated based on the operation information associated with the timing information, and the connection unit The generated operation signal is transmitted to the operation control unit via a network.

  According to still another aspect of the present invention, there is provided an operation analysis program for analyzing a user operation on an image forming apparatus having an operation unit and reproducing the operation, wherein the operation control controls the operation unit and the operation unit. An operation that is a signal that is exchanged between the operation unit and the operation control unit when a user operates the operation unit via a connection unit that is connected so as to obtain a signal between the operation unit and the operation unit. A step of acquiring a signal, a step of storing operation information based on the acquired operation signal and timing information indicating the timing at which the operation signal is acquired in association with each other in a storage medium, and the stored reproduction And causing the information processing apparatus to execute a step of reproducing the operation by the user based on the information, and the step of reproducing the operation by the user includes the operation signal. When the acquisition unit acquires the operation signal, the operation unit and the operation control unit are connected, and when the operation reproduction unit reproduces the operation, the operation unit and the operation control unit are disconnected. The step of controlling the connecting section so as to become, the step of starting the counting of the timing according to the reproduction instruction of the operation, and the operation associated with the timing information when the timing indicated by the timing information is reached The method includes generating the operation signal based on information, and transmitting the generated operation signal to the operation control unit via the connection unit.

  According to the present invention, in an operation analysis apparatus for reproducing and analyzing a failure that has occurred in an image forming apparatus, an operation for reproducing a failure with low reproducibility is simplified and the conditions at the time of occurrence of the failure are more faithful. Can be reproduced.

1 is a block diagram illustrating a hardware configuration of an image forming apparatus according to an embodiment of the present invention. 1 is a diagram illustrating a functional configuration of an image forming apparatus according to an embodiment of the present invention. FIG. 2 is a diagram illustrating a functional configuration of a display panel included in the image forming apparatus according to the embodiment of the present invention. It is a figure which shows the function structure of the touchscreen contained in the display panel which concerns on embodiment of this invention. 5 is a flowchart illustrating an operation of a controller of a touch panel included in the display panel according to the embodiment of the present invention. 5 is a flowchart illustrating an operation of a controller of a touch panel included in the display panel according to the embodiment of the present invention. It is a figure which shows the structure of the key switch which concerns on embodiment of this invention. It is a timing chart which shows the control signal in the press detection of the key switch concerning the embodiment of the present invention. It is a timing chart which shows the timing of pressing of the key switch which concerns on embodiment of this invention, and the detected key. It is a figure which shows the functional structure of the operation | movement analysis apparatus which concerns on embodiment of this invention, and a connection relationship with an image forming apparatus. It is a flowchart which shows the whole operation | movement of the operation | movement analysis apparatus which concerns on embodiment of this invention. It is a flowchart which shows the whole operation | movement of the recording process of the operation | movement analysis apparatus which concerns on embodiment of this invention. It is a flowchart which shows the recording process of the key switch operation of the motion analysis apparatus which concerns on embodiment of this invention. It is a flowchart which shows the recording process of the touch panel operation of the motion analysis apparatus which concerns on embodiment of this invention. It is a flowchart which shows the whole operation | movement of the reproduction | regeneration processing of the operation | movement analysis apparatus which concerns on embodiment of this invention. It is a flowchart which shows the reproduction process of the key switch operation of the motion analysis apparatus which concerns on embodiment of this invention. It is a flowchart which shows the reproduction process of the touch panel operation of the motion analysis apparatus which concerns on embodiment of this invention. It is a figure which shows the structure of the light emission part which concerns on embodiment of this invention. It is a figure which shows the recording / reproducing mechanism of the power supply operation of the motion analysis apparatus which concerns on embodiment of this invention. It is a figure which shows GUI of the control application displayed on PC concerning embodiment of this invention.

  Hereinafter, embodiments of the present invention will be described in detail with reference to the drawings. In the present embodiment, an operation analysis apparatus that reproduces a failure occurring in an image forming apparatus as an MFP (Multi Function Peripheral) including functions of a printer, a scanner, a copier, etc. and analyzes the operation will be described as an example. To do.

  FIG. 1 is a block diagram illustrating a hardware configuration of an image forming apparatus 1 that is an object of motion analysis. As shown in FIG. 1, the image forming apparatus 1 according to the present embodiment includes an engine that executes image formation in addition to the same configuration as an information processing terminal such as a general server or a PC (Personal Computer). That is, the image forming apparatus 1 according to the present embodiment includes a CPU (Central Processing Unit) 10, a RAM (Random Access Memory) 20, a ROM (Read Only Memory) 30, an engine 40, a HDD (Hard Disk Drive) 50, and an I / O. F60 is connected via the bus 90. Further, an LCD (Liquid Crystal Display) 70 and an operation unit 80 are connected to the I / F 60.

  The CPU 10 is a calculation unit and controls the operation of the entire image forming apparatus 1. The RAM 20 is a volatile storage medium capable of reading and writing information at high speed, and is used as a work area when the CPU 10 processes information. The ROM 30 is a read-only nonvolatile storage medium and stores a program such as firmware. The engine 40 is a mechanism that actually executes image formation in the image forming apparatus 1.

  The HDD 50 is a non-volatile storage medium that can read and write information, and stores an OS (Operating System), various control programs, application programs, and the like. The I / F 60 connects and controls the bus 90 and various hardware and networks. The LCD 70 is a visual user interface for the user to check the state of the image forming apparatus 1. The operation unit 80 is a user interface such as a keyboard and a mouse for the user to input information to the image forming apparatus 1.

  In such a hardware configuration, a program stored in a recording medium such as the ROM 30 or the HDD 50 or an optical disk (not shown) is read out to the RAM 20 and operates according to the control of the CPU 10 to constitute a software control unit. A functional block that realizes the functions of the image forming apparatus 1 according to the present embodiment is configured by a combination of the software control unit configured as described above and hardware.

  Next, the functional configuration of the image forming apparatus 1 according to the present embodiment will be described with reference to FIG. FIG. 2 is a block diagram illustrating a functional configuration of the image forming apparatus 1 according to the present embodiment. As shown in FIG. 2, the image forming apparatus 1 according to the present embodiment includes a controller 100, an ADF (Auto Document Feeder) 110, a scanner unit 120, a paper discharge tray 130, a display panel 140, and a paper feed table. 150, a print engine 160, a paper discharge tray 170, and a network I / F 180.

  The controller 100 includes a main control unit 101, an engine control unit 102, an input / output control unit 103, an image processing unit 104, and an operation display control unit 105. As shown in FIG. 2, the image forming apparatus 1 according to the present embodiment is configured as a multifunction machine having a scanner unit 120 and a print engine 160. In FIG. 2, the electrical connection is indicated by solid arrows, and the flow of paper is indicated by broken arrows.

  The display panel 140 is an output interface that visually displays the state of the image forming apparatus 1 and is an input when the user directly operates the image forming apparatus 1 or inputs information to the image forming apparatus 1 as a touch panel. It is also an interface (operation unit). The network I / F 180 is an interface for the image forming apparatus 1 to communicate with other devices via the network, and an Ethernet (registered trademark) or USB (Universal Serial Bus) interface is used.

  The controller 100 is configured by a combination of software and hardware. Specifically, a control program such as firmware stored in a ROM 30, a nonvolatile memory, and a nonvolatile recording medium such as the HDD 50 or an optical disk is loaded into a volatile memory (hereinafter referred to as a memory) such as the RAM 20, and is controlled by the CPU 10. The controller 100 is configured by a software control unit configured according to the above and hardware such as an integrated circuit. The controller 100 functions as a control unit that controls the entire image forming apparatus 1.

  The main control unit 101 plays a role of controlling each unit included in the controller 100, and gives a command to each unit of the controller 100. The engine control unit 102 serves as a drive unit that controls or drives the print engine 160, the scanner unit 120, and the like. The input / output control unit 103 inputs a signal or a command input via the network I / F 180 to the main control unit 101. The main control unit 101 also controls the input / output control unit 103 to access other devices via the network I / F 180.

  The image processing unit 104 generates drawing information based on the print information included in the input print job, under the control of the main control unit 101. The drawing information is information for drawing an image to be formed in the image forming operation by the print engine 160 as an image forming unit. The print information included in the print job is information that has been converted into a format that can be recognized by the image forming apparatus 1 by a printer driver installed in an information processing apparatus such as a PC. PDL (Page Description Language), Information such as Postscript, PCL (Printer Command Language), and RPCS. The operation display control unit 105 displays information on the display panel 140 or notifies the main control unit 101 of information input via the display panel 140.

  When the image forming apparatus 1 operates as a printer, first, the input / output control unit 103 receives a print job via the network I / F 180. The input / output control unit 103 transfers the received print job to the main control unit 101. When receiving the print job, the main control unit 101 controls the image processing unit 104 to generate drawing information based on the print information included in the print job.

  When drawing information is generated by the image processing unit 104, the engine control unit 102 executes image formation on a sheet conveyed from the paper feed table 150 based on the generated drawing information. That is, the print engine 160 functions as an image forming unit. As a specific mode of the print engine 160, an image forming mechanism using an ink jet method, an image forming mechanism using an electrophotographic method, or the like can be used. The document on which the image has been formed by the print engine 160 is discharged to the discharge tray 170.

  When the image forming apparatus 1 operates as a scanner, the operation display control is performed according to a user operation on the display panel 140 or a scan execution instruction input from an information processing terminal for an external client via the network I / F 180. The unit 105 or the input / output control unit 103 transfers a scan execution signal to the main control unit 101. The main control unit 101 controls the engine control unit 102 based on the received scan execution signal.

  The engine control unit 102 drives the ADF 110 and conveys the document to be imaged set on the ADF 110 to the scanner unit 120. Further, the engine control unit 102 drives the scanner unit 120 and images a document conveyed from the ADF 110. If no original is set on the ADF 110 and the original is set directly on the scanner unit 120, the scanner unit 120 images the set original according to the control of the engine control unit 102. That is, the scanner unit 120 operates as an imaging unit.

  In the imaging operation, an imaging element such as a CCD included in the scanner unit 120 optically scans the document, and imaging information generated based on the optical information is generated. The engine control unit 102 transfers the imaging information generated by the scanner unit 120 to the image processing unit 104. The image processing unit 104 generates image information based on the imaging information received from the engine control unit 102 according to the control of the main control unit 101. Image information generated by the image processing unit 104 is stored in a storage medium attached to the image forming apparatus 1 such as the HDD 40. That is, the scanner unit 120, the engine control unit 102, and the image processing unit 104 work together to function as a document reading unit.

  The image information generated by the image processing unit 104 is stored in the HDD 40 or the like as it is according to a user instruction or transmitted to an external device via the input / output control unit 103 and the network I / F 180. That is, the scanner unit 120 and the engine control unit 102 function as an image input unit.

  Further, when the image forming apparatus 1 operates as a copying machine, the image processing unit 104 generates drawing information based on imaging information received by the engine control unit 102 from the scanner unit 120 or image information generated by the image processing unit 104. To do. Based on the drawing information, the engine control unit 102 drives the print engine 160 as in the case of the printer operation.

  With respect to such an image forming apparatus 1, the motion analysis apparatus according to the present embodiment is connected so as to be able to acquire a signal inside the display panel 140. First, the configuration of the display panel 140 will be described with reference to FIG. FIG. 3 is a diagram illustrating a functional configuration as an operation unit and a connection relationship with the operation display control unit 105 in the configuration of the display panel 140 according to the present embodiment.

  As shown in FIG. 3, the display panel 140 according to this embodiment includes a controller 141, a touch panel 142, a key switch 143, an ADC (Analog to Digital Converter) 144, a connector 145, and a main control unit 146. The controller 141 is a control unit that controls a function as an operation unit in the display panel 140. The controller 141 processes a signal generated by the operation of the touch panel 142 and the key switch 143 by the user and transmits the signal as operation information to the operation display control unit 105. To do. Similar to the controller 100 of the image forming apparatus 1, the controller 141 according to the present embodiment includes the CPU 10, the RAM 20, a control program, and the like described with reference to FIG. 1.

  Based on the serial control signal input from the main control unit 146, the ADC 144 converts the analog signal output from the touch panel 142 into a digital signal and inputs the digital signal to the main control unit 146. The connector 145 is used for taking out a signal between the ADC 144 and the main control unit 146 and a signal between the key switch 143 and the main control unit 146 and inputting the signal to the main control unit 146 from the outside. Interface. As shown in the figure, in the normal operation state of the image forming apparatus 1, each terminal of the connector 145 is bypassed, and the ADC 144 or the key switch 143 and the main control unit 146 are connected.

  The main control unit 146 converts a signal input from the ADC 144 or the key switch 143 into an operation signal in the image forming apparatus 1 and inputs the operation signal to the operation display control unit 105. In the present embodiment, the operation display control unit 105 and the main control unit 146 are connected by a USB interface.

  The touch panel 142 includes a display screen such as an LCD and a sensor that detects a user's touch position on the screen. The touch panel 142 outputs an analog signal corresponding to the coordinates of the position touched by the user, that is, a voltage value corresponding to the coordinates to the ADC 144. FIG. 4 shows a connection relationship between the touch panel 142, the ADC 144, and the main control unit 146. That is, peripheral circuits that supply voltage to the ADC 144 and the touch panel 142 function as a touch panel controller.

  As shown in FIG. 4, the touch panel 142 is provided with connection terminals on the high potential side and the low potential side for each of the X coordinate and the Y coordinate. These connection terminals are connected to the ADC 144 as Xp, Xn, Yp, and Yn, respectively, and the ADC 144 converts the voltage values of Xp and Xn and Yp and Yn into digital signals. The ADC 144 receives a control signal from the main control unit 146, and the ADC 144 acquires and converts the voltage value according to the control signal, and outputs the converted digital signal to the main control unit 146. .

  In addition, the ADC 144 outputs a detection signal (hereinafter referred to as a touch detection signal) according to a touch and release detection state of the touch panel by the user to the main control unit 146 as an interrupt signal. The touch detection signal according to the present embodiment is “Low” when the user is touching the touch panel 142, and is “High” when the user is not touching.

  Next, the touch position recognition operation of the touch panel by the main control unit 146 will be described with reference to FIG. As shown in FIG. 5, when the touch detection signal becomes “Low” (S501 / YES), the main control unit 146 inputs the control signal to the ADC 144 and executes the coordinate measurement process of the touch position (S502). When the coordinate measurement process is completed, the main control unit 146 waits for 10 ms (S503). When the touch detection signal is no longer “Low” while waiting for 10 ms (S504 / NO), the main control unit 146 performs touch release processing (S508), and repeats the processing from S501.

  On the other hand, if the touch detection signal is “Low” even after waiting for 10 ms, the main control unit 146 executes the coordinate measurement process again (S505). When the process of S505 is completed, the main control unit 146 determines whether or not the coordinate measurement for three times is completed and whether or not the variation of the measurement value for three times is within a predetermined value (S506). If the coordinate measurement for three times has not been completed yet or if the variation in the measurement for three times exceeds a predetermined value (S506 / NO), the main control unit 146 repeats the processing from S503. On the other hand, if the coordinate measurement for three times is completed and the variation of the measurement value is within the predetermined value (S506 / YES), the main control unit 146 determines the coordinate by the average value of the measurement (S507), The processing from S501 is repeated.

  When the processing shown in FIG. 5 is repeated and the coordinates are continuously determined without executing the touch release processing, the main control unit 146 displays on the touch panel 142 based on the determined coordinate values. It recognizes continuous pressing of the same button and dragging operation. Through such a procedure, the main control unit 146 recognizes an operation on the touch panel 142 by the user and outputs an operation signal to the operation display control unit 105.

  Next, the coordinate measurement process of S502 and S505 will be described with reference to FIG. As shown in FIG. 6, when starting the coordinate measurement process, the main control unit 146 transmits a coordinate detection command as a control signal to the ADC 144 (S601). This coordinate detection command is a response signal in response to the touch detection signal becoming “Low” in S501 of FIG. When a digital signal is received from the ADC 144 as a response to S601 (S602 / YES), the main control unit 146 stores the received data (S603). The main control unit 146 repeats the processing from S601 to S603 eight times (S604 / NO), discards the first to third data, and checks whether the variation in the fourth to eighth data is within a predetermined value. (S605).

  If the variation of the fourth to eighth data is within a predetermined value as a result of the processing in S605, the fourth to eighth data average value is set as the definite value of the coordinate measurement result (S606), and the processing is terminated. On the other hand, if the fourth to eighth data variations exceed a predetermined value, the main control unit 146 repeats the processing from S601. With such a process, the coordinate measurement process is completed.

  The key switch 143 is a hard switch composed of a plurality of keys. FIG. 7 shows a connection relationship between the hard switch included in the key switch 143 and the main control unit 146. As shown in FIG. 7, eight key switches are connected to each of the key press detection control signal lines SCAN <b> 0 to 3 connected to the main control unit 146. The other end of the switch is connected to one of the key press detection signal lines KEY0 to KEY7, and 32 key switches as a whole are connected and arranged on the matrix.

  As shown in FIG. 7, the key press detection signal lines KEY0 to KEY7 are connected to a high potential via a resistor, so that they are “High” when the key switch is “OFF”. In a state of waiting for a key input by the user, the main control unit 146 sets all signal states of SCAN0 to 3 that are signals of the key press detection control signal lines to “Low”. Thus, when any key switch is pressed by the user, the key of the key press detection signal line connected to the key switch becomes “Low”.

  The main control unit 146 recognizes that one of the key switches has been pressed by the user when one of the KEYs becomes “Low”. Further, when the KEY that has become “Low” becomes “High” again, it is recognized that the pressed key switch has been released. The main control unit 146 operates to determine which key switch is pressed by generating an interrupt process when one of the keys becomes “Low” (hereinafter, referred to as a key switch pressing determination operation). Execute. The operation will be described below.

  8 and 9 are timing charts showing the timing of each signal in the key switch pressing determination operation by the main control unit 146. FIG. FIG. 8 shows a signal state after the main control unit 146 starts the key switch pressing determination operation when any of the KEYs becomes “Low”. As shown in FIG. 8, when an interrupt process occurs due to any of the KEYs becoming "Low", the main control unit 146 sets SCAN0 to 3 to "High" and then sets one SCAN0 to 3 to SCAN0-3. The signal states of KEY0 to KEY7 are confirmed as “Low” sequentially. A signal that becomes “Low” in order after all of SCAN0 to SCAN3 become “High” is a response signal in response to any of KEY0 to KEY7 becoming “Low”.

  The main control unit 146 confirms the signal states of the KEYs 0 to 7 after 1 ms has elapsed since the falling edge of the SCAN. The main control unit 146 can recognize the key switch pressed by the user by the combination of the SCAN set to “Low” and the key set to “Low” accordingly. That is, when any of the KEYs 0 to 7 becomes “Low”, the key switch connected to the KEY that becomes “Low” and the SCAN that is set to “Low” is pressed. I understand that.

  After recognizing the pressed key switch, the main control unit 146 executes a process (hereinafter referred to as a pressed key switch recognition process) of shifting SCAN0 to 3 from “High” to “Low” once each. As shown in FIG. 8, all of the SCANs 0 to 3 are set to “Low” again to return to the standby state for detecting key press or key release. Then, the second press key switch recognition process is executed at the timing when 10 ms has elapsed from the first interrupt detection timing. As a result, the recognition result is adopted only when the recognition results of the first press key switch recognition process and the second press key switch recognition process match.

  FIG. 9 is a timing chart showing determination of pressing and release of the key switch. The main control unit 146 monitors the key switch state change by executing the above-described pressed key switch recognition process every 200 ms even if the key release is not detected after the key switch is pressed. For example, even if any one key switch is pressed and then a key switch connected to the same key press detection signal line as the pressed key switch is pressed, the key of “KEY” that is already “Low”. Since the signal state does not change, the main control unit 146 cannot recognize the subsequent pressing of the key switch. As described above, such a problem can be solved by executing the pressing-key switch recognition process every 200 ms.

  Next, the configuration of the motion analysis apparatus 2 according to the present embodiment and the connection mode with the display panel 140 will be described with reference to FIG. As illustrated in FIG. 10, the motion analysis apparatus 2 according to the present embodiment includes a user operation analysis / reproduction unit 210, a USB protocol analyzer 220, and a PC 230. The user operation analysis / reproduction unit 210 receives a signal input from the touch panel 142 via the ADC 144, a signal input by the key switch 143, and a control signal from the main control unit 146, that is, the main control unit 146 and the ADC 144 or the key switch 143. In addition to acquiring and recording an operation signal exchanged with the user, a user operation is reproduced in response to a control signal from the main control unit 146 instead of the touch panel 142 and the key switch 143.

  The user operation analysis / reproduction unit 210 includes a switch circuit 211, an FPGA (Field Programmable Gate Array) 212, and a microcomputer 213. The switch circuit 211 is a connection portion with a signal line drawn from the connector 145 of the display panel 140. As shown in FIG. 10, the switch circuit 211 is connected to the connector 145 so that the ADC 144 and the key switch 143 side (hereinafter referred to as input). And the main control unit 146 side (hereinafter referred to as the control side) can be connected or disconnected.

  The switch circuit 211 is connected to the FPGA 212. When the input side and the control side are connected, the switch circuit 211 acquires signals from both the input side and the control side and inputs them to the FPGA 212. In a state where the input side and the control side are disconnected, the switch circuit 211 acquires a control signal on behalf of the input side, inputs the control signal to the FPGA 212, and inputs a signal output from the FPGA to the main control unit 146. .

  The FPGA 212 is provided in the user operation analysis / reproduction unit 210 so that the microcomputer 213 absorbs a load when a signal exchanged between the input side and the control side is taken in, and in particular, the main control unit 146. And ADC 144 are provided to absorb the processing load of signals exchanged between them. As described above, signals exchanged between the main control unit 146 and the ADC 144 are control signals output from the main control unit 146, digital signals and detection signals output from the ADC 144, and the like. It is a peculiar signal. When all of these are directly acquired by the microcomputer 213, many interrupt processes occur, and the load on the microcomputer 213 becomes very high. On the other hand, the FPGA 212 receives these signals, acquires the signals to be recorded, and transmits them to the microcomputer 213, whereby the load on the microcomputer 213 can be reduced.

  The microcomputer 213 controls the user operation analysis / reproduction unit 210 to control the user operation analysis and signal recording on the touch panel 142 and the key switch 143 of the display panel 140 and the reproduction of the user operation to the main control unit 146. It is. The microcomputer 213 acquires a signal via the switch circuit 211 and the FPGA 212 when recording the signal by a user operation. That is, the microcomputer 213 functions as an operation signal acquisition unit. Then, the microcomputer 213 stores the acquired signal in an HDD that is a storage medium included in the PC 230. In addition, when reproducing the user operation on the main control unit 146, the microcomputer 213 outputs a signal to the main control unit 146 according to the information stored in the HDD of the PC 230 to reproduce the operation by the user. That is, the microcomputer 213 functions as an operation reproduction unit.

  The USB protocol analyzer 220 acquires and analyzes information exchanged between the main control unit 146 and the operation display control unit 105 and stores it in the HDD of the PC 230. Information exchanged between the main control unit 146 and the operation display control unit 105 is a control signal output by the main control unit 146 to control other parts when the user operates the key switch 143 or the like. It is. That is, the USB protocol analyzer 220 functions as a control signal acquisition unit and a control information storage processing unit.

  The information stored by the USB protocol analyzer is the same as the information exchanged between the main control unit 146 and the operation display control unit 105 in the reproduction of the user operation by the user operation analysis / reproduction unit 210. It is used for the purpose of confirming whether or not they match. This confirmation of matching is executed to confirm the accuracy of the operation reproduced by the user operation analysis / reproduction unit. That is, the USB protocol analyzer 200 also functions as a reproduction confirmation unit.

  As described above, the PC 230 stores the information acquired by the microcomputer 213 and the USB protocol analyzer 220 in the HDD. In the present embodiment, the microcomputer 213 and the USB protocol analyzer 220 execute respective operations by receiving commands such as “start recording” and “start reproduction” from the PC 230.

  Next, the operation of the motion analysis apparatus 2 according to the present embodiment will be described with reference to FIG. FIG. 11 is a flowchart showing the overall operation of the microcomputer 213 according to the present embodiment. As shown in FIG. 11, upon receiving a recording start command from the PC 230 (S1101 / YES), the microcomputer 213 sets the mode to the recording mode (mode = SCAN), and turns on the execution flag (Running = 1) (S1103). .

  On the other hand, when not a recording start command (S1101 / NO) but a playback command is received (S1102 / YES), the mode is set to a playback mode (mode = PLAY) (S1104). When the process of S104 or S1105 is completed, the microcomputer 213 confirms the mode, and if the recording mode (mode = SCAN) (S1105 / YES), the microcomputer executes the recording process (S1107). Details of the recording process will be described later.

  On the other hand, if not the recording mode (S1105 / NO) and the reproduction mode (mode = PLAY) (S1106 / YES), the microcomputer 213 executes the reproduction process (S1108). Details of the reproduction process will be described later. If the playback mode is not set (S1106 / NO), the microcomputer 213 assumes that the standby mode (mode = WAIT) is set (S1109), and repeats the processing from S1101. On the other hand, when the processing of S1107 or S1108 is completed, the microcomputer 213 repeats the processing from S1105. By such processing, control of the motion analysis apparatus 2 by the microcomputer 213 according to the present embodiment is executed.

  Next, the recording process of S1107 according to the present embodiment, that is, the recording process of a signal input when the user operates the touch panel 142 or the key switch 143 will be described with reference to FIG. FIG. 12 is a flowchart showing the operation of the microcomputer 213 in the recording process according to the present embodiment. The microcomputer 213 according to the present embodiment starts the recording process by receiving a recording start command from the PC 230.

  In this case, the microcomputer 213 controls the switch circuit 211 so that the input side and the control side of the connector 145 are connected. Accordingly, a signal input by the user operating the touch panel 144 or the key switch 143 is input to the main control unit 146 via the switch circuit 211 in the same manner as a normal operation. At the same time, the control signal output from the main control unit 146 is input to the ADC 144 or the key switch 143 via the switch circuit 211. A signal exchanged between the main control unit 146 and the ADC 144 or the key switch 143 is input to the microcomputer 213 via the switch circuit 211 and the FPGA 212.

  As shown in FIG. 12, the microcomputer that has started the recording process first starts a timer count (S1201). The microcomputer 213 confirms that the mode is the recording mode (S1202 / YES), and responds to signals input from the key switch 143 and the touch panel 142 until a recording end command is received from the PC 230 (S1203 / NO). This corresponds to the interrupt processing executed by the main control unit 146 (S1206). Thereafter, the processing from S1202 is repeated.

  On the other hand, when a recording end command is received from the PC 230 (S1203 / YES), the microcomputer 213 shifts to a standby mode (mode = WAIT) (S1204) and stops the timer count (S1205). Then, returning to the processing of S1202, when it is confirmed that the standby mode is set (S1202 / YES), the processing is terminated.

  Next, interrupt processing corresponding to the operation of the key switch 143 will be described with reference to FIG. 13 as processing of S1206. The microcomputer 213 detects the interruption of the key switch operation at the fall of any of the key press detection control signal lines SCAN0 to SCAN3 or the rise of any of the key press detection signal lines KEY0 to 7 controlled by the main control unit 146.

  The falling edge of any one of the above SCAN0 to 3 is a case where the signal is changed from “High” to “Low”. Specifically, as described with reference to FIG. 7, when the user presses the key switch and one of the keys KEY 0 to 7 becomes “Low”, the main control unit 146 sets all the SCANs 0 to 3 to “High”. In this case, SCAN 0 to 3 are sequentially set to “Low” one by one to check the signal state of KEY 0 to 7 (hereinafter referred to as a key scan operation).

  On the other hand, the rise of KEY 0 to 7 is when the signal changes from “Low” to “High”. Specifically, as described with reference to FIG. 7, any one of the KEYs 0 to 7 that has become “Low” when the user presses the key switch again releases “High” when the user releases the key switch. This is the case.

  When the microcomputer 213 detects the falling edge of any one of the SCANs 0 to 3 (S1301 / YES), the microcomputer 213 recognizes which of the SCANs 0 to 3 has fallen, and sets the falling number to “(N)”. Note that the processing of S1301 occurs not only by a key scan operation in response to a user pressing a key switch, but also by a key scan operation every 200 ms by the main control unit 146 as described above.

  The microcomputer 213 that has detected the interruption waits for 500 μs (S1302), and then records the signal states of KEY0 to KEY7 as DATA (N) (S1303). For example, if the falling edge of SCAN0 is detected in S1301, it is recorded as DATA0. Note that when recording DATA (N), the microcomputer 213 records the count value of the timer in association with the data. The count value of the timer is used as information for determining the reproduction timing when reproducing the key operation.

  When the recording of DATA (N) is completed, the microcomputer 213 determines whether “(N)” is “3”, that is, whether the key scan operation by the main control unit 146 is completed for one cycle of SCAN0 to SCAN3. It is confirmed whether or not (S1304). If “(N)” is not “3” (S1304 / NO), the microcomputer 213 determines that the key scan operation for one cycle has not yet been completed, and ends the processing as it is. In this case, the microcomputer 213 returns to S1202 in FIG. 12, detects the falling edge of any one of the SCANs 0 to 3 again by the key scan operation that is continuously executed by the main control unit 146, and executes the process in FIG.

  If “(N)” is “3” (S1304 / YES), then the microcomputer 213 checks whether DATA0 to DATA3 are the same as DATA0 to 3 recorded last time (S1305). If DATA0 to DATA3 are the same as the previous data (S1305 /), the microcomputer 213 determines that the data of the key operation is not required to be recorded, discards the data (S1306), and ends the processing. . By such processing, the amount of key operation data recorded in the PC 230 can be reduced. In addition, as described with reference to FIG. 7, the main control unit 146 executes the key scan operation for two cycles at an interval of 10 ms. In this case as well, only one piece of information is recorded, and the amount of information can be reduced. .

  On the other hand, if DATA0 to 3 are different from the previous data, the microcomputer 213 transmits operation information indicating the operation of the key switch recognized by DATA0 to 3 recorded this time to the PC in association with the time stamp (S1307). Exit. In addition, when any of SCAN to 3 falls (S1301 / NO), and any of KEY0 to 7 rises is detected and KEY0 to 7 all become "High" (ALL High) (S1308 / YES) The microcomputer 213 recognizes that the key switch has been released, transmits information indicating the key release operation to the PC 230 in association with the time stamp (S1309), and ends the process. Note that the determination in S1308 is performed when a key scan operation is not being performed. In S1307 and S1309, the information transmitted by the microcomputer 213 is stored in the HDD of the PC 230 as reproduction information for reproducing one operation. That is, the microcomputer 213 functions as a reproduction information storage processing unit. With this process, the key switch operation recording process is completed.

  Next, interrupt processing corresponding to the operation of the touch panel 142 will be described with reference to FIG. 14 as processing of S1206. The microcomputer 213 detects an interruption of the touch panel operation based on a coordinate detection command input to the ADC 144 by the main control unit 146 as a control signal, that is, a signal output from the main control unit 146 in S601 of FIG.

  When the microcomputer 213 receives a coordinate detection command and detects an interrupt (S1401), the microcomputer 213 waits until a digital signal is received from the ADC 144 (S1402 / NO), and receives a digital signal (S1402 / YES). It is recorded as operation data (S1403). When the operation data is recorded, the microcomputer 213 determines whether or not the coordinate determination condition is satisfied by the same processing as S605 of FIG. 6 and S506 of FIG. 5 (S1404). If the coordinate determination condition is satisfied (S1404 / YES), the microcomputer 213 transmits the coordinate data obtained as an average value to the PC 230 as operation information indicating an operation on the touch panel 142 (S1405), and ends the process.

  In step S <b> 1405, the microcomputer 213 associates the coordinate data and the time stamp and transmits them to the PC 230. This information is stored in the HDD of the PC 230 as reproduction information for reproducing one operation. On the other hand, if the coordinate determination condition is not satisfied (S1404 / NO), the process is terminated as it is. In this case, the microcomputer 213 returns to S1202 in FIG. 12, and executes the process in FIG. 14 again according to the coordinate detection command that is continuously output from the main control unit 146. With such a process, the touch panel operation recording process is completed.

  13 and 14 are repeated according to the flow of FIG. 12, reproduction information for reproducing an operation on the touch panel 142 or the key switch 143 is accumulated in the HDD of the PC 230. By using the reproduction information accumulated in this way, a series of operations by the user can be reproduced.

13 and 14, the USB protocol analyzer 220 analyzes and records information exchanged between the main control unit 146 and the operation display control unit 105 (hereinafter referred to as internal information). And stored in the HDD of the PC 230. This internal information includes information exchanged between the main control unit 146 and the operation display control unit 105 and information on the timing of the exchange, and when the operation is reproduced based on the operation information recorded later, Is used to confirm whether or not is accurately reproduced.

  Next, the reproduction process of S1108 according to the present embodiment, that is, the process of reproducing the operation by the user according to the information stored in the PC 230 by the recording process will be described with reference to FIG. As shown in FIG. 15, the microcomputer 213 first obtains reproduction data, which is operation information to be reproduced, from the PC 230 (S1501). This reproduction data is information recorded by the microcomputer 213 by the above-described processing of FIGS. 12 to 14 and stored as reproduction information in the HDD of the PC 230, and the time corresponding to the operation information to be reproduced and the count value of the timer. This is information associated with a stamp. When the reproduction data is acquired, the microcomputer 213 starts counting the timer (S1502).

  When the timer count is started, the microcomputer 213 compares the count value of the timer with the time stamp of the reproduction data, and monitors the coincidence between them (S1503). If the timer counter matches the time stamp (S1503 / YES), the microcomputer 213 determines whether or not reproduction of the previous stage reproduction data has been completed (S1504), and if it has not been completed (S1504 / NO), it is completed. Wait until If the reproduction data is the first one and there is no previous reproduction data, the process proceeds directly to the next process.

  The reason for providing the process of S1504, that is, the process of waiting until the reproduction of the previous stage of reproduction data is completed mainly focuses on the state of the control means such as the CPU that controls the main control unit 146. Since the control means such as the CPU differs depending on the operation of the apparatus, the main control unit 146 does not always return a response with the same response time even when the same operation is performed. Therefore, the operation cannot be reproduced according to the time stamp of the reproduction data, and the operation may be delayed.

  In such a case, if the processing is performed according to the time stamp of the reproduction data, the subsequent operation is input before the previous operation is reproduced, and as a result, the recorded operation procedure is accurately reproduced. I can't do that. Therefore, in the motion analysis apparatus 2 according to the present embodiment, such a problem is solved by performing the process of S1504.

  If the reproduction of the previous stage reproduction data has been completed (S1504 / YES), the microcomputer 213 confirms whether or not the reproduction data of the time stamp that matches the timer counter value is key operation data (S1505). If it is key operation data (S1505 / YES), the microcomputer 213 reproduces the key operation based on the reproduction data (S1506). Details of reproduction of key operations will be described later.

  On the other hand, if the result of the confirmation in S1505 is panel operation data instead of key operation (S1505 / NO), the microcomputer 213 reproduces the panel operation based on the reproduction data (S1507). Details of the panel operation reproduction will be described later. When reproduction of the operation is started in S1506 or S1507, the microcomputer 213 determines whether or not the end of the reproduction data has been reached (S1508). If the end data has been reached (S1508 / YES), the standby mode (mode = (WAIT) (S1509), the timer is stopped (S1510), and the process is terminated. On the other hand, if the terminal data has not been reached (S1508 / NO), the processing from S1503 is repeated.

  Next, the key operation reproduction process of S1506 will be described with reference to FIG. FIG. 16 is a flowchart showing key operation reproduction processing according to this embodiment. As shown in FIG. 16, the microcomputer 213 first sets any one of the KEYs 0 to 7 maintained at “High” to “Low” (S1601). This reproduces a state in which any one of KEYs 0 to 7 connected to the pressed key switch becomes “Low” when the user presses the key switch. At this time, which of the KEYs 0 to 7 is set to “Low” is not a problem in the configuration of the main control unit 146 according to the present embodiment. Alternatively, the same signal line may always be “Low”.

  By dropping any one of KEY0 to KEY7, as described in FIG. 7, the main control unit 146 performs the key scan operation, so that SCAN0 to DOWN3 are sequentially dropped. When the microcomputer 213 detects the falling edge of the SCAN (N) (S1602 / YES), the microcomputer 213 determines the DATA (N), that is, the operation signal from the information recorded as the reproduction data corresponding to the SCAN (N) where the falling edge is detected. Is generated and output (S1603).

  If “(N)” is any one of 0 to 2, since the main control unit 146 is executing a key scan operation, one of the SCANs 0 to 3 is “Low” and the others are “High”. The state continues (S1604 / NO). In this case, the microcomputer 213 repeats the processing from S1602. On the other hand, when the key scanning operation of the main control unit 146 is completed, the main control unit 146 sets all the SCANs 0 to 3 to “Low”. When the microcomputer 213 detects that all of the SCANs 0 to 3 are “Low” (S1604 / YES), the microcomputer 213 performs AND outputs of DATA0 to DATA3 to the KEYs 0 to 7 (S1605).

  As described in FIG. 7, the main control unit 146 performs the key scan operation for two cycles at 10 ms intervals. Therefore, it is necessary to cope with the key scan operation for two cycles in reproducing the key operation. Therefore, the microcomputer 213 repeats the processing of S1602 to S1605 until data output for two cycles is completed (S1606 / NO). When the processing for two cycles is completed (S1606 / YES), the key operation reproduction operation using the key operation data is ended. In addition to the processing shown in FIG. 16, when the key operation data is a key release operation, the microcomputer 213 outputs a signal corresponding to the key release operation instead of the processing of FIG.

  Next, the panel operation reproduction process of S1507 will be described with reference to FIG. FIG. 17 is a flowchart showing a panel operation reproduction process according to this embodiment. As shown in FIG. 17, the microcomputer 213 first transmits a signal that reproduces the touch detection signal (S1701). This reproduces the process in which the touch detection signal becomes “Low” in S501 of FIG.

  When the touch detection signal becomes “Low”, as described in FIG. 5, the main control unit 146 starts the coordinate measurement process, and outputs the coordinate detection command as described in FIG. When receiving the coordinate detection command from the main control unit 146 (S1702 / YES), the microcomputer 213 transmits the coordinate data recorded as the reproduction data (S1703). Thereby, the main control unit 146 acquires the coordinate data, and executes the processing of S602 and S603 in FIG.

  As described in FIGS. 5 and 6, the main control unit 146 performs eight detections three times at 10 ms intervals, that is, at least 24 coordinate detections in order to determine the coordinates. Accordingly, the microcomputer 213 repeats transmission of coordinate data as reproduction data in accordance with the coordinate detection command until the condition for the main control unit 146 to determine the coordinates is satisfied (S1704 / NO). Then, when the coordinate determination condition by the main control unit 146 is satisfied (S1704 / YES), the process ends. With this process, the panel operation reproduction process is completed.

  As described above, the processes of FIGS. 16 and 17 are repeated a plurality of times as long as key operation data or panel operation data is included in the reproduction data in the process of FIG. 15, that is, the operation reproduction process based on the reproduction data. Executed. Thereby, the operation recorded as reproduction data is automatically reproduced by the control of the microcomputer 213 without the user directly operating the display panel 140.

  As described above, in the reproduction processing according to the present embodiment, information generated when the touch panel 142 or the key switch 143 is operated is generated inside the main control unit 146 as in the prior art and is displayed in the operation display control unit 105. Instead of reproducing the operation by transmitting, a signal input to the main control unit 146 when the touch panel 142 and the key switch 143 are operated is acquired and recorded, and the recorded signal is stored in the main control unit 146. Reproduce the operation by typing. Thereby, the conditions at the time of failure occurrence can be reproduced more faithfully.

  Furthermore, the user can repeatedly execute an operation based on the reproduction information when the microcomputer 213 executes the reproduction process of FIG. When the microcomputer 213 automatically repeats the operation of FIG. 15 to reproduce a failure that has occurred in the image forming apparatus 1 and has a low reproducibility, the same operation needs to be repeated numerous times. The operation necessary for the user can be simplified and the burden on the user can be reduced. It should be noted that the repetition of the reproduction of the operation based on the reproduction information can be executed by specifying the number of repetitions in addition to the case of executing the operation endlessly without specifying the number.

  16 and 17, the USB protocol analyzer 220 acquires and analyzes internal information exchanged between the main control unit 146 and the operation display control unit 105, and the above-described FIGS. It is confirmed whether or not it matches the internal information stored in the process of 14. As a result, it is possible to confirm that the operation is accurately reproduced when the two match, and to recognize that the operation is not accurately reproduced when the internal information is different.

  As described above, in the reproduction of the operation, the timing of the signal may be different depending on the state of the CPU or the like that controls the main control unit 146. Therefore, the timing of the information exchanged in the reproduction of the operation is the PC 230. The timing in the internal information stored in the HDD may be different. Therefore, the USB protocol analyzer 220 determines the match of the internal information in consideration of the case where the timing of the signal is deviated when determining the match of the internal information.

  As described above, the operation analysis apparatus 2 according to the present embodiment can simplify the operation for reproducing a failure with low reproducibility and more faithfully reproduce the conditions at the time of the occurrence of the failure. Also, as shown in FIG. 10, by providing an interface for connecting the two, such as a connector 145 provided on the image forming apparatus 1 side and a switch circuit 211 provided on the operation analysis apparatus 2 side, the apparatus Thus, there is no need for work such as emptying the housing, selecting the internal signal lines and connecting the signal extraction lines, and the work for the operation analysis can be performed more easily.

  In the above embodiment, as shown in FIG. 10, the USB protocol analyzer 220 compares the internal information in the operation recording process with the internal information in the operation reproduction process, thereby confirming the reproducibility of the operation. The case where it does is demonstrated as an example. In addition, various means can be used to confirm the reproducibility of the operation. In the following, another means for confirming the reproducibility of operations will be described.

  The image forming apparatus 1 is provided with light emitting units such as a plurality of LEDs (Light Emitting Diodes) at various locations in the apparatus, and emits light in response to a user operation. Therefore, it is possible to check the reproducibility of the operation by monitoring the control signal to each light emitting unit by the main control unit 146 in the same manner as the internal information in the USB protocol analyzer. Such an aspect will be described with reference to FIG.

  FIG. 18 is a diagram illustrating an example of a connection relationship of the light emitting unit 147 by the main control unit 146. In the example of FIG. 18, eight LEDs are connected to each of the LED scan signal lines LSC0 to LSC3 connected to the main control unit 146. The other end of the LED is connected to one of the LED control signal lines LEDC0 to LEDC7, and 32 LEDs as a whole are connected and arranged on the matrix.

  As shown in FIG. 18, LSC0 to LSC3 are connected to the bases of pnp transistors, respectively. The emitter of the pnp transistor is connected to a high potential, and eight LEDs are connected in parallel to the collector. The LEDs C0 to 7 are respectively connected to the bases of npn transistors. The emitter of the npn transistor is connected to the system ground, and four LEDs are connected in parallel to the collector.

  In such a configuration, the main control unit 146 causes the desired LED to emit light by setting the LSC connected to the LED to emit light to “Low” and the LEDC to “High”. In such a connection relationship, the operation analysis device 2 acquires and stores the signals between the pnp type transistor and the npn type transistor and the main control unit 146, and thus operates similarly to the USB protocol analyzer 220 described above. Reproducibility can be confirmed.

  In addition to such an aspect, for example, it is conceivable that the display of the display unit such as the LCD 70 provided in the display panel 140 changes according to an operation by the user. Therefore, the motion analysis apparatus 2 acquires a control signal for the main control unit 146 to control the display unit, and performs the same processing as that of the USB protocol analyzer 220 described above. The reproducibility of the operation can be confirmed.

  Moreover, in the said embodiment, the case where the operation of the touch panel 142 and the key switch 143 by a user was reproduced was demonstrated as an example. In addition, the operation of the image forming apparatus 1 by the user can be turned on / off. As an aspect of the operation that causes the malfunction, an operation of the power supply, particularly a power-off operation that does not follow a formal procedure can be considered. Below, the aspect which reproduces such operation is demonstrated.

  FIG. 19 is a diagram illustrating a configuration of a mode in which the power ON / OFF operation can be reproduced. As shown in FIG. 19, the image forming apparatus 1 includes a power management unit 190 that receives power supply from the external power supply 3 and manages the power of each unit. The power management unit 190 is generally connected directly to the external power supply 3, but in the example of FIG. 19, it is connected to the external power supply 3 via the relay circuit 240, which is one of the features of this example. One.

  As shown in FIG. 19, the microcomputer 213 is connected so as to be able to detect the power supplied from the power management unit 190 to each part of the apparatus. That is, the microcomputer 213 also functions as a power supply state detection unit. The power supply detection by the microcomputer 213 is simple “High” or “Low” detection. For example, in the case of a 5V power supply, the microcomputer 213 detects “High” and “Low” with a threshold of about 2 to 4V. Similar to the operations in FIGS. 13 and 14, the microcomputer 213 records the fall of the signal together with the time stamp as the power-off timing.

  The relay circuit 240 is a connection circuit capable of switching the AC power supply, and switches connection and disconnection states between the power management unit 190 and the external power supply 3 according to the control of the microcomputer 213. That is, the relay circuit 240 functions as a power supply switching unit. Thereby, the supply state of the external power source, that is, the main power source to the image forming apparatus 1 can be switched.

  It should be noted that the power-off procedure of the image forming apparatus as a general multi-function peripheral is a two-step process. Supply is stopped. In the example of FIG. 19, the main power supply stop at the latter stage can be reproduced in the two-stage power-off procedure. The supply stop of the internal power supply in the previous stage can be reproduced in the above-described manner as long as the operation is processed by the main control unit 146 according to the operation on the key switch 143.

  Moreover, in the said embodiment, the aspect which controls the start of operation recording and reproduction | regeneration of recorded operation via PC230 which operate | moves as a part of motion analysis apparatus 2 was demonstrated as an example. Details thereof will be described with reference to FIG. FIG. 20 is a diagram illustrating an example of a GUI (Graphical User Interface) 231 of a dedicated control application displayed on the display unit of the PC 230 in order to control the user operation analysis / reproduction unit 210.

  As illustrated in FIG. 20, the GUI 231 includes a control button 232 and a sequence display unit 233. The control button 232 is a user interface for the user to operate the PC 230 and give a command to the user operation analysis / reproduction unit 210. The buttons included in the control button 232 include transmission of a recording start command in S1101 in FIG. 11, transmission of a reproduction command in S1102, transmission of a recording end command in S1203 in FIG. 12, transmission of a frame advance command for reproduction, and loop reproduction command. There are buttons for transmitting the playback data, transmitting the reproduction data acquisition command of S1501 in FIG. 15, and transmitting the stored operation information storage command.

  Of each of the above processes, the playback frame advance command does not automatically execute the playback data sequentially as described with reference to FIG. 15, but performs frame-by-step playback executed while stopping for each playback data. The command to be executed. Specifically, in the case of frame-by-frame playback, the microcomputer 213 does not reproduce the operation based on the operation information according to the count value of the timer as described in S1502 and S1503 in FIG. 15, but is included in the reproduction information. Reproduce the operation in the order of the time stamp. At this time, instead of automatically reproducing the operation, the next time stamp operation is performed every time the above-described reproduction frame advance command is input by the user. By enabling such frame-by-frame playback, it is possible to improve user convenience in investigating the cause of a failure.

  The sequence display unit 233 is a display unit that shows the contents of the reproduction data acquired by the microcomputer 213 in S1501 of FIG. As shown in FIG. 20, the reproduction data is reproduction information accumulated in the HDD of the PC 230, and is information in which information for reproducing one operation on the touch panel 142 or the key switch 143 is accumulated. Of the reproduction information shown in FIG. 20, “ID” is identification information for identifying reproduction information for reproducing each operation.

  “Operation data type” and “value” are information indicating the contents of each operation, and are information processed as operation information in FIGS. 13 and 14. That is, the operation information is included in the reproduction information transmitted from the microcomputer 213 to the PC 230 in S1307 in FIG. 13 or S1405 in FIG. The “operation data type” is information for identifying the type of operation such as an operation on the touch panel 142, an operation on the key switch 143, and a key press or release on the key switch 143. “Value” is details in each operation, and is information indicating the coordinates on the panel in the case of a touch panel operation and the pressed key in the case of a key switch operation. The “time stamp” is information indicating each operation timing, and is associated with each operation information as described above.

  In such a GUI, by clicking each button displayed on the control button 232, the user can give a command to the user operation analysis / reproduction unit 210 to execute recording and reproduction of the user operation.

  In the above embodiment, the case where the PC 230 is used as an example of the configuration for controlling the operation of the motion analysis apparatus 2 has been described. Such an embodiment is effective in carrying the motion analysis apparatus 2 by configuring the user operation analysis / reproduction unit 210 and the USB protocol analyzer 220 as USB devices and using a notebook PC as the PC 230, for example. In addition, it is possible to use a dedicated information processing apparatus instead of the PC 230 as the control mechanism. Furthermore, such a dedicated information processing apparatus and the user operation analysis / reproduction unit 210 may be configured as an integrated device.

1 image forming apparatus,
2 motion analysis device,
3 External power supply,
10 CPU,
20 RAM,
30 ROM,
40 engines,
50 HDD,
60 I / F,
70 LCD,
80 operation unit,
90 bus,
100 controller,
101 Main control unit,
102 engine control unit,
103 I / O control unit,
104 image processing unit,
105 operation display control unit,
110 ADF,
120 scanner unit,
130 paper output tray,
140 display panel,
141 controller,
142 touch panel,
143 key switch,
144 ADC,
145 connector,
146 Main control unit,
147 light emitting unit,
150 paper feed table,
160 print engine,
170 paper output tray,
180 Network I / F,
190 Power management unit,
210 User operation analysis / reproduction unit,
211 switch circuit,
212 FPGA,
213 microcomputer,
220 USB protocol analyzer,
230 PC,
231 GUI,
232 control buttons,
233 sequence display section,
240 Relay circuit

JP 2002-157147 A JP 2000-94787 A

Claims (11)

An operation analysis apparatus that analyzes a user operation on an image forming apparatus having an operation unit and reproduces the operation,
A connection unit connected so as to obtain a signal between the operation unit and an operation control unit that controls the operation unit;
An operation signal acquisition unit that acquires, via the connection unit, an operation signal that is a signal exchanged between the operation unit and the operation control unit when the user operates the operation unit;
A reproduction information storage processing unit that stores operation information based on the acquired operation signal and timing information indicating the timing at which the operation signal is acquired in association with each other and stored in a storage medium as reproduction information;
An operation reproduction unit that repeatedly reproduces an operation by a user based on the stored reproduction information,
The connection unit is in a state in which the operation unit and the operation control unit are connected when the operation signal acquisition unit acquires the operation signal, and when the operation reproduction unit reproduces the operation, The state where the operation control unit is disconnected,
The operation reproduction unit starts counting the timing according to the operation reproduction command, and generates the operation signal based on the operation information associated with the timing information when the timing indicated by the timing information is reached. And transmitting the generated operation signal to the operation control unit via the connection unit.   The operation reproduction unit is configured to associate the operation information associated with the timing information based on a count value of the timing and a timing indicated by the timing information according to a response signal of the operation control unit with respect to the transmitted operation signal. The motion analysis apparatus according to claim 1, wherein the operation signal is generated based on the control signal and transmitted to the operation control unit.   The reproduction information storage processing unit discards the operation signal acquired after the second time when the operation signal acquired continuously indicates the same state as the operation state of the operation unit. The motion analysis apparatus according to claim 1 or 2.   The operation reproduction unit reproduces the operation being reproduced when the count value of the timing reaches a timing indicated by other timing information during reproduction of the operation based on the operation information associated with the one timing information. The motion analysis apparatus according to claim 1, wherein the reproduction of the operation based on the operation information associated with the other timing information is started after completion of the operation. A control signal acquisition unit that acquires a control signal that the operation control unit outputs to control another part by a user operating the operation unit;
A control information storage processing unit that stores control information based on the acquired control signal in a storage medium in association with the reproduction information related to the operation by the user;
Control information based on the control signal acquired by the control signal acquisition unit when the operation reproduction unit reproduces the operation of the operation unit by the user, and the reproduction information stored in association with the reproduced operation information. 5. The motion analysis apparatus according to claim 1, further comprising a reproduction confirmation unit configured to confirm that the user's operation is accurately reproduced based on a difference from the control information.   6. The operation analysis according to claim 5, wherein the control signal acquisition unit acquires a signal output from the operation control unit to the control unit of the image forming apparatus main body when a user operates the operation unit. apparatus.   The control signal acquisition unit acquires a signal output by the operation control unit to control a display unit of the image forming apparatus when a user operates the operation unit. The motion analysis device described in 1.   The control signal acquisition unit acquires a signal output for the operation control unit to control a light emitting unit provided in the image forming apparatus when a user operates the operation unit. The motion analysis apparatus according to any one of 5 to 7. A power supply state detection unit for detecting a state of power supplied to the control unit of the image forming apparatus main body;
A power supply switching unit that is connected to an external power supply unit that supplies power to the image forming apparatus from the outside and switches a power supply state from the outside;
The reproduction information storage processing unit associates operation information for turning on or off the power based on the detected power supply state with timing information indicating the timing at which the power supply state is detected, and stores it in the storage medium as reproduction information. ,
The operation reproduction unit controls the power supply switching unit to switch an external power supply state when reproducing an operation by a user based on the reproduction information including operation information of turning on or off power. The motion analysis apparatus according to claim 1. An operation analysis method for reproducing a user operation by analyzing a user operation on an image forming apparatus having an operation unit,
When the user operates the operation unit via a connection unit that is connected so that the operation signal acquisition unit can acquire a signal between the operation unit and the operation control unit that controls the operation unit. Obtaining an operation signal which is a signal exchanged between the operation unit and the operation control unit;
The reproduction information storage processing unit associates the operation information based on the acquired operation signal with the timing information indicating the timing at which the operation signal is acquired, and stores it in the storage medium as reproduction information.
The operation reproduction unit repeatedly reproduces the operation by the user based on the stored reproduction information,
The operation reproduction unit is
When the operation signal acquisition unit acquires the operation signal, the operation unit and the operation control unit are connected, and when the operation reproduction unit reproduces the operation, the operation unit and the operation control unit are disconnected. Controlling the connecting part to be in the
In response to the operation reproduction command, timing is started, and when the timing indicated by the timing information is reached, the operation signal is generated based on the operation information associated with the timing information, and the connection unit is And transmitting the generated operation signal to the operation control unit. An operation analysis program for analyzing a user operation on an image forming apparatus having an operation unit and reproducing the operation,
The operation unit and the operation control are performed by a user operating the operation unit via a connection unit that is connected so as to obtain a signal between the operation unit and an operation control unit that controls the operation unit. Obtaining an operation signal that is a signal exchanged with the unit;
Storing the operation information based on the acquired operation signal and the timing information indicating the timing at which the operation signal is acquired in association with each other in a storage medium;
Based on the stored reproduction information, causing the information processing apparatus to execute a step of repeatedly reproducing an operation by the user,
The step of reproducing the operation by the user includes:
When the operation signal acquisition unit acquires the operation signal, the operation unit and the operation control unit are connected, and when the operation reproduction unit reproduces the operation, the operation unit and the operation control unit are disconnected. Controlling the connecting portion so as to be in a connected state;
Starting timing according to the reproduction instruction of the operation;
When the timing indicated by the timing information is reached, generating the operation signal based on the operation information associated with the timing information;
And a step of transmitting the generated operation signal to the operation control unit via the connection unit.

Images