JP2006260596A - Drawing information acquiring method, program for executing this method by computer, and image forming device - Google Patents

Abstract

<P>PROBLEM TO BE SOLVED: To provide a key operation monitoring method, a drawing information acquiring method, a key operation regeneration method, a program for executing the methods by a computer, and an image forming device, capable of making debugging work efficient. <P>SOLUTION: This drawing information acquiring method is a method of acquiring drawing information output to an operation panel, in the image forming device provided with the operation panel, and an application for executing processing concerned in image formation, and operated as an application process for outputting the drawing information to the operation panel, and a drawing information acquiring means in the image forming device includes a drawing information acquiring step for receiving the drawing information from the application process by interprocess communication. <P>COPYRIGHT: (C)2006,JPO&NCIPI

Description

  The present invention relates to a key operation monitoring method for monitoring a user's key operation from an operation panel when debugging an image forming apparatus that performs a user service related to image forming processing such as a printer, a copy, or a facsimile, and drawing information for the operation panel. A drawing information acquisition method for acquiring a key, a key operation reproduction method for reproducing a key operation of the operation panel, a program for causing a computer to execute these methods, a key operation monitoring method, a drawing information acquisition method, and a key operation reproduction method are executed. The present invention relates to an image forming apparatus capable of performing image processing.

  2. Description of the Related Art In recent years, an image forming apparatus (hereinafter, referred to as “multifunction machine”) in which functions of apparatuses such as a printer, a copy machine, a facsimile machine, and a scanner are housed in a single housing is generally known. This multifunction device is provided with a display unit, a printing unit, an imaging unit, and the like in one casing, and is provided with three types of software respectively corresponding to a printer, a copying machine, and a facsimile machine. It operates as a copy, scanner or facsimile machine.

In such a multifunction device, the user presses various keys displayed as drawing data on the display unit of the operation panel so that user services such as a printer, a copy, a facsimile, and a scanner are provided according to the user's key operation. It has become. For this reason, in the development stage of the multifunction device, debugging work as to whether or not the operation according to the user's key operation functions normally takes an important position.
JP 2002-207399 A

  However, the conventional multifunction peripheral is not provided with a function for debugging the key operation from the operation panel of the user and the operation by the key operation. This is because a conventional multifunction peripheral has a simple configuration in which functional unit software corresponding to a printer, a copy, a scanner, and a facsimile apparatus is separately provided. This is because sufficient quality can be maintained by performing a debugging operation for each software of each functional unit without checking the operation of each function.

  By the way, in such a conventional multi-function machine, software corresponding to a printer, a copy, a scanner, and a facsimile apparatus is provided separately, so that development of each software requires a lot of time. For this reason, the applicant has hardware resources used in image forming processing such as a display unit, a printing unit, and an imaging unit, and has an application that performs processing specific to each user service such as a printer, copy, or facsimile. When a user service is provided by interposing between these applications and hardware resources, hardware resource management, execution control, and image formation processing that are commonly required by at least two of the applications are provided. Invented an image forming apparatus (multifunction machine) equipped with a platform comprising various control services. According to this image forming apparatus, it is possible to improve the efficiency of software development by including a platform that performs management, execution control, and image forming processing of hardware resources commonly required by at least two applications. In addition, the productivity of the entire apparatus can be improved.

  Such a multifunction device has a control service that provides services that are commonly required by at least two of the applications, and has a characteristic configuration in which a large number of softwares operate in a complex manner. There is a problem that it is difficult to determine whether or not an operation corresponding to a user's key operation is normally realized only by performing a debugging operation for each software. In particular, when a failure occurs during an operation by a user's key operation, there is a problem that it is difficult to identify the software having the failure, and a great amount of labor is required for debugging the multifunction peripheral.

  The present invention has been made in view of the above. A key operation monitoring method, a drawing information acquisition method, a key operation reproduction method, a program for executing these methods on a computer, and an image capable of improving the efficiency of debugging work. The object is to obtain a forming device.

  In order to achieve the above object, the present invention provides an image forming apparatus comprising: an operation panel; and an application that executes processing relating to image formation and operates as an application process for outputting drawing information to the operation panel. A drawing information acquisition method for acquiring drawing information output to the operation panel in the apparatus, wherein the drawing information acquisition means in the image forming apparatus receives the drawing information from the application process by inter-process communication. An information acquisition step is included.

  According to the present invention, since the drawing information is received from the application process by inter-process communication, the display contents (drawing on the operation panel) in the image forming apparatus in which a large number of software operates are included. Information) can be easily obtained. Therefore, by using such drawing information as debugging information, drawing information on the operation panel at the time of failure can be easily reproduced, and debugging of the image forming apparatus can be efficiently performed. it can.

  In the drawing information acquisition step, the drawing information acquisition means receives the drawing information by receiving a call of a drawing information transmission function corresponding to a function for managing the operation panel from the application process.

  According to the present invention, the drawing information acquisition step receives the drawing information transmission function corresponding to the function managing the operation panel from the application, and receives the drawing information. Drawing information useful for debugging work can be easily obtained.

  Further, according to the present invention, drawing information can be received using a drawing information transmission function corresponding to a function for managing the operation panel, so that the drawing information is notified to the drawing information acquisition module at the application development stage. There is no need to be aware of this, and application development can be made more efficient.

  The image processing apparatus may further include a drawing information storing step of storing a plurality of drawing information received from the application in a storage unit as drawing history data.

  According to the present invention, by including a drawing information storing step for storing a plurality of drawing information received from the application as drawing history data in the storage means, the drawing information to be displayed on the operation panel is left as historical data. This makes it easy to reproduce a series of displays on the operation panel when a failure occurs, thereby further improving the efficiency of debugging work.

  Further, the drawing information acquisition means adds time information to the received drawing information in the drawing information acquisition step, and the drawing information to which the time information is added in the drawing information storage step is used as the drawing history data. May be stored in the storage means.

  According to this invention, the drawing information acquisition step further includes a drawing information processing step for adding time information to the drawing information received, and the drawing information storage step stores the drawing information to which the time information is added as drawing history data. By storing it in the means, it is possible to recognize the timing of the display on the series of operation panels based on the time information, and to synchronize the actual operation panel display and software operation. This can be reproduced, and the debugging work efficiency can be further improved.

  The image forming apparatus may further include a step of transmitting the drawing history data to a terminal connected to a network.

  According to the present invention, the drawing information storage step transmits the drawing history data to the terminal connected to the network, so that the history data of the drawing information of the operation panel is directly left on the remote terminal used by the user who performs the debugging work. It is possible to improve usability when debugging work is performed at a location away from the image forming apparatus.

  The present invention can also be configured as a program that causes the image forming apparatus to execute each step in the drawing information acquisition method.

  The present invention also provides an image forming apparatus comprising: an operation panel; and an application that executes an image forming process and operates as an application process for outputting drawing information to the operation panel. The image forming apparatus may further include a drawing information acquisition unit that receives drawing information output from the application process to the operation panel from the application by inter-process communication.

  According to the present invention, the display information (drawing information) displayed on the operation panel can be easily acquired by providing the drawing information acquisition means for receiving the drawing information output from the application by the interprocess communication from the application. Can do. Therefore, by using such drawing information as debugging information, drawing information on the operation panel at the time of failure can be easily reproduced, and debugging of the image forming apparatus can be efficiently performed. it can.

  Further, the drawing information acquisition means operates as a server process using the application process as a client, and the application process is an operation panel control service library that defines a drawing information transmission function corresponding to a function for controlling the operation panel. By executing the drawing information transmission function, the drawing information is transmitted to the drawing information acquisition means.

  According to this invention, the drawing information acquisition means operates as a server process using an application as a client, and the application includes an operation panel control service library that defines a drawing information transmission function corresponding to a function for controlling the operation panel, and the drawing information By transmitting the drawing information to the drawing information acquisition means by executing the transmission function, it is possible to easily acquire drawing information useful for debugging work by simple inter-process communication called function call.

  The image processing apparatus may further include a drawing information storage unit that stores a plurality of drawing information received from the application in a storage unit as drawing history data.

  According to the present invention, by providing the drawing information storage means for storing the plurality of drawing information received from the application as drawing history data in the storage means, the drawing information to be displayed on the operation panel is left as history data over time. This makes it easy to reproduce a series of displays on the operation panel when a failure occurs, thereby further improving the efficiency of debugging work.

  The drawing information acquisition unit further includes a drawing information processing unit that adds time information to the received drawing information, and the drawing information storage unit further displays the drawing information to which the time information is added as the drawing history. It is good also as storing in the said memory | storage means as data.

  According to this invention, it further comprises a drawing information processing means for adding time information to the drawing information received by the drawing information acquisition means, and the drawing information storage means stores the drawing information to which the time information is added as drawing history data in the storage means. By storing, the timing of display on a series of operation panels can be recognized based on the time information, and the display on the operation panel is reproduced by synchronizing the actual operation panel display and software operation. Therefore, it is possible to further improve the debugging work efficiency.

  The drawing information storage means may further transmit the drawing history data to a terminal connected to a network.

  According to the present invention, the drawing information storage means transmits the drawing history data to the terminal connected to the network, whereby the drawing history data of the drawing information of the operation panel is directly transmitted to the remote terminal used by the user who performs the debugging work. Therefore, it is possible to improve usability when performing debugging work at a location away from the image forming apparatus.

  Further, the drawing information acquisition unit and the drawing information storage unit may operate as different processes, and the drawing history data may be transmitted and received through inter-process communication between the drawing information acquisition unit and the drawing information storage unit. .

  According to the present invention, the drawing information acquisition unit and the drawing information storage unit operate as different processes, and image information storage is performed by transmitting and receiving drawing history data through inter-process communication between the drawing information acquisition unit and the drawing information storage unit. The means can be provided independently of the drawing information acquisition means, and the configuration of the drawing information acquisition means can be prevented from becoming complicated.

  Further, the drawing information processing means may be a thread generated within the process of the drawing information acquisition means.

  According to this invention, since the drawing information processing means is a thread generated within the process of the drawing information acquisition means, the drawing information is output to the operation panel and other data processing is performed in a short time or almost simultaneously. Even in this case, both data processes can be executed in parallel, and the debugging work can be realized in the same situation as the actual operation. Even when time information is added to the drawing information, there is no deviation from the actual time. For this reason, the accuracy of the debugging work can be ensured.

  In addition, in order to solve the above-described problems, the present invention can be configured as follows.

  The present invention relates to a key operation monitoring method for monitoring a key operation from the operation panel in an image forming apparatus having an operation panel, wherein the key monitoring unit acquires the key operation as key event information. It is characterized by having.

  According to the present invention, since the key operation is acquired as the key event information, it is possible to easily reproduce the key operation at the time of occurrence of the failure, and the debugging operation of the image forming apparatus can be performed efficiently.

  In the key operation monitoring method, the key monitoring step may include a step in which the key monitoring unit receives key event information distributed by a communication driver of the operation panel.

  According to the present invention, key event information can be distributed using a communication driver.

  In the key operation monitoring method, the image forming apparatus includes a hardware resource used in the image forming process, and an application that performs a process specific to the user service related to the image forming process. A system control service that controls the operation panel between the hardware resources, and the key monitoring step includes a key event acquisition step of acquiring the key operation as key event information by the system control service; The key event information acquired by the key event acquisition step may include receiving the key monitoring unit from the system control service by inter-process communication.

  According to the present invention, a key event acquisition step of acquiring a key operation as key event information by the system control service, and a key monitoring step of receiving the key event information acquired by the key event acquisition step by inter-process communication with the system control service In the image forming apparatus in which a large number of software programs are included, key event information by key operation can be easily obtained using inter-process communication, and debug information can be used. For this reason, it is possible to easily reproduce the key operation at the time of occurrence of the failure, and it is possible to efficiently debug the image forming apparatus.

  The key monitoring step may further include a key event storage step of storing the received plurality of key event information as key history data in a storage unit.

  According to the present invention, a key event storage step of storing a plurality of key event information received by the key monitoring step as key history data in the storage means is included, so that key event information over time by a series of key operations can be obtained. It can be left as history data, and it becomes easy to reproduce the operation at the time of failure by a series of key operations, and the efficiency of debugging work can be further improved.

  In addition, the key monitoring step further includes a key event processing step of adding time information to the received key event information, and the key event storage step includes the key event information to which the time information is added as the key history data. It is good also as storing in the said memory | storage means.

  According to this invention, the key monitoring step further includes a key event processing step for adding time information to the key event information received by the key monitoring step, and the key event storage step stores the key event information to which the time information is added as key history data. By storing it in the memory, it is possible to recognize the timing of a series of key operations based on the time information, and to reproduce the key operations by synchronizing the actual key operations and software operations. Further improvement can be achieved.

  The key event storage step may further transmit the key history data to a terminal connected to a network.

  According to the present invention, the key event storage step transmits the key history data to the terminal connected to the network, so that the history data of the key event information can be left directly on the remote terminal used by the user who performs the debugging operation. In addition, usability can be improved when debugging work is performed at a location remote from the image forming apparatus.

  The present invention also provides a key operation reproduction method for reproducing a key operation from the operation panel in an image forming apparatus including an application for performing processing for user service related to image formation processing and an operation panel. A storage data acquisition step of acquiring the key history data from a storage means storing key history data including a plurality of key event information over time of key operations on the operation panel; and a key acquired by the storage data acquisition step A key operation reproduction method comprising: a reproduction step of generating reproduction information including the key event information based on history data, and transmitting the reproduction information to the application to reproduce a key operation. You can also

  According to this invention, the storage data acquisition step for acquiring the key history data from the storage means storing the key history data including a plurality of key event information over time of the key operation on the operation panel, and the storage data acquisition step A playback step of generating playback information including key event information based on the key history data, and transmitting the playback information to the application to playback the key operation, thereby repeatedly executing the playback of the specific key operation. Therefore, the reproducibility and automation of the operation can be easily performed, and the debugging work efficiency and the evaluation efficiency can be improved.

  In the key operation reproduction method, the stored data acquisition step acquires key history data including key event information to which time information is added, and the reproduction step performs the reproduction at intervals based on the time information. Information may be transmitted to the application.

  According to the present invention, the stored data acquisition step acquires key history data including key event information to which time information is added, and the playback step transmits the playback information to the application at intervals based on the time information. The key operations can be automatically reproduced at intervals of the key operations actually performed by the user, and the debugging work efficiency and the evaluation efficiency can be further improved.

  The saved data acquisition step acquires drawing history data including a plurality of time-lapse drawing information output to the operation panel from the storage unit, and the playback step transmits from the application by a played key operation. The drawn drawing information may be compared with the drawing information of the drawing history data acquired in the stored data acquisition step, and if they do not match, the fact may be notified to the user.

  According to the present invention, drawing history data including a plurality of time-lapse drawing information output to the operation panel by the saved data acquisition step is acquired from the storage means, and the drawing transmitted from the application by the key operation in which the playback step is played back. The information is compared with the drawing information of the drawing history data acquired in the saved data acquisition step. If they do not match, the user is notified that the drawing information displayed on the operation panel is normal. Can be automatically determined, and debugging efficiency and evaluation efficiency can be further improved.

  In the key operation reproduction method, the reproduction step may transmit the reproduction information via a system control service that transmits the key event information to the application.

  According to the present invention, when the reproduction step transmits the reproduction information via the system control service that transmits the key event information to the application, the system control service transmits the key event information to the application by an actual key operation. The debugging operation can be performed by adapting the reproduction of the key operation to the actual operation.

  Further, the reproduction step may call a mode switching function for switching to a reproduction mode for accepting only the reproduction information, to the system control service when a reproduction request for key operation is made.

  According to the present invention, when the reproduction step is requested to reproduce the key operation, the system control service automatically calls the function by calling the mode switching function for switching to the reproduction mode that accepts only reproduction information. Since the mode is shifted to the playback mode, it is possible to prevent the key event from being input from the operation panel which is unnecessary for the key operation playback.

  In the key operation reproduction method, the key operation reproduction request may be generated when a plurality of predetermined keys are input from the operation panel.

  According to the present invention, it is possible to shift to the reproduction mode by inputting a plurality of keys.

  The system control service may include an activation step for executing an activation function for activating a process for executing the reproduction step when a key operation reproduction request is made.

  According to the present invention, when the key operation reproduction process is performed, the activation step for executing the activation function for activating the process for executing the reproduction step by the system control service when the key operation reproduction request is made is included. It is not necessary to restart the image forming apparatus, and usability during debugging can be improved.

  Also, a notification step of notifying the system control service of a stop request when the key operation playback process is completed, and executing the playback step when the system control service receives the stop request notification And a stop step for terminating the process.

  According to the present invention, a notification step of notifying the system control service of a stop request when the key operation playback process is completed, and a process of executing the playback step when the system control service receives the stop request notification Including the stop step for ending the process, the process of automatically executing the key monitoring step can be ended at the end of the key operation reproduction process, and the usability during debugging can be improved.

  The present invention also provides an image forming apparatus that includes an operation panel and provides a user service related to image forming processing based on a key operation from the operation panel, and acquires the key operation as key event information. It can also be configured as an image forming apparatus characterized by comprising means.

  According to the present invention, since the key operation is acquired as the key event information, it is possible to easily reproduce the key operation at the time of occurrence of the failure, and the debugging operation of the image forming apparatus can be performed efficiently.

  The key monitoring means may receive key event information distributed by a communication driver of the operation panel.

  According to the present invention, key event information can be distributed using a communication driver.

  The image forming apparatus includes a hardware resource used in the image forming process and an application for performing a process specific to the user service related to the image forming process, and further between the application and the hardware resource. A system control service for controlling the operation panel, the system control service acquires a user's key operation from the operation panel as key event information, and the key monitoring means is a process with the system control service. The key event information may be received from the system control service through intercommunication.

  According to the present invention, the key event information is received from the system control service through inter-process communication between the system control service and the system control service, which is included in the control service and acquires user key operations from the operation panel as key event information. The key event information by the key operation can be easily obtained by using the inter-process communication in the image forming apparatus in which a large number of software operates, and can be used as debug information. it can. For this reason, it is possible to easily reproduce the key operation at the time of occurrence of the failure, and it is possible to efficiently debug the image forming apparatus.

  The image forming apparatus may further include a key event storage unit that stores a plurality of key event information received from the system control service as key history data in a storage unit.

  According to the present invention, the key event storage means for storing the plurality of key event information received from the system control service in the storage means as key history data is further provided, so that the key event information over time by a series of key operations can be obtained. It can be left as history data, and it becomes easy to reproduce the operation at the time of failure by a series of key operations, and the efficiency of debugging work can be further improved.

  The key monitoring means further includes key event processing means for adding time information to the received key event information, and the key event storage means displays the key event information with the time information added to the key history data. It is good also as storing in the said memory | storage means.

  According to this invention, the key monitoring means further includes key event processing means for adding time information to the key event information received by the key monitoring means, and the key event storage means stores the key event information with the time information added as key history data. By storing it in the means, it is possible to recognize the timing of a series of key operations based on the time information, and to reproduce the key operations by synchronizing the actual key operations and software operations, making debugging work efficient Can be further improved.

  The key event storage means may further transmit the key history data to a terminal connected to a network.

  According to the present invention, the key event storage means transmits the key history data to the terminal connected to the network, so that the key history data of the key event information is directly left on the remote terminal used by the user who performs the debugging work. It is possible to improve usability when performing debugging work at a location distant from the image forming apparatus.

  The key monitoring unit and the key event storage unit may operate as different processes, and the key history data may be transmitted and received by inter-process communication between the key monitoring unit and the key event storage unit.

  In the present invention, the key monitoring means and the key event storage means operate as different processes, and the key event storage means is monitored by transmitting and receiving key history data by inter-process communication between the key monitoring means and the key event storage means. It can be provided independently from the means, and the configuration of the key monitoring means can be prevented from becoming complicated.

  Further, the key event processing means may be a thread generated within the process of the key monitoring means.

  According to the present invention, since the key event processing means is a thread generated within the process of the key monitoring means, both the data is processed even when the key operation and other data processing are performed in a short time or almost simultaneously. Processing can be executed in parallel, and debugging work can be realized in the same situation as the actual operation. Even when time information is added to key event information, there is no deviation from the actual time. For this reason, the accuracy of the debugging work can be ensured.

  Further, the present invention is an image forming apparatus that includes an application for performing processing for user service related to image forming processing and an operation panel, and provides the user service based on a key operation from the operation panel, Storage means for storing key event information corresponding to the key operation as key history data, and generating reproduction information including the key event information based on the key history data, and transmitting the reproduction information to the application The image forming apparatus can also be configured to include a reproducing unit that reproduces key operations.

  According to the present invention, the storage means that stores the key event information corresponding to the key operation as the key history data, the reproduction information including the key event information is generated based on the key history data, and the reproduction information is transmitted to the application. And replaying means for replaying key operations, it is possible to easily perform reproducibility and automation of operations when repeatedly replaying and evaluating a specific key operation, and debugging efficiency and evaluation Efficiency can be improved.

  The key history data may include key event information to which time information is added, and the reproduction means may transmit the reproduction information at intervals based on the time information.

  According to the present invention, the key history data includes the key event information to which the time information is added, and the reproduction means transmits the reproduction information at intervals based on the time information, so that the user actually performs a series of key operations. Therefore, it is possible to automatically reproduce at intervals of the key operation, and further improve the debugging work efficiency and the evaluation efficiency.

  Further, the storage means further stores drawing information output to the operation panel as drawing history data, and the saved data acquisition means further acquires the drawing history data stored in the storage means. The reproducing means may compare the drawing information transmitted from the application by the reproduced key operation with the drawing information of the drawing history data, and notify the user if it does not match. Good.

  According to this invention, the storage means further stores the drawing information output to the operation panel as drawing history data, the saved data acquisition means acquires the drawing history data stored in the storage means, and the reproduction means reproduces it. The drawing information sent from the application by the operated key operation is compared with the drawing information of the drawing history data, and if they do not match, the fact is notified to the user, and the application is displayed on the operation panel by the key operation reproduction process. It is possible to automatically determine whether or not the drawing information displayed on the screen is normal, and the debugging efficiency and the evaluation efficiency can be further improved.

  The image forming apparatus includes a system control service interposed between hardware resources used in image forming processing and the application, and the system control service includes means for transmitting the key event information to the application. The playback means may transmit the playback information via the system control service.

  According to the present invention, the system control service for transmitting the key event information to the application is further provided, and the playback means transmits the playback information via the system control service, so that the system control service performs the key event information by the actual key operation Can be debugged by adapting the reproduction of key operations to the actual operation.

  Further, the system control service defines a mode switching function for switching to a reproduction mode that accepts only reproduction information transmitted from the reproduction means, and the reproduction means is configured to receive the key operation reproduction request when The mode switching function may be called for the system control service.

  According to the present invention, the system control service defines the mode switching function for switching to the playback mode that accepts only the playback information transmitted from the playback means, and when the playback means has made a key operation playback request, the system control service By calling the mode switching function for the service, the mode is automatically shifted to the playback mode by the function call, so that it is possible to prevent the key event from being input from the operation panel which is unnecessary for the key operation playback.

  Further, the image forming apparatus may include means for generating a reproduction request for the key operation when a plurality of predetermined keys are input from the operation panel.

  According to the present invention, it is possible to shift to the reproduction mode by inputting a plurality of keys.

  The system control service may define an activation function that activates the process of the reproducing means, and may execute the activation function when a key operation reproduction request is made.

  According to this invention, the system control service defines a start function for starting the process of the playback means, and when performing a key operation playback process by executing the start function when a key operation playback request is made. Therefore, it is not necessary to restart the image forming apparatus, and usability during debugging can be improved.

  In addition, when the reproduction process of the key operation is completed, the reproduction unit performs a stop request notification to the system control service, and when the system control service receives the stop request notification, the reproduction unit The process may be terminated.

  According to the present invention, when the reproduction means finishes the key operation reproduction process, the reproduction control unit issues a stop request notification to the system control service, and the system control service terminates the reproduction unit process when receiving the recording stop request notification. By doing so, the process of the playback means can be automatically ended at the end of the key operation playback process, and usability during debugging can be improved.

  As described above, according to the present invention, by using the drawing information as debug information, the drawing information on the operation panel at the time of failure can be easily reproduced, and the debugging operation of the image forming apparatus can be performed. Can be done efficiently.

  Exemplary embodiments of a key operation monitoring method, a drawing information acquisition method, a key operation reproduction method, a program for causing a computer to execute these methods, and an image forming apparatus according to the present invention are described in detail below with reference to the accompanying drawings. explain.

(Embodiment 1)
FIG. 1 is a block diagram showing a configuration of an image forming apparatus (hereinafter referred to as “multifunction machine”) according to Embodiment 1 of the present invention. As shown in FIG. 1, the multifunction peripheral 100 includes hardware such as a monochrome line printer (B & W LP) 101, a color line printer (Color LP) 102, a scanner 103, a facsimile 104, a hard disk 105, and a network interface 106. The software group 110 includes a hardware resource and includes a platform 120 and an application 130.

  The platform 120 interprets a processing request from an application and generates a hardware resource acquisition request, and a system resource manager that manages one or a plurality of hardware resources and arbitrates the acquisition request from the control service. (SRM) 123 and a general-purpose OS 121.

  The control service is formed of a plurality of service modules, and includes an SCS (system control service) 122, an ECS (engine control service) 124, an MCS (memory control service) 125, an FCS (fax control service) 127, and an NCS ( Network control service) 128 and key monitor 117. The platform 120 has an application program interface (API) that can receive a processing request from the application 130 by a predefined function.

  The general-purpose OS 121 is a general-purpose operating system such as UNIX (registered trademark), and executes the software of the platform 120 and the application 130 in parallel as processes.

  The key monitor 117 receives a user's key operation from the operation panel 210 as key event information from the SCS 122 and receives drawing information displayed on the operation panel 210 by each application from each application. Then, the key monitor 117 adds a time stamp (time information) to the received key event information and drawing information, and stores them as history data in the hard disk 105. Further, the key monitor 117 transmits a key event to the SCS 122 based on the history data and performs a key operation reproduction process. The key monitor 117 constitutes key monitoring means, drawing information acquisition means, and reproduction means in the present invention.

  The process of the SRM 123 performs system control and resource management together with the SCS 122. The SRM123 process uses hardware resources such as engines such as a scanner unit and printer unit, memory, HDD file, and host I / O (Centro I / F, network I / F, IEEE 1394 I / F, RS232C I / F, etc.). Arbitration is performed according to the request from the upper layer to be used, and execution control is performed.

  Specifically, the SRM 123 determines whether the requested hardware resource is available (whether it is not used by another request), and if it is available, the requested hardware resource is used. Tell the upper layer that it is possible. In addition, the SRM 123 performs use scheduling of hardware resources in response to a request from an upper layer, and directly executes request contents (for example, paper conveyance and image forming operation, memory allocation, file generation, etc. by a printer engine). .

The process of the SCS 122 performs application management, operation unit control, system screen display, LED display, resource management, interrupt application control, and the like. Further, the process of the SCS 122 acquires a key operation from the operation panel 210 as a key event, transmits it to each application, and transmits it to the key monitor 117. The SCS 122 implements a mode switching function. This mode switching function is executed by a function call from the key monitor 117. By executing the mode switching function, the SCS process 122 cuts off the key event from the operation panel 210 and shifts to a playback mode in which only the key event information from the key monitor 117 is accepted.
The process of the ECS 124 controls an engine of hardware resources including a monochrome line printer (B & W LP) 101, a color line printer (Color LP) 102, a scanner 104, a facsimile 104, and the like.

  The MCS 125 process acquires and releases an image memory, uses a hard disk device (HDD), compresses and decompresses image data, and the like.

  The FCS 127 process includes facsimile transmission / reception using PSTN / ISDN network from each application layer of the system controller, registration / quotation of various facsimile data managed by BKM (backup SRAM), facsimile reading, facsimile reception printing, and fusion transmission / reception. Provides an API to do.

  The NCS 128 is a process for providing a service that can be used in common for applications that require network I / O. Data received from the network side according to each protocol is distributed to each application, and data from the application is networked. Intermediary when sending to the side.

  The application 130 includes a printer application 111 that is a printer application having a page description language (PDL), PCL, and postscript (PS), a copy application 112 that is a copy application, and a fax application 113 that is a facsimile application. , A scanner application 114 as a scanner application and a net file application 115 as a network file application.

  The printer application 111, the copy application 112, the fax application 113, and the scanner application 114 each include an OCS library 126 therein. That is, the programs of these applications are executable files linked (coupled) with the OCS library 126. Here, the OCS library 126 registers various functions for controlling an operation panel (operation panel) serving as information transmission means between the operator (user) and the main body control. Each application is registered in the OCS library 126. By executing the drawing function, drawing information such as windows, buttons, other characters and figures is displayed on the display section of the operation panel.

  FIG. 2 is a hardware configuration diagram of the multifunction peripheral 100 according to the first embodiment shown in FIG. As shown in FIG. 2, the multifunction peripheral 100 includes a controller board 200 in which a CPU 202, SDRAM 203, SRAM 208, flash memory 204, HD 205, and the like are connected to the ASIC 201, an operation panel 210, a fax control unit (FCU) 220, It comprises a USB 230, an IEEE1394 240, and a printer 250. The operation panel 210 is directly connected to the ASIC 201, and the FCU 220, USB 230, IEEE1394 240, and printer 250 are connected to the ASIC 201 via the PCI bus. The flash memory 204 stores the above-described applications and control services that constitute the platform 120 and programs of the SRM 123.

  The operation panel 210 is an operation panel in which a user gives an instruction for selecting a function to the multifunction peripheral 100. The operation panel 210 includes a display unit such as a touch panel. Functions such as a selection instruction for each function, magnification specification, sorting, and stapling from the printer application 111, the copy application 112, the fax application 113, and the scanner application 114 are provided on the display unit. Selection instruction buttons such as selection instruction, OK, and cancel, and drawing data such as windows, other characters, and graphics are displayed via the OCS library 126.

  Further, when the user presses (touches) a key such as a button displayed on the display unit (touch panel) of the operation panel 210, the key operation pressed by the user is notified as a key event in the SCS 122.

  FIG. 3 is a block diagram of a configuration of the key monitor 117 according to the first embodiment. As shown in FIG. 3, the key monitor 117 includes a message queue 311, an SCS data processing unit 301, an OCS data processing unit 302, a remote data processing unit 303, a data determination processing unit 304, and a stored data reading unit 305. A data reproduction unit 306, a data printing unit 307, and a data storage unit 308 are provided. Here, the SCS data processing unit 301 is a key event processing unit in the present invention, the OCS data processing unit 302 is a drawing information processing unit in the present invention, and a stored data reading unit 305 is a stored data acquisition unit in the present invention. The unit 306 constitutes reproduction means in the present invention, and the data storage unit 308 constitutes key event storage means and drawing information storage means in the present invention.

  The message queue 311 stores messages transmitted from the SCS process 122, the application 130 (each application 111 to 114), and the NCS 128. In this message queue 311, key event information is transmitted from the SCS process 122, and drawing information is transmitted and stored from the applications 111 to 114. A command transmitted from a remote PC 320 connected to a network 330 such as a LAN is stored in the message queue 311 via the NCS process 128.

  FIG. 4 is a data structure diagram of a message transmitted to the message queue 311. As shown in FIG. 4, the message includes a sender that indicates the sender of the message, an application ID that indicates an application that generates and uses key events and drawing information, a data attribute that indicates the type of message, and each field of data. Consists of

  Codes of “SCS”, “OCS”, “internal”, and “remote” are stored in each source and transmitted in the source field. Here, when the message is a command transmitted from the remote PC 320, “remote” is set as the transmission source. Note that, when the transmission source is “internal”, this indicates that the history data is stored in the hard disk 105, but the history data is transmitted to the message queue 311 in the key monitor 117 of the first embodiment. There is no.

  In the data attribute field, codes of “key event”, “drawing”, and “command” are stored at the transmission source. In the case of “key event”, the message is key event information, in the case of “drawing”, the message is drawing information, and in the case of “command”, the message is a command. Show. Here, when the data attribute is drawing information, there are two types, that is, a case where the transmission source is “OCS” and a case where it is “internal”. The case of “internal” corresponds to the drawing information in the history data stored in the hard disk 105.

  The data stored in the data field differs depending on the data attributes of key event information, drawing information, and command. FIG. 5A is a data structure diagram of key event information stored in the message queue 311 (that is, before processing by the SCS data processing unit 301). As shown in FIG. 5A, in the key event information, “SCS” is set in the transmission source field, and “key event” is set in the data attribute field in the SCS of the transmission source. In the key code field, a key code which is an identification code of the key operated on the operation panel 210 is set. In the key pressed state field, whether or not the key is pressed is set. In the key valid / invalid field, the key code is set. A code indicating whether or not the key corresponding to the code is valid is set.

  FIG. 6A is a data structure diagram of drawing information stored in the message queue 311 (that is, before processing by the OCS data processing unit 302). As shown in FIG. 6A, in the drawing information, “OCS” is set in the transmission source field, and “drawing” is set in the data attribute field in the OCS library 126 of the application 111 to 114 of the transmission source. In the drawing data field, drawing data such as a window ID, an item ID indicating an attribute such as a shaded display such as a button, character information, and graphic information is set in the OCS library 126 of the transmission source application 111 to 114.

  FIG. 7 is a data structure diagram of commands stored in the message queue 311. As shown in FIG. 7, in the case of a command, “remote” is set in the transmission source field, and “command” is set in the data attribute field on the remote PC 320 as the transmission source. In the command data field, identification data for each command such as a recording command and a reproduction command is set by the remote PC 320 that is the transmission source.

The SCS data processing unit 301 is a thread that is generated and operates in the process of the key monitor 117, acquires key event information from the message queue 311, performs data analysis, and adds a time stamp.
The OCS data processing unit 302 is a thread that is generated and operates in the process of the key monitor 117, acquires drawing information from the message queue 311, performs data analysis, and adds a time stamp.

  FIG. 9 is a flowchart illustrating a procedure of data processing performed by the SCS data processing unit 301 and the OCS data processing unit 302. First, the data processing units 301 and 302 retrieve data (messages) to be processed from the message queue 311 at regular intervals, and if there is data to be processed, read the data (step S901).

  Specifically, the SCS data processing unit 301 searches the message queue 311 for data having the transmission source “SCS” and the data attribute “key event”, and determines that such data is the key event information transmitted from the SCS 122. And read. In addition, the OCS data processing unit 302 searches the message queue 311 for data having the transmission source “OCS” and the data attribute “drawing”, and the data is drawn by the applications 111 to 114 using the OCS library 126. It is determined to be information and is read.

  Next, the current time is acquired as a time stamp from a timer or the like provided in the multifunction device 100 (step S902). Then, data analysis is performed to determine whether or not the data read in step S901 is compatible with the data structure to be processed by the data processing units 301 and 302 (step S903).

  Specifically, whether the data read by the SCS data processing unit 301 has the data structure of the key event information shown in FIG. 5A, the data read by the OCS data processing unit 302 is shown in FIG. Analyzes whether the data structure of the drawing information shown is obtained.

  Then, by data analysis, it is determined whether or not the read data is correct (step S904). If the read data is not correct, the process is terminated without performing subsequent processing.

  If the data is correct, the current time acquired in step S902 is added to the data as a time stamp, and further the data length is added (step S905), and then passed to the data processing determination unit 304 (step S906). ). In order to make the determination process in the data determination processing unit 304 easier, a process of adding an identifier such as data reproduction, data printing, or data storage to the key event information may be performed.

  FIG. 5B is a data structure diagram of key event information after processing by the SCS data processing unit 301, and FIG. 6B is a data structure diagram of drawing information after processing by the OCS data processing unit 302. . As shown in FIG. 5B and FIG. 6B, as a result of the processing of the key event information by the SCS data processing unit 301 and the processing of the drawing information by the OCS data processing unit 302, the data length and time stamp data are first. To be added.

  The remote data processing unit 303 performs data processing of commands transmitted from the remote PC 320 via the network, and is a thread that is generated and operates in the process of the key monitor 117. However, the time stamp and data length added by the SCS data processing unit 301 and the OCS data processing unit 302 are not added. The remote data processing unit 303 searches the message queue 311 for data that is the transmission source “remote”, and determines that such data is a command transmitted from the remote PC 320 and reads it. Then, data analysis is performed to determine whether the structure of the read data conforms to the data structure of the command shown in FIG. 7. If the data is correct, the read data is transferred to the data determination processing unit 304.

  The data determination processing unit 304 checks the source field, the data attribute field, or the data field for the data delivered from the data processing units 301, 302, and 303, and the data reproduction unit 306 and the data printing unit 307. To the data storage unit 308. Specifically, when the transmission source is “internal” or “OCS”, and when the transmission source is “remote”, the data attribute is “command”, and the data content is a reproduction command, the data is stored as data. Transfer to the playback unit 306. Accordingly, the history data, the drawing information shown in FIG. 6B, and the playback command having the structure shown in FIG. 7 are input to the data playback unit 306.

  The data determination processing unit 304 passes the data to the data printing unit 307 and the data storage unit 308 when the transmission source is “SCS” or “OCS”. Accordingly, the key event information and the drawing information to which the time stamps shown in FIGS. 5B and 6B are added are input to the data printing unit 307 and the data storage unit 308.

  The data storage unit 308 stores the key event information and the drawing information to which the time stamp is added in the hard disk (HD) 105 as history data. At this time, the source field of each data is set to “internal” and stored. FIG. 8A is a data structure diagram of each record of history data (internal data). As shown in FIG. 8A, “internal” is set in the transmission source field of the history data, and the data field is the same data as the key event information or the drawing information. Here, the history data is composed of a plurality of records collected over time with the data shown in FIG. 8A as one record.

  The data printing unit 307 prints key event information and drawing information by the printers 101 and 102 when a print command is transmitted from the remote PC 320.

  The saved data reading unit 305 reads out the history data shown in FIG. 8A from the hard disk 105 and transfers it to the data determination processing unit 304 in a playback mode described later.

  In the playback mode, the data playback unit 306 calls a mode switching function for switching to the playback mode to the SCS process 122, generates playback information from the history data, transmits the playback information to the SCS process 122, and generates a key based on the history data. The operation is played back.

  FIG. 10 is a flowchart illustrating a procedure of key operation reproduction processing by the data reproduction unit 306 of the key monitor 117 according to the first embodiment. As shown in FIG. 10, the data reproducing unit 306 first checks the data attribute of the data input from the data determination processing unit 304 (step S1001). If the data attribute is “command” and the data field is a reproduction command, the mode switching function is called to the SCS process 122 (step S1002). As a result, the SCS process 122 executes the mode switching function, blocks the key event from the operation panel 210, and shifts to a playback mode that accepts only playback information (key event information) from the key monitor 117.

  When the data attribute is “key event”, since the data input from the data determination processing unit 304 is the history data of the key event information, reproduction information in which the data length and the time stamp are deleted from the history data is generated. (Step S1003). FIG. 8B is a data structure diagram of the generated reproduction information. This reproduction information is different from the key event information shown in FIG. 5A only in that it is “internal”. Then, the generated reproduction information is transmitted to the SCS process 122 (step S1004). This process is performed for key event information of all records included in the history data. Further, such a plurality of pieces of reproduction information are transmitted at intervals of the difference between the time stamp deleted in step S1003 and the time stamp of the record in the next history data. Accordingly, the key operation at the same interval as the interval at which the user actually operated the key on the operation panel 210 is reproduced, and the debugging work more suitable for the actual operation can be performed.

  On the other hand, when the data attribute is “drawing”, the data input from the data determination processing unit 304 is the drawing information in the history data and the drawing information received from the applications 111 to 114 via the OCS library 126, that is, the key. This is drawing information generated as a result of execution of the applications 111 to 114 in the reproduction of the operation. Therefore, both pieces of drawing information are compared (step S1005), and it is determined whether or not they match (step S1006).

  If they match as a result of the comparison, it is determined that the display of the drawing information on the operation panel 210 by the key operation reproduction is normal. On the other hand, if they do not match, it is determined that there is an abnormality in the display of the drawing information on the operation panel 210 by the key operation reproduction, and an error is displayed to the user of the operation panel 210 or the remote PC 320 (step S1007).

  Next, a key operation recording process by the multifunction peripheral 100 including the key monitor 117 configured as described above will be described. FIG. 11 is an explanatory diagram showing the flow of data among the operation panel 210, the key monitor 117, the SCS 122, and the application in the key operation recording process. FIG. 12 is an explanatory diagram showing a data flow mainly inside the key monitor 117 in the key operation recording process.

  First, when a recording command is transmitted from the remote PC 320 (step S1201), the NCS process 128 of the multifunction peripheral 100 receives the recording command via the network and registers it in the message queue 311 of the key monitor 117 (step S1202).

  The remote data processing unit 303 of the key monitor 117 acquires this recording command from the message queue 311 (step S1203), performs data analysis, and thereby starts key operation recording processing. This recording command is output to the data determination processing unit 304 (step S1204).

  When there is a user key operation on the operation panel 210, key event information of the operated key is notified to the SCS process 122 (step S1205). The SCS process 122 transmits the notified key event information to the applications 111 to 114 specified by the application ID, and registers it in the message queue 311 of the key monitor 117 by interprocess communication such as message transmission or function call ( Step S1206).

  The SCS data processing unit 301 of the key monitor 117 acquires key event information from the message queue 311 (step S1207), performs the above-described data analysis and time stamp addition, and sends the key event information to the data determination processing unit 304. Deliver (step S1208).

  The data determination processing unit 304 determines the transmission source of the key event information and outputs the key event information to the data storage unit 308. Then, the history data in which the transmission source is set to “internal” is stored in the hard disk 105 by the data storage unit 308.

  The acquisition process of key event information and the storage process of history data as described above are performed for each key operation on the operation panel 210, and a plurality of key event information is sequentially recorded in the history data.

  On the other hand, the applications 111 to 114 that have received the key event information from the SCS process 122 perform application-specific processing, but at this time, drawing information may be output to the operation panel 210 (step S1209). At this time, the applications 111 to 114 execute the drawing information transmission function of the OCS library 126. This drawing information transmission function is a function that is paired with the function of the OCS library 126 that the applications 111 to 114 output the drawing information to the operation panel 210. The drawing information that is the same as the drawing information output to the operation panel 210 is the key. This is transmitted to the message queue 311 of the monitor 117. Therefore, the drawing information output to the operation panel 210 is also transmitted to the message queue 311 of the key monitor 117 (step S1210).

  The OCS data processing unit 302 of the key monitor 117 acquires drawing information from the message queue 311 (step S1211), performs the above-described data analysis and time stamp addition, and passes the drawing information to the data determination processing unit 304. (Step S1212).

  The data determination processing unit 304 determines the source of the drawing information and outputs key event information to the data storage unit 308 (step S1213). Then, the history data in which the transmission source is set to “internal” is stored in the hard disk 105 by the data storage unit 308 (step S1214).

  The processing for obtaining drawing information and storing history data as described above is performed every time drawing information is transmitted to the operation panel 210 in the applications 111 to 114, and a plurality of drawing information is sequentially recorded in the history data. It will be done.

  In the key monitor 117 according to the first embodiment, since both the SCS data processing unit 301 and the OCS data processing unit 302 operate as threads, data processing by the SCS data processing unit 301 and data by the OCS data processing unit 302 are performed. Processing is performed in parallel. Therefore, even when key operation and output of drawing information to the operation panel 210 are performed for a short time or almost simultaneously, both data processing can be executed in parallel, and the time stamp is shifted from the actual time. There is no end. By such key operation recording processing, history data including key event information and drawing information is stored in the hard disk 105.

  Next, key operation reproduction processing by the multifunction peripheral 100 including the key monitor 117 according to the first embodiment will be described. FIG. 13 is an explanatory diagram showing a data flow among the operation panel 210, the key monitor 117, the SCS 122, and the application in the key operation reproduction process. FIG. 14 is an explanatory diagram showing a data flow mainly inside the key monitor 117 in the key operation reproduction process.

  First, when performing key operation reproduction processing, the multifunction peripheral 100 is restarted. When all the processes and the key monitor 117 are restarted, a reproduction command is transmitted from the remote PC 320 (step S1401). The NCS process 128 of the multifunction device 100 receives the playback command via the network and registers it in the message queue 311 of the key monitor 117 (step S1402).

  The remote data processing unit 303 of the key monitor 117 acquires this reproduction command from the message queue 311 (step S1403), performs data analysis, and outputs it to the data determination processing unit 304 (step S1404).

  The data determination processing unit 304 recognizes that the transmission source of the input data is “remote”, the data attribute is “command”, and the command data is a reproduction command, and the reproduction command is transmitted to the data reproduction unit 306. (Step S1405).

  Since the input data is a playback command, the data playback unit 306 calls a mode switching function to the SCS process 122 and requests the SCS 122 to switch to the playback mode (step S1406).

  In the SCS process 122, a mode switching function is executed, and a transition is made to the playback mode. As a result, as shown in FIG. 13, the SCS process 122 enters the reproduction mode state in which only the reproduction information from the key monitor 117 is input and the key operation from the operation panel 210 is cut off.

  Next, the saved data reading unit 305 reads the history data stored in the hard disk 105 (step S1407), and transfers it to the data determination processing unit 304 (step S1408). Since the origin of the history data is “internal”, the data determination processing unit 304 transfers the history data to the data reproduction unit 306 (step S1409).

  The data reproduction unit 306 determines the data attribute for each record of the input history data. If the data attribute is “key event”, the reproduction unit 306 generates reproduction information from which the data length and the time stamp have been deleted. The reproduction information is transmitted to the process 122 by inter-process communication called message transmission (step S1410).

  In the SCS process 122, the key code of the received reproduction information is transmitted to the applications 111 to 114, thereby performing key operation reproduction processing based on the history data. The transmission of reproduction information to the SCS process 122 by the data reproduction unit 306 is performed by generating reproduction information for all records having a data attribute “key event” in records constituting the history data. At this time, the transmission of the reproduction information is calculated based on the time indicated by the time stamp deleted in the previous reproduction information generation process and the time indicated by the time stamp deleted from the reproduction information to be currently transmitted. Performed at intervals. That is, the reproduction information is transmitted and the key operation is reproduced at a time interval of the actual user's key operation.

  Note that the data playback unit 306 generates playback information when the data attribute is “key event”. However, if the data attribute is “draw” and the source is “internal”, the data playback unit 306 performs playback processing. Keep it.

  In the SCS process 122, the key event in the reproduction information received from the data reproduction unit 306 is transmitted to the applications 111 to 114 to reproduce the key operation. As a result, the applications 111 to 114 are displayed on the operation panel 210. When drawing information such as a button to be transmitted is transmitted (step S1411), the drawing information is received by the key monitor 117 (steps S1412, S1413, and S1414) as in the key operation recording process described with reference to FIG.

  The drawing information received from the applications 111 to 114 is sent to the data reproduction unit 306 by the data determination processing unit 304 because the transmission source is “OCS” (step S1415). Since this drawing information has “OCS” as the transmission source and “drawing” as the data attribute, the data reproducing unit 306 determines whether or not the drawing information matches the drawing information of the history data. to decide. If they match, it is determined that the drawing information displayed on the operation panel 210 by the applications 111 to 114 by the key operation is normal. If they do not match, an abnormality has occurred in the applications 111 to 114 and the like. The error is notified to the operation panel 210 or the remote PC 320. As described above, it is possible to determine whether or not the drawing information displayed on the operation panel 210 is normal by reproducing the key operation.

  As described above, in the MFP 100 according to the first embodiment, the key monitor 117 acquires key event information from the operation panel 210 via the SCS process 122 by inter-process communication, and also from the applications 111 to 114 to the operation panel 210. Is obtained by inter-process communication, and a time stamp is added and stored as historical data over time in the hard disk 105. Therefore, a series of key operations can be easily reproduced at time stamp intervals. Useful debug information can be obtained.

  In the MFP 100 according to the first embodiment, reproduction information is generated from the history data and transmitted to the SCS process 122 to perform key operation reproduction. Therefore, a series of key operation reproduction is repeatedly and automatically executed. It is possible to improve debugging efficiency and evaluation efficiency.

  In the MFP 100 according to the above-described embodiment, when the key operation playback process is started, a playback command is transmitted from the remote PC 320 to the MFP 100, and the MFP 100 receives the playback command. Although the mode switching function is called, a reproduction command can be generated in the multi-function device 100 by another method, and the mode switching function can be called.

For example, when a special combination of key inputs (eg “[Clear]” + “1” + “2” + “3” + “[Clear]”) is received from the operation panel, the mode switching function is called. Alternatively, a dedicated key is provided in the multifunction device 100, and the mode switching function is called when the dedicated key is pressed.
(Embodiment 2)
The MFP 100 according to the first embodiment stores the history data of the key event information and the drawing information in the hard disk 105. However, the MFP 100 according to the second embodiment further stores the history data on the remote PC 320. To send to.

  Since the configuration and hardware configuration of the multi-function device 100 according to the second embodiment are the same as those of the multi-function device 100 according to the first embodiment shown in FIG. 1 and FIG.

  FIG. 15 is an explanatory diagram mainly showing the configuration of the key monitor 117 and the data flow during key operation recording. As shown in FIG. 15, the MFP 100 according to the second embodiment is different from the MFP 100 according to the first embodiment in that a shared memory 107 and a log generation unit 129 are provided.

  The log generation unit 129 is a process that operates on the multifunction peripheral 100, acquires key event information and drawing information from the shared memory 107 described later, generates history data, and generates the generated history data via the NCS process 128 via a network. Are transmitted to the remote PC 320 connected to the PC and stored in the hard disk 105. In addition, the log generation unit 129 stores the history data stored in the hard disk 105 in the shared memory 107. The log generation unit 129 constitutes a key event storage unit and a drawing information storage unit in the present invention. The log generation unit 129 may be configured to receive history data from the remote PC 320 and store it in the shared memory 107.

  The shared memory 107 is an area secured in the SDRAM 203 and accessible in common from the process of the key monitor 117 and the process of the log generation unit 129.

  Next, a key operation recording process in the MFP 100 according to the second embodiment configured as described above will be described. The processing (steps S1501 to S1513) from the transmission of the recording command from the remote PC 320 to the delivery of the key event information and drawing information to the data storage unit 308 (steps S1501 to S1513) in FIG. 12 described in the MFP 100 of the first embodiment. Since it is the same as that, description is abbreviate | omitted.

  The data storage unit 308 transmits the key event information (FIG. 5B) and the drawing information (FIG. 6B) to which the time stamp is added to the log generation unit 129 by inter-process communication using the shared memory 107. . That is, the data storage unit 308 writes the key event information (FIG. 5B) and the drawing information (FIG. 6B) to which the time stamp is added to the shared memory 107 (step S1514). On the other hand, the process of the log generation unit 129 accesses the shared memory 107 and obtains key event information and drawing information from the shared memory 107 (step S1515), whereby the key event information and drawing information of both processes are communicated. Delivery takes place.

  The log generation unit 129 generates history data by combining a plurality of key event information and a plurality of drawing information read from the shared memory 107. The history data is stored in the hard disk 105 (step S1516), and the network address of the remote PC 320 is designated and transmitted to the remote PC 320 via the network via the NCS process 128 (steps S1517 and S1518).

  On the other hand, in the key operation reproduction process, when the key monitor 117 reads the history data, the log generation unit 129 first reads the history data from the hard disk 105 (step S1519) and writes it to the shared memory 107 (step S1520). Then, the log generation unit 129 process and the key monitor 117 process that the stored data reading unit 305 of the key monitor 117 accesses the shared memory 107 and reads the history data stored in the shared memory 107 (step S1521). History data is acquired by inter-communication. The subsequent key operation reproduction processing procedure is the same as that of the MFP 100 of the first embodiment described with reference to FIG.

As described above, in the MFP 100 according to the second embodiment, since history data is transmitted to the remote PC 320 connected to the network, the history data of key event information and drawing information is used remotely by a user who performs debugging work. This can be left directly on the PC 320, which is convenient for the user when performing debugging work away from the multifunction peripheral 100.
(Embodiment 3)
The multifunction peripheral 100 according to the first and second embodiments needs to restart the multifunction peripheral 100 and shift to the reproduction mode before executing the key operation reproduction process. The multifunction peripheral according to the third embodiment Reference numeral 100 dynamically changes to the reproduction mode to perform key operation reproduction processing.

  Since the configuration and hardware configuration of the multi-function device 100 according to the third embodiment are the same as those of the multi-function device 100 according to the first embodiment shown in FIG. 1 and FIG. However, in the MFP 100 of the third embodiment, the SCS 1622 has a start request function for starting the key monitor 117 and a stop function for ending the process of the key monitor 117.

  FIG. 16 is an explanatory diagram illustrating an initial procedure of key operation reproduction processing in the multifunction peripheral 100 according to the third embodiment. When the key operation reproduction process is performed by the key monitor 117, a reproduction command is first transmitted from the remote PC 320 (step S1601). At this time, it is not necessary to restart the multifunction device 100.

  When the NCS process 1628 of the MFP 100 receives the restart command via the network (step S1602), the NCS process 1628 calls the key monitor activation request function to the SCS process 1622 (step S1603).

  In response to the request, the SCS process 1622 executes the key monitor activation request function, whereby the process of the key monitor 117 is generated and activated in the multifunction peripheral 100 (step S1604).

  On the other hand, when the key operation reproduction process is completed, the data reproduction unit 1666 of the key monitor 117 transmits an end notification event message to the SCS process 1622 (step S1605). The SCS process 1622 that has received this end notification event message executes a stop function, whereby the key monitor 117 process disappears (step S1606).

  As described above, in the MFP 100 according to the third embodiment, since the SCS 1622 includes a start function for starting the key monitor 117, the start function is executed when performing the key operation reproduction process. This eliminates the need for restarting and improves usability during debugging.

  In the MFP 100 according to the third embodiment, the key monitor 117 notifies the SCS process 1622 of a stop request when the reproduction process of the key operation is completed, and the SCS process 1622 receives the request and the key monitor 117 receives the request. Therefore, the process of the key monitor 117 can be automatically terminated at the end of the key operation reproduction process, and usability during debugging can be improved.

(Embodiment 4)
In the MFP 100 according to the first to third embodiments, the key event information input from the operation panel 210 is distributed to the application and the key monitor 117 via the SCS 122, but the driver of the operation panel 210 does not pass through the SCS 122. The key event information may be distributed to the application and the key monitor 177. This configuration will be described with reference to FIGS.

  FIG. 17 is a diagram showing the same multifunction device 100 as the multifunction device 100 shown in FIG. 1, with the engine I / F portion shown in more detail.

  As shown in the figure, a hardware-side driver and an OS-side driver are provided corresponding to each hardware, and these drivers constitute an engine I / F. As shown in the figure, in the fourth embodiment, the OS-side OCS driver 2102 receives the key event information from the hardware-side OCS driver 2101, and the OS-side OCS driver 2102 does not pass through the SCS 122. Delivered to the key monitor 117.

  FIG. 18 shows the configuration of the OCS drivers 2101 and 2102 in detail. As shown in the figure, in the OCS driver 2101 on the hardware side, the key operation function unit 2103 detects a key operation input from the operation panel 210 and transmits it to the communication driver 2104 as key event information. The drawing function unit 2105 receives drawing information from the communication driver 2104 and displays drawing data on the operation panel 210. Further, the communication driver 2104 transmits key event information to the communication driver 2106 in the OSC driver 2102 on the OS side.

  In the OSC driver 2102 on the OS side, the communication driver 2106 distributes key event information to each application and the key monitor 117. The drawing information from the application is sent from the communication driver 2106 to the hardware-side OCS driver 2101 using the library function 2107.

  In addition, the part enclosed with the dotted-line circle of the same figure is the structure in Embodiment 1-3. In this case, the key event information is passed to the SCS 122 and distributed from there to each application. In the present fourth embodiment, the function enclosed by the dotted circle is not used for the distribution of the key event information.

  As described above, according to the fourth embodiment, key event information can be distributed to the application and the key monitor 117 without using the SCS 122. It should be noted that the same configuration as that of the first to third embodiments can be adopted except that the key event information is sent to the application and the key monitor 117 without passing through the SCS 122.

  In the MFP 100 according to the first to third embodiments, the key operation interval is calculated from the time stamp added to the key event information or the drawing information. Can be calculated and stored in the history data.

  In the MFP 100 according to the first to third embodiments, the key monitor 117 is provided in the control service layer, and the application program interface can be used for data transmission / reception with the application. For example, the layer may be provided as a key monitor application.

1 is a block diagram illustrating a configuration of a multifunction machine according to a first embodiment. 2 is a hardware configuration diagram of the multifunction machine according to Embodiment 1. FIG. FIG. 2 is a block diagram illustrating a configuration of a key monitor in the multifunction machine according to the first embodiment. 4 is a data structure diagram of a message transmitted to a message queue in the multi-function peripheral according to the first embodiment. FIG. FIG. 5A is a data structure diagram of key event information stored in the message queue in the multi-function peripheral according to the first embodiment. FIG. 5B is a data structure diagram of key event information after processing by the SCS data processing unit. FIG. 6A is a data structure diagram of drawing information stored in the message queue in the multi-function peripheral according to the first embodiment. FIG. 6B is a data structure diagram of drawing information after processing by the OCS data processing unit. FIG. 3 is a data structure diagram of commands stored in a message queue in the multi-function peripheral according to the first embodiment. FIG. 8A is a data structure diagram of each record of history data in the MFP according to the first embodiment. FIG. 8B is a data structure diagram of reproduction information generated in the multifunction machine according to the first embodiment. 4 is a flowchart illustrating a procedure of data processing performed by an SCS data processing unit and an OCS data processing unit of the key monitor 117 in the multifunction peripheral according to the first embodiment. 6 is a flowchart showing a procedure of key operation reproduction processing by a data reproduction unit 306 of the key monitor 117 in the multifunction peripheral according to the first embodiment. FIG. 6 is an explanatory diagram illustrating a data flow between an operation panel, a key monitor, an SCS, and an application in a key operation recording process in the multifunction peripheral according to the first embodiment. FIG. 6 is an explanatory diagram mainly showing a data flow inside a key monitor in a key operation recording process in the multifunction machine according to the first embodiment; FIG. 6 is an explanatory diagram illustrating a data flow among an operation panel, a key monitor, an SCS, and an application in a key operation reproduction process in the multifunction peripheral according to the first embodiment. FIG. 6 is an explanatory diagram mainly showing a data flow in a key monitor 117 in key operation reproduction processing in the multifunction machine according to the first embodiment; FIG. 9 is an explanatory diagram mainly showing the configuration of a key monitor and the flow of data during key operation recording in the multifunction machine according to the second embodiment. FIG. 10 is an explanatory diagram illustrating an initial procedure of key operation reproduction processing in the multifunction machine according to the third embodiment; In Embodiment 4, it is the figure which showed the engine I / F part in detail about the multifunctional machine shown in FIG. In Embodiment 4, it is the figure which showed the structure of OCS driver 2101 and 2102 in detail.

Explanation of symbols

100 MFP 101 Monochrome Line Printer 102 Color Line Printer 103 Scanner 104 Facsimile 105 Hard Disk (HD)
106 Network interface 107 Shared memory 110 Software group 111 Printer application 112 Copy application 113 Fax application 114 Scanner application 115 Net file application 117 Key monitor 120 Platform 121 General-purpose OS
122 1622 SCS
123 SRM
124 ECS
125 MCS
126 OCS Library 127 FCS
128, 1628 NCS
129 Log generation unit 130 Application 200 Controller board 201 ASIC
202 CPU
203 SDRAM (RAM)
204 Flash memory (ROM) 205 HD
208 SRAM
210 Operation panel 230 USB
240 IEEE 1394
250 Printer 301 SCS Data Processing Unit 302 OCS Data Processing Unit 303 Remote Data Processing Unit 304 Data Determination Processing Unit 305 Saved Data Reading Unit 306 Data Reproducing Unit 307 Data Printing Unit 308 Data Storage Unit 311 Message Queue 330 Network 2101, 2102 OCS Driver 2104 2106 Communication driver

Claims (13)

A drawing output to the operation panel in an image forming apparatus comprising an operation panel and an application that executes processing relating to image formation and operates as an application process for outputting drawing information to the operation panel A drawing information acquisition method for acquiring information,
A drawing information acquisition method, wherein the drawing information acquisition means in the image forming apparatus includes a drawing information acquisition step of receiving the drawing information from the application process by inter-process communication.   In the drawing information acquisition step, the drawing information acquisition means receives the drawing information by receiving a call of a drawing information transmission function corresponding to a function for managing the operation panel from the application process. The drawing information acquisition method according to claim 1.   The drawing information acquisition method according to claim 1, further comprising a drawing information storing step of storing a plurality of drawing information received from the application as drawing history data in a storage unit.   The drawing information acquisition means adds time information to the received drawing information in the drawing information acquisition step, and uses the drawing information to which the time information is added as the drawing history data in the drawing information storage step. The drawing information acquisition method according to claim 3, wherein the drawing information is stored in a storage unit.   The drawing information acquiring method according to claim 3, further comprising a step of the image forming apparatus transmitting the drawing history data to a terminal connected to a network.   A program for causing the image forming apparatus to execute each step in the drawing information acquisition method according to claim 1. An image forming apparatus comprising: an operation panel; and an application that executes processing related to image formation and operates as an application process for outputting drawing information to the operation panel.
An image forming apparatus, comprising: a drawing information acquisition unit configured to receive drawing information output from the application process to the operation panel from the application by inter-process communication. The drawing information acquisition unit operates as a server process using the application process as a client,
The application process transmits the drawing information to the drawing information acquisition unit by executing the drawing information transmission function in an operation panel control service library that defines a drawing information transmission function corresponding to a function for controlling the operation panel. The image forming apparatus according to claim 7.   The image forming apparatus according to claim 7, further comprising a drawing information storage unit that stores a plurality of drawing information received from the application process in a storage unit as drawing history data. The drawing information acquisition means further comprises drawing information processing means for adding time information to the received drawing information,
The image forming apparatus according to claim 9, wherein the drawing information storage unit further stores the drawing information to which the time information is added in the storage unit as the drawing history data.   The image forming apparatus according to claim 9, wherein the drawing information storage unit further transmits the drawing history data to a terminal connected to a network.   The drawing information acquisition unit and the drawing information storage unit operate as different processes, and transmit and receive the drawing history data by inter-process communication between the drawing information acquisition unit and the drawing information storage unit. Item 12. The image forming apparatus according to any one of Items 9 to 11.   The image forming apparatus according to claim 10, wherein the drawing information processing unit is a thread generated within a process of the drawing information acquisition unit.

Images