JP5072705B2 - Operating component information display device, electronic device, program analysis device, operating component information display system, operating component information display method, operating component information management method, program analysis method, and program - Google Patents

Description

The present invention relates to an operation component information display device, an electronic device, a program analysis device, an operation component information display system, an operation component information display method, an operation component information management method, a program analysis method, and a program, and more particularly to an operation panel of an electronic device. The present invention relates to an operation component information display device, an electronic device, a program analysis device, an operation component information display system, an operation component information display method, an operation component information management method, a program analysis method, and a program for reproducing a displayed screen.

  In recent years, image forming apparatuses such as a copy, a scanner, a FAX, and a printer are becoming more and more multifunctional in order to cope with diversification of usage methods. As the number of functions increases, the number of operation modes set from the operation panel increases, and the setting operation for obtaining a desired output tends to become complicated or complicated. However, some users do not always use all the functions, and many use only a specific part of the functions. Nevertheless, since a large number of functions are mounted and the cost of development, parts, manufacturing, etc. increases and the image forming apparatus becomes expensive, it is disadvantageous for the user. For a user who uses only a part of functions, only the operation mode input means related to the part of the functions is displayed on the operation panel in an easy-to-understand manner.

  However, the user interface that is easy to use differs depending on the user's proficiency in using the device. For users with low usage frequency, operation errors are likely to occur in a complicated user interface, and time efficiency is poor. Therefore, a simple user interface with limited functions is welcomed.

  On the other hand, users with high usage frequency can use even a slightly complicated operation, and a user interface that can set all functions is required when using many functions. is there.

  In order to solve these problems, various techniques for customizing a screen according to user's preference have been proposed.

On the other hand, a call center is conventionally provided as an inquiry window for operations of the image forming apparatus. Therefore, the user can make an inquiry to the call center by telephone if the operation method is unknown.
JP 2006-345256 A

  However, for image forming devices that offer a highly flexible customization function, the initial screen configuration at the time of shipment and the screen configuration at the time of inquiring to the call center are significantly different, or extended functions are added. There is. In this case, there is a problem that the call center cannot accurately grasp the situation on the customer side and cannot give an appropriate answer.

  The present invention has been made in view of the above points, and is an operation component information display device, an electronic device, a program analysis device, an operation capable of appropriately grasping the contents of a customizable operation screen via a network. An object is to provide a component information display system, an operation component information display method, an operation component information management method, a program analysis method, and a program.

  Therefore, in order to solve the above-described problem, the present invention provides screen information including display information of operation components on the screen displayed on the operation panel of the electronic device and the operation components from the electronic device connected via a network. A receiving means for receiving a program code associated with the screen, a screen reproduction means for displaying a reproduction screen of the operation panel on a display device based on the screen information, and an input to an operation component arranged on the reproduction screen The program code associated with the operation component based on correspondence information management means for managing correspondence information between a keyword that can be included in the program code and a character string indicating an action that occurs in accordance with processing indicated by the keyword And an action display means for displaying on the display device a character string indicating an action caused by the execution of.

  In such an operation component information display device, the contents of an operation screen that can be customized can be appropriately grasped via a network.

  According to the present invention, an operation component information display device, an electronic device, a program analysis device, an operation component information display system, an operation component information display method capable of appropriately grasping the contents of a customizable operation screen via a network, An operation component information management method, a program analysis method, and a program can be performed.

  Hereinafter, embodiments of the present invention will be described with reference to the drawings. FIG. 1 is a diagram showing an example of a system configuration in the embodiment of the present invention. In the figure, one or more operator terminals 10, one or more devices 20, an analysis server 30, and the like can communicate with each other via a wide area network 40 such as the Internet.

  The device 20 is an image forming apparatus (multifunction machine) that realizes a plurality of functions such as copying, facsimile, printer, and scanner in a single casing. In the device 20, the operation screen can be customized. The customization includes not only changing the display mode of existing operation parts (operation parts) (display / non-display or change of display color, etc.), but also new operation screens or operation parts according to function addition (extension), etc. This includes adding (buttons, etc.). In the present embodiment, the device 20 corresponds to an example of an electronic device.

  The operator terminal 10 is a computer such as a PC (Personal Computer) installed in a call center for a user of the device 20 and is used by an operator of the call center. On the operator terminal 10, the state of the operation panel of the device 20 is reproduced (displayed).

  The analysis server 30 analyzes the source code (program code) of the program associated with each component (software or hardware operation component) on the operation panel of the device 20 reproduced in the operator terminal 10 and analyzes the source code. It is a computer that generates information indicating an action (contents of operation of the device 20) caused by the execution of the code.

  FIG. 2 is a diagram illustrating a hardware configuration example of the operator terminal according to the embodiment of the present invention. The operator terminal 10 in FIG. 2 includes a drive device 100, an auxiliary storage device 102, a memory device 103, a CPU 104, an interface device 105, a display device 106, and an input device 107, which are connected to each other via a bus B. And is configured to have.

  A program that realizes processing in the operator terminal 10 is provided by a recording medium 101 such as a CD-ROM. When the recording medium 101 on which the program is recorded is set in the drive device 100, the program is installed from the recording medium 101 to the auxiliary storage device 102 via the drive device 100. However, the program need not be installed from the recording medium 101 and may be downloaded from another computer via a network. In this case, the drive device 100 is not necessary.

  The auxiliary storage device 102 stores the installed program and also stores necessary files and data. The memory device 103 reads the program from the auxiliary storage device 102 and stores it when there is an instruction to start the program. The CPU 104 realizes functions related to the operator terminal 10 in accordance with a program stored in the memory device 103. The interface device 105 is used as an interface for connecting to a network. The display device 106 displays a GUI (Graphical User Interface) or the like by a program. The input device 107 includes a keyboard and a mouse, and is used for inputting various operation instructions.

  The analysis server 30 only needs to include the hardware shown in FIG. However, the drive device 100, the display device 106, and the input device 107 are not necessarily required.

  FIG. 3 is a diagram illustrating a hardware configuration example of the device according to the embodiment of the present invention. In the figure, the device 20 includes hardware such as a controller 201, a scanner 202, a printer 203, a network interface 204, and an operation panel 205.

  The controller 201 includes a CPU 211, a RAM 212, a ROM 213, an HDD 214, and the like. The ROM 213 stores various programs and data used by the programs. The RAM 212 is used as a storage area for loading a program, a work area for the loaded program, and the like. The CPU 211 realizes functions to be described later by processing a program loaded in the RAM 212. The HDD 214 is used to make various data permanent.

  The scanner 202 is hardware for reading image data from a document. The printer 13 is hardware for printing image data on printing paper. The network interface 204 is hardware for connecting to a network (regardless of wired or wireless) such as a LAN (Local Area Network). The operation panel 205 is hardware including buttons, a liquid crystal panel, and the like for receiving input from the user and notifying the user of information.

  FIG. 4 is a diagram illustrating a functional configuration example of the system according to the embodiment of the present invention. In the figure, an operator terminal 10 includes a UI information acquisition unit 11, a UI reproduction unit 12, an action display unit 13, a source code editing unit 14, an event notification unit 15, and the like. The device 20 includes a screen display unit 21, a UI information transfer unit 22, a component information management unit 23, a source code update unit 24, an event processing unit 25, and the like. The analysis server 30 includes a correspondence information table 31, an analysis unit 32, and the like. Note that the functions and the like of each unit will be clarified in the description of the processing procedure.

  Hereinafter, a processing procedure of the system in the present embodiment will be described. First, a processing procedure for reproducing the operation panel 205 of the device 20 on the operator terminal 10 when the user of the device 20 makes an inquiry to the call center by telephone will be described. At this time, the following operation screen is displayed on the operation panel 205 of the device 20 by the screen display unit 21.

  FIG. 5 is a diagram illustrating an example of an operation screen displayed on the operation panel of the device. In the figure, the operation screen 250 is composed of a customization area 251 and a fixed area 252. The customization area 251 is an area that can be customized. In the figure, a favorite copy button 252 and a menu button 253 are displayed (arranged). The fixed area 252 is an area that is displayed regardless of whether or not customization is performed, and includes a login user display unit 254 and a screen transmission button 255. The login user display unit 254 displays the user name of the logged-in user. The screen transmission button 255 is a button for transmitting information related to the operation panel 205 to the operator terminal 10 including the displayed operation screen (part of the customization area 251).

  FIG. 6 is a sequence diagram for explaining operation panel reproduction processing in the operation terminal.

  When the user presses the screen transmission button 255 in the state where the operation screen 250 of FIG. 5 is displayed (S101), the UI information transfer unit 22 of the device 20 displays the operation screen 250 currently displayed on the operation panel 205. UI information indicating the current state of the operation panel 205 is generated based on the information (S102).

  FIG. 7 is a diagram illustrating a configuration example of UI information. In the figure, the UI information 221 includes information on soft key fields (soft key field information) and information on hard key fields (hard key field information). Here, the soft key field corresponds to a part of the operation panel 205 where a soft user interface is arranged, that is, an operation screen 250 displayed on the liquid crystal panel of the operation panel 205. The hard key field corresponds to a portion of the operation panel 205 where a hardware user interface is arranged.

  The soft key field includes information such as a display size, a medium, and an arrangement component. The display size indicates the width and height of the entire operation screen 250 currently being displayed. The medium indicates hardware on which the operation screen 250 is displayed. The arrangement component is a list of IDs (identifiers) for the components of the respective components (operation parts such as buttons) currently arranged on the operation screen 250.

  The hard key field includes information such as model, size, and placement component. The model indicates the model name of the operation panel 205. The display size indicates a display size when the entire operation panel 205 is displayed (reproduced) on the operator terminal 10. The arrangement component is a list of IDs for components of hardware components (operation parts such as buttons) arranged on the operation panel 250.

  Subsequently, the UI information transfer unit 22 acquires component information of each component arranged on the operation screen 250 or the operation panel 205 from the component information management unit 23 based on the component ID included in the UI information. (S103). The component information management unit 23 is an area (for example, a folder) that stores component information in the HDD 214.

  FIG. 8 is a diagram illustrating a configuration example of component information. In the figure, component information 222 includes component display information and processing information executed in response to an operation on the component. Specifically, the component information 222 includes an ID, a component type, a field type, an arrangement information link, an action link, and the like.

  The ID is an ID for uniquely identifying each component information 222 and matches the ID of the corresponding component. Therefore, the component information 222 is associated with the UI information 221 by the ID. The component type is a component type of the component. The field type is a field (soft key field or hard key field) to which the component belongs. The arrangement information link is information indicating the storage position of the arrangement information of the component. In the figure, arrangement information 223 and 224 is shown as arrangement information. The action link is information indicating a storage position of the source code in which an action (processing content) to be executed when the component is operated is defined. In the figure, a source code 225 is shown as a specific example of the source code.

  The arrangement information 223 is an example of arrangement information for components arranged in the soft key field, and includes information such as a position, an image data link, and a size. The position indicates the arrangement position of the component. The image data link indicates the storage position of the image data of the component. In the figure, image data 226 for the favorite copy button 252 in FIG. 5 is shown. The size indicates the size of the component.

  The arrangement information 224 is an example of arrangement information for components arranged in the hard key field, and includes information such as a key ID, a reproduction position, a reproduction size, and a reproduction image data link. The key ID is an ID assigned to the component in hardware on the operation panel 205. The reproduction position indicates a display position when the component is reproduced on the operator terminal 10. The reproduction size indicates the size when reproducing the component. The reproduction image data link indicates a storage position of image data for reproducing the component.

  The component information related to the components arranged in the soft key field is also used when the screen display unit 21 displays the operation screen 250. Accordingly, the UI information transfer unit 22 can generate soft key field information of the UI information 221 based on the component information used by the screen display unit 21. However, the UI information 21 may not be generated again, but may be stored in the HDD 205 in advance for each operation screen.

  Subsequently, the UI information transfer unit 22 includes the generated or acquired UI information 221, each component information 222 referred to by the UI information 221, arrangement information referred to by each component information 222, image data, and source code And other information related to the device 20 (such as a model name and a list of installed plug-ins (software parts)) is transmitted to the operator terminal 10 (S104). Here, the destination operator terminal 10 such as the UI information 221 is identified based on, for example, the IP address or URL (Uniform Resource Locator) of the operator terminal 10. The IP address or the like may be input via the IP address input screen displayed when the user presses the screen transmission button 255, for example, in response to a notification from the operator.

  The UI information 221 and the like transmitted by the device 20 are received by the UI information acquisition unit 11 of the operator terminal 10. Subsequently, the UI reproduction unit 12 of the operator terminal 10 reads the UI information 221 and the component information 222 and the like (S105, S106), and reproduces (displays) the operation panel 205 on the operator screen displayed on the display device 107. (S107).

  FIG. 9 is a diagram illustrating a display example of the operator screen. In the figure, an operator screen 500 includes a connection destination information area 510, a screen information area 520, an action information area 530, a source code transmission button 540, an event transmission button 550, and the like.

  In the connection destination information area 510, information (model name, installed plug-in) and the like related to the device 20 received from the device 20 is displayed by the UI reproduction unit 12. In the screen information area 520, the operation panel 205 of the device 20 is reproduced based on the UI information 221 and the component information 222. In the drawing, the customization area 250 and the start key 521 of the operation screen 250 are reproduced. The customization area 251 is reproduced based on the soft key field information of the UI information 221. The start key 521 is reproduced based on the hard key field information of the UI information 221. In addition, the same code | symbol is attached | subjected to the same part as FIG. The action information area 530, the source code transmission button 540, and the event transmission button 550 will be described later.

  Next, the reproduction process of the operation panel 205 on the screen information area 520 executed by the UI reproduction unit 12 in step S107 will be described in more detail. FIG. 10 is a flowchart for explaining operation panel reproduction processing by the UI reproduction unit.

  In step S1071, a rectangle indicating the hard key field (the outer periphery of the operation panel 205) is displayed based on the display size of the hard key field information of the UI information 221. FIG. 9 shows an example in which the outer periphery of the screen information area 520 is displayed in accordance with the outer periphery of the hard key field. Subsequently, the soft key field (customization area 251) is displayed based on the display size of the soft key field information of the UI information 221 (S1072).

  Subsequently, the image data is stored in the memory device 103 based on the image data link or the reproduction image data link of the arrangement information 223 or 224 for each component whose ID is included in the arrangement component of the hard key field information or the soft key field information. The image data is loaded (S1076), and the image data is arranged in the screen information area 520 based on the position or reproduction position of the arrangement information (S1077). For the component included in the hard key field (Yes in S1074), the device 20 is inquired whether or not the key (button) corresponding to the key ID included in the component arrangement information 224 actually exists (S1075). ) Arrange the image data when it actually exists.

  When the operation panel 205 is reproduced on the operator terminal 10, the operator inputs an operation instruction to the reproduced operation panel in response to a question from the user. For example, if the question is “Copying is not executed even if the favorite copy button 252 is pressed”, the operator instructs the favorite copy button 252 with the mouse pointer. At this time, the operator terminal 10 executes the following process.

  FIG. 11 is a flowchart for explaining a processing procedure executed when a reproduced component is designated.

  In response to an instruction input by the mouse pointer in the image information area 520 of the operator screen 500, the action display unit 13 determines (acquires) the coordinate value of the mouse pointer in the image information area 520 (S201). The instruction input here may be a single click or a double click. Alternatively, it may be a simple movement (arrangement) of the mouse pointer.

  Subsequently, the action display unit 13 determines whether or not a component exists at the position of the mouse pointer based on the determined coordinate value and the arrangement information 223 or 224 of each component (S202). When a component exists at the position of the mouse pointer (Yes in S202), the action display unit 13 reads the source code corresponding to the component into the memory device 103 (S203). Subsequently, the action display unit 13 requests the analysis server 30 to analyze the action caused by the execution of the source code (that is, the analysis of the processing content of the source code) (S204). In the analysis server 30, the source code is analyzed by a process described later, and information indicating the action (action information) is returned to the operation terminal 20.

  Subsequently, the action display unit 13 displays the source code read into the memory device 103 and action information returned from the analysis server 30 in the action information area 530 of the operator screen 500 (S205).

  FIG. 12 is a diagram illustrating an example of an operator screen on which source code and action information are displayed. This figure shows a state in which the favorite copy button 252 is instructed in the screen information area 520. Accordingly, the source code display area 531 of the action information area 530 displays the source code 225 (see FIG. 8) that is executed when the favorite copy button 252 is pressed. In the action information display area 532, action information returned from the analysis server 30 as an analysis result of the source code 225 is displayed. In the ID display area 533, the ID of the favorite copy button 252 is displayed.

  As shown in the figure, the action information is information indicating the contents of the action in a natural language. Therefore, even if the operator cannot understand the source code 225 itself (even if the program cannot be read), the operator can understand the contents of the source code 225 to some extent by referring to the action information. As a result, the reason why the copy is not executed can be estimated. For example, in the example of FIG. 12, it can be seen that copying of 10 copies is executed and stapling is performed as post-processing by the second and subsequent lines of the action information. In addition, it can be seen that there is a limit on the time that the copy function can be used from the description of “use restriction by time” in the first line of the action information. Therefore, the operator can answer about the possibility that the time limit is the cause.

  When no component is present at the position of the mouse pointer (FIG. 11: No in S202), the action display unit 13 sets each display area of the action information area 350 to a blank state (a state in which nothing is displayed) ( S206).

  Next, details of step S204 will be described. FIG. 13 is a sequence diagram for explaining source code analysis processing.

  In step S <b> 2041, the action display unit 12 of the operator terminal 10 transmits the source code 225 to the analysis unit 32 of the analysis server 30. The analysis unit 32 refers to the correspondence information table 31 and analyzes the source code 225 to generate action information (S2042).

  FIG. 14 is a diagram illustrating a configuration example of the correspondence information table. In the figure, the correspondence information table 31 is a natural language indicating an action that occurs in accordance with the processing indicated by the keyword for each keyword (for example, command name (including function name, method name, etc.)) that can be included in the source code. A character string (action character string) is defined (registered). Therefore, the analysis unit 32 extracts action keywords from the source code 225, and converts (replaces) each extracted keyword into action character strings based on the correspondence information table 31, thereby generating action information. For example, based on the correspondence information table 31 shown in FIG. 8, “checkLock ()”, “setUpCount (10)”, “setUpProcess (STAPLE)”, and “executeCopy ()” of the source code 225 (see FIG. 8) are respectively , “Usage restriction by time”, “Number of copies: 10”, and “Processing: Staple”.

  Subsequently, the analysis unit 32 returns the action information generated as a replacement result to the action display unit 13 (S2043). The analysis unit 32 displays the received action information in the action information display area 532 (S2044).

  The action display unit 13 may perform extraction of keywords from the source code 225. In this case, the extracted keyword is transferred from the action display unit 13 to the analysis unit 32 in step S2041. The unit of transfer may be for each keyword or a set of all extracted keywords. In the former case, steps S2041 to S2043 are executed for each keyword. Note that information for identifying the analysis unit 32 during network communication, such as the IP address of the analysis server 30 or the URL (Uniform Resource Locator) of the analysis unit 32, is stored in advance in the auxiliary storage device 102 of the operator terminal 10. Yes.

  Incidentally, when there is a keyword that cannot be analyzed in the analysis unit 32 (that is, a keyword that is not registered in the correspondence information table 31), the analysis unit 32 returns the keyword to the action display unit 13 (S2045). The keyword reply may be performed simultaneously with step S2043. Subsequently, the action display unit 13 causes the display device 107 to display a screen (an action character string input screen) for inputting an action character string for the keyword (S2046). When the operator can interpret the action (meaning) of the keyword displayed on the action character string input screen, the operator inputs the action character string on the action character string input screen. If it cannot be interpreted by the operator, no action string is entered.

  When the action character string is input via the action character string input screen by the operator, the action display unit 13 transmits the input action character string and the corresponding keyword to the analysis unit 32 (S2047). The analysis unit 32 registers the received action character string and keyword in the correspondence information table 31 (S2048). Thus, the proficiency level or completeness level of the correspondence information table 31 can be improved by each operator.

  The analysis unit 32 does not return the keyword to the operator terminal 10 (action display unit 13), but acts on the mail address of a person familiar with the program such as a developer registered in advance. An e-mail requesting registration of a character string may be transmitted. By doing so, the correspondence information table 31 can be updated by a developer or other person familiar with the source code.

  Next, a case where there is an error (bug) in the source code displayed in the action information area 530 of the operator screen 500 and the operator himself has the ability to correct the bug will be described. In this case, the operator can correct the source code via the operator screen 500.

  FIG. 15 is a sequence diagram for explaining the correction process of the source code. When the source code is edited (corrected) by the operator via the input to the source code display area 531 of the operator screen 500 and the source code transmission button 540 is clicked (S301), the source code editing unit 14 displays the source code. The contents (source code) of the area 531 are generated as data (S302), and the generated data (source code) and the ID of the currently instructed component are transmitted to the source code update unit 24 of the device 20 (S303). ).

  The source code update unit 24 searches the component information 222 of the component based on the received component ID (S304). Subsequently, the source code update unit 24 refers to the action link of the retrieved component information 222 to confirm the storage location of the source code for the component (S305). Subsequently, the source code update unit 24 updates the source code for the component by storing the source code received from the source code editing unit 14 in the confirmed storage location (S306).

  When the source code is in a program language that does not require compilation or the like (for example, an interpreter language, a script language, etc.), the operation corresponding to the component in the device 20 is immediately changed. In addition, when the source code is in a program language that requires compilation, compilation and the like may be executed on the device 20 side. The compiling or the like may be automatically performed by the source code update unit 24 in response to reception of the source code, or may be performed in response to an instruction input from an administrator or the like.

  Thus, in this embodiment, the source code of the device 20 can be edited and updated from the operator side.

  Next, a processing procedure when the operator remotely operates the device 20 will be described. FIG. 16 is a sequence diagram for explaining a processing procedure when a device is remotely operated by an operator terminal.

  When an event transmission button 550 is selected after any component reproduced in the screen information area 520 of the operator screen 500 (see FIG. 9) is selected (S401), the event notification unit 15 The ID of the component in the selected state is acquired from the component information 222, and information (event) indicating the ID and an operation (for example, “selection”) on the component is transmitted to the event processing unit 25 of the device 20 (S402). ).

  For example, the event processing unit 25 acquires the source code for the component based on the component information 222 for the received ID (S403). Subsequently, the event processing unit 25 executes processing corresponding to the received event according to the acquired definition of the source code (S404).

  Thus, in the present embodiment, the device 20 can be remotely operated from the operator terminal 10. Such a function is effective when the operator wants to perform an investigation by actually operating the device 20.

  Next, processing that is executed when the operation screen on the operation panel 205 changes in response to an operation on the device 20 will be described.

  FIG. 17 is a sequence diagram for explaining a processing procedure when the operation screen is changed on the device side.

  When an operation screen transition instruction (change instruction) is input via the operation panel 205 by the user of the device 20 (S501), the screen display unit 21 of the device 20 displays a new operation screen corresponding to the transition instruction. It is displayed on the operation panel 205 as a display target (S502). Subsequently, the screen display unit 21 requests the UI information transfer unit 22 to transmit the UI information 221 of the operation screen newly displayed (transition destination) (S503). When the UI information transfer unit 22 is currently connected to the operator terminal 10, the UI information transfer unit 22 generates the UI information 221 of the operation screen at the transition destination, and the component information 222 referred to by the UI information 221 from the component information management unit 23. Obtain (S504). Subsequently, the UI information transfer unit 22 transmits the generated or acquired UI information 221 and component information 222 to the UI information acquisition unit 11 of the operator terminal 10 (S505). Subsequently, the UI reproduction unit 12 of the operator terminal 10 updates the display content of the screen information area 520 of the operator screen 510 based on the UI information 221 and the component information 222 received by the UI information acquisition unit 11 (S506). . More specifically, the display content of the screen information area 520 is changed to the operation screen currently displayed on the device 20.

  Thus, the display state of the operator terminal 10 can be synchronized with the transition of the operation screen of the device 20. Thus, the operator can appropriately grasp the display state of the device 20.

  As described above, according to the present embodiment, in an environment where the operator terminal 10 and the device 20 are connected on the network and the operation screen of the device 20 can be customized, the operator terminal 10 is more than the device 20. UI information, component information, arrangement information, image data for each operation component, and source code for each operation component are received, and the operation screen of the device 20 is reproduced based on the received information. Moreover, the action information of the program executed according to the operation on the operation screen of the device 20 can be displayed via the reproduced screen. Therefore, even if the operation screen of the device 20 is customized for each user, the operator can give accurate advice.

The arrangement information holds different information depending on the difference between the soft key and the hard key, and the UI information holds the soft key field information and the hard key field information. Therefore, not only the operation screen displayed on the liquid crystal panel but also the physically arranged hard keys can be reproduced on the operation terminal 10 side.
Further, by displaying the action information, the operator can easily grasp what kind of action is generated by operating each component.
Further, since the correspondence information table 31 between the keyword and the action character string in the source code is centrally managed in the analysis device 30, the correspondence information table 31 can be shared among a plurality of operators.

  In the present embodiment, the operator terminal 10 corresponds to an operation component information display device. The UI information acquisition unit 11 corresponds to a reception unit, the UI reproduction unit 12 corresponds to a screen reproduction unit, the action display unit 13 corresponds to an action display unit, and the source code editing unit 14 corresponds to a transmission unit.

  Further, the component information management unit 23 of the device 20 corresponds to an operation component management unit, the UI information transfer unit 22 corresponds to a screen information transmission unit, and the source code update unit 24 corresponds to an update unit.

  The correspondence information table 31 of the analysis server 30 corresponds to correspondence information management means, and the analysis unit 32 corresponds to analysis means and registration means.

  As mentioned above, although the Example of this invention was explained in full detail, this invention is not limited to such specific embodiment, In the range of the summary of this invention described in the claim, various deformation | transformation・ Change is possible.

It is a figure which shows the system configuration example in embodiment of this invention. It is a figure which shows the hardware structural example of the operator terminal in embodiment of this invention. It is a figure which shows the hardware structural example of the apparatus in embodiment of this invention. It is a figure which shows the function structural example of the system in embodiment of this invention. It is a figure which shows the example of the operation screen currently displayed on the operation panel of an apparatus. It is a sequence diagram for demonstrating the reproduction process of the operation panel in an operation terminal. It is a figure which shows the structural example of UI information. It is a figure which shows the structural example of component information. It is a figure which shows the example of a display of an operator screen. It is a flowchart for demonstrating the reproduction process of the operation panel by a UI reproduction part. It is a flowchart for demonstrating the process sequence performed when the reproduced component is instruct | indicated. It is a figure which shows the example of the operator screen on which the source code and action information were displayed. It is a sequence diagram for demonstrating the analysis process of a source code. It is a figure which shows the structural example of a corresponding | compatible information table. It is a sequence diagram for demonstrating the correction process of a source code. It is a sequence diagram for demonstrating the process sequence at the time of operating a apparatus remotely by an operator terminal. It is a sequence diagram for demonstrating the process sequence when the operation screen changes in the apparatus side.

Explanation of symbols

DESCRIPTION OF SYMBOLS 10 Operator terminal 11 UI information acquisition part 12 UI reproduction part 13 Action display part 14 Source code edit part 15 Event notification part 20 Device 21 Screen display part 22 UI information transfer part 23 Component information management part 24 Source code update part 25 Event processing part 30 Analysis server 31 Corresponding information table 32 Analysis unit 40 Network 100 Drive device 101 Recording medium 102 Auxiliary storage device 103 Memory device 104 CPU
105 Interface Device 106 Display Device 107 Input Device 201 Controller 202 Scanner 203 Printer 204 Network Interface 205 Operation Panel 211 CPU
212 RAM
213 ROM
214 HDD
B bus

Claims (26)

Receiving means for receiving, from an electronic device connected via a network, screen information including display information of the operation component on the screen displayed on the operation panel of the electronic device and a program code associated with each operation component When,
Screen reproduction means for displaying a reproduction screen of the operation panel on a display device based on the screen information;
Corresponding information management means for managing correspondence information between a keyword that can be included in the program code and a character string that indicates an action caused by processing indicated by the keyword in response to an input to the operation component arranged on the reproduction screen An operation component information display device comprising: an action display means for displaying on the display device a character string indicating an action caused by execution of the program code associated with the operation component.   The action display means inputs the character string for a keyword whose corresponding character string is not registered in the correspondence information management means, and registers the keyword in the correspondence information management means in association with the keyword. The operation component information display device according to claim 1.   The action display means transmits the program code associated with the operation component to a program analysis apparatus having the correspondence information management means, and causes the display apparatus to display the character string returned from the program analysis apparatus. The operating component information display device according to claim 1 or 2. The action display means causes the display device to display a program code associated with the operation component,
4. The operation component information display device according to claim 1, further comprising a transmission unit that receives editing of the displayed program code and transmits the edited program code and an identifier of the operation component to the electronic device. . An electronic device having an operation panel,
Operation component information managing means for managing display information of operation components arranged on a screen that can be displayed on the operation panel and a program code for each operation component;
5. The screen information including the display information of the operation component on the screen displayed on the operation panel and the program code for each operation component are transmitted to the operation component information display device according to claim 1. An electronic apparatus comprising: screen information transmitting means for performing.   5. The program code transmitted from the transmission unit according to claim 4 and the identifier of the operation component are received, and the program code for the operation component managed by the operation component information management unit is received based on the identifier. 6. The electronic apparatus according to claim 5, further comprising an updating unit that updates the program code. A program analysis device connected to the operation component information display device according to claim 3 via a network,
The correspondence information management means;
Based on the correspondence information management means, a keyword included in the program code transmitted from the operation component information display device is converted into a character string indicating the action, and the converted character string is displayed in the operation component information display. An analysis means for returning to the apparatus.   8. The program analysis apparatus according to claim 7, further comprising a registration unit that registers the keyword and the character string transmitted from the operation component information display unit in association with the correspondence information management unit. An operation component information display system including an electronic device and an operation component information display device connected to the electronic device via a network,
The operation component information display device
Receiving means for receiving, from the electronic device, screen information including display information of the operation component on the screen displayed on the operation panel of the electronic device and a program code associated with each operation component;
Screen reproduction means for displaying a reproduction screen of the screen on a display device based on the screen information;
Corresponding information management means for managing correspondence information between a keyword that can be included in the program code and a character string that indicates an action caused by processing indicated by the keyword in response to an input to the operation component arranged on the reproduction screen An operation component information display system comprising: action display means for displaying on the display device a character string indicating an action caused by execution of the program code associated with the operation component. The operation component information display system further includes a program analysis device having the correspondence information management means,
The action display means transmits the program code associated with the operation component to the program analysis device, and causes the display device to display the character string returned from the program analysis device. 9. The operating component information display system according to 9. An operation component display method executed by a computer,
A receiving procedure for receiving, from an electronic device connected via a network, screen information including display information of an operation component on the screen displayed on the operation panel of the electronic device and a program code associated with each operation component When,
A screen reproduction procedure for displaying a reproduction screen of the operation panel on a display device based on the screen information;
Corresponding information management means for managing correspondence information between a keyword that can be included in the program code and a character string that indicates an action caused by processing indicated by the keyword in response to an input to the operation component arranged on the reproduction screen An operation component information display method comprising: an action display procedure for causing the display device to display a character string indicating an action caused by execution of the program code associated with the operation component.   In the action display procedure, the character string corresponding to the keyword for which the corresponding character string is not registered in the correspondence information management unit is input, and the character string is associated with the keyword and registered in the correspondence information management unit. The operation component information display method according to claim 11.   In the action display procedure, the program code associated with the operation component is transmitted to a program analysis apparatus having the correspondence information management unit, and the character string returned from the program analysis apparatus is displayed on the display apparatus. The operation component information display method according to claim 11 or 12, wherein: The action display procedure causes the display device to display a program code associated with the operation component,
14. The operation component information display method according to claim 11, further comprising: a transmission procedure for receiving editing of the displayed program code and transmitting the edited program code and the identifier of the operation component to the electronic device. . An operation component information management method executed by an electronic device having an operation panel,
5. The screen information including the display information of the operation component on the screen displayed on the operation panel and the program code for each operation component are transmitted to the operation component information display device according to claim 1. An operation component information management method comprising a screen information transmission procedure.   5. An update procedure for receiving the program code and the identifier of the operation component transmitted from the transmission means according to claim 4, and updating the program code for the operation component to the program code received based on the identifier. The operation part information management method according to claim 15, wherein: A program analysis method executed by a computer connected to the operation component information display device according to claim 3 via a network,
Based on the correspondence information management means, a keyword included in the program code transmitted from the operation component information display device is converted into a character string indicating the action, and the converted character string is displayed in the operation component information display. A program analysis method comprising an analysis procedure for sending a reply to the apparatus.   18. The program analysis method according to claim 17, further comprising a registration procedure for registering the keyword and the character string transmitted from the operation component information display device in association with the correspondence information management unit. On the computer,
A receiving procedure for receiving, from an electronic device connected via a network, screen information including display information of an operation component on the screen displayed on the operation panel of the electronic device and a program code associated with each operation component When,
A screen reproduction procedure for displaying a reproduction screen of the operation panel on a display device based on the screen information;
Corresponding information management means for managing correspondence information between a keyword that can be included in the program code and a character string that indicates an action caused by processing indicated by the keyword in response to an input to the operation component arranged on the reproduction screen A program for executing an action display procedure for causing the display device to display a character string indicating an action caused by execution of the program code associated with the operation component.   In the action display procedure, the character string corresponding to the keyword for which the corresponding character string is not registered in the correspondence information management unit is input, and the character string is associated with the keyword and registered in the correspondence information management unit. The program according to claim 19.   In the action display procedure, the program code associated with the operation component is transmitted to a program analysis apparatus having the correspondence information management unit, and the character string returned from the program analysis apparatus is displayed on the display apparatus. 21. The program according to claim 19 or 20, wherein: The action display procedure causes the display device to display a program code associated with the operation component,
The program according to any one of claims 19 to 21, further comprising a transmission procedure for accepting editing of the displayed program code and transmitting the edited program code and the identifier of the operation component to the electronic device. For electronic devices equipped with operation panels,
5. The screen information including the display information of the operation component on the screen displayed on the operation panel and the program code for each operation component are transmitted to the operation component information display device according to claim 1. A program for executing the screen information transmission procedure.   5. An update procedure for receiving the program code and the identifier of the operation component transmitted from the transmission means according to claim 4, and updating the program code for the operation component to the program code received based on the identifier. 24. The program according to claim 23. A computer connected to the operation component information display device according to claim 3 via a network,
Based on the correspondence information management means, a keyword included in the program code transmitted from the operation component information display device is converted into a character string indicating the action, and the converted character string is displayed in the operation component information display. A program for executing an analysis procedure sent back to the device.   26. The program according to claim 25, further comprising a registration procedure for registering the keyword and the character string transmitted from the operation component information display device in association with the correspondence information management unit.

Images