JP2005326959A - Skill level evaluation system - Google Patents

Abstract

<P>PROBLEM TO BE SOLVED: To provide a skill level evaluation system for providing the correct operation procedures of equipment 2 or the interpretation of the optimal operation procedure to an engineer who has learned the operation of the equipment 2, and for feeding back the analytic result of the performed operation of the equipment 2 to an educational implementation facility, and for retrieving information related with the performed information of the equipment 2 even from the educational implementation facility. <P>SOLUTION: This skill level evaluation system is configured by communicatively connecting equipment 2 through a network 7 to an evaluation management server 3, wherein the evaluation management server 3 is provided with a database part 31, an optimal operation setting processing part 33, a procedure registration processing part 34, an operation evaluation processing part 35 and an evaluation result processing part 36. <P>COPYRIGHT: (C)2006,JPO&NCIPI

Description

  The present invention provides an environment for practical training, confirmation and evaluation of device operations for engineers who have learned how to operate devices. It is a proficiency assessment system that can provide explanations of procedures. In addition, it collects and accumulates information on the operations of engineers, and provides statistical information necessary for analysis of erroneous operation trends to educational institutions. A proficiency evaluation system that provides feedback.

  As an invention of an apparatus for monitoring the operation of a device, for example, as shown in Patent Document 1, it is determined whether an operator who is taking an education is performing an operation in accordance with a curriculum. There is a terminal operation education device for supporting the education of operation of an operator terminal, which is notified to a supervisor when an incorrect operation is performed.

  The invention of the system for monitoring the operation of the device is, for example, whether the PC educational support software displayed the practice pattern as shown in Patent Document 2 and the student performed the operation according to the practice pattern. There is a PC classroom system for monitoring word processing and spreadsheet software used in general households.

  As an invention for capturing a screen of a monitor connected to a personal computer or the like as screen shot information and performing image processing, for example, a game screen displayed on a monitor or the like connected to a personal computer or the like as shown in Patent Document 3 There is a screen shot information providing system and program capable of avoiding the risk of copyright infringement and the like when posted on the Web and easily performing image processing.

  As an invention for supporting the acquisition of software operation, for example, there is a management method of an education support company that uses a Web page of an education management company as shown in Patent Document 4 to provide education between students and instructors. is there.

On the other hand, for example, when an engineer who has learned how to operate server equipment evaluates proficiency before on-site work or confirms practical training, he builds the server himself and checks the operation to achieve the goal. If not, an inquiry is made to the educational institution, but usually the inquiry method to the educational institution is limited to using email or Web.
JP 2004-127552 A JP 2001-265206 A JP 2003-109025 A JP 2003-263508 A

  However, devices and systems that monitor the operation of known devices can monitor whether or not the correct operation procedure is being performed, but have not yet provided a description of the correct operation procedure and the optimal operation procedure. There was a problem.

  Inquiries to educational institutions using e-mail or the Web are not specified or are unclear, so the inquiry content depends on the skill level of the engineer. There was a problem that the level of contents (operation procedure, screen shot, etc.) was not unified, and it was difficult to analyze and extract improvement points for reflection in education.

  The present invention has been made in view of the above problems, and its purpose is to provide a technician who has learned how to operate a device with a description of the correct operation procedure and the optimal operation procedure of the device. A proficiency evaluation system that provides feedback on the results of analysis of performed equipment operations to the educational institution and makes it possible to retrieve information on the operation of the equipment from the educational institution. To provide a system.

  As a result of various studies to achieve the above object, the present inventor has connected the device and the evaluation management server so that they can communicate with each other via a network. The evaluation management server includes a database unit and an optimum operation. It has been found that the above problems can be achieved by a proficiency evaluation system including a setting processing unit, a procedure registration processing unit, an operation evaluation processing unit, and an evaluation result transmission processing unit, and has led to the present invention. .

  That is, the first proficiency level evaluation system of the present invention evaluates the proficiency level of operation of the device by the technician who has learned the operation of the device and the device, and information on the proficiency level of operation of the device that has been evaluated. Is a proficiency level evaluation system that is connected to an evaluation management server that can communicate with each other via a network, and the evaluation management server is a device operation information database in which information related to operation of the device is registered And a database unit having an execution operation information database in which information related to the operation of the executed device is registered, and an evaluation item of the operation of the device sent from the device acquired by the information acquisition unit via the network Based on the information, extract information from the device operation information database, determine a confirmation procedure to confirm the proficiency of the operation of the performed device, An optimum operation setting processing unit for performing processing for setting an optimum operation procedure indicating the most suitable operation procedure for the evaluation item from the confirmation procedure, information on the confirmation procedure, and information on the optimum operation procedure are displayed in the device operation information. Registered in the execution operation information database is a procedure registration processing unit that performs processing to be registered in the database, and information related to the operation of the device that has been executed and transmitted from the device acquired by the information acquisition unit via the network. Based on the information regarding the performed device operation, whether the performed device operation is appropriate is evaluated from the information extracted from the device operation information database, and information regarding the evaluated result is performed. An operation evaluation processing unit that performs processing of registering in the execution operation information database in association with information related to operation of the device; In accordance with a preset condition, information that matches the preset condition is extracted from the device operation information database and / or the execution operation information database, edited into evaluation result information, and the evaluation result information is output to the information output unit. And an evaluation result transmission processing unit for performing processing for transmission to the device.

  The second proficiency level evaluation system of the present invention evaluates the proficiency level of the operation of the device by the technician who has learned the operation of the device and the device, and manages information related to the proficiency level of the operation of the device. A skill level evaluation system in which an evaluation management server and an engineer terminal that remotely operates the device are connected to each other via a network, wherein the evaluation management server relates to the operation of the device The engineer acquired by the information acquisition unit via a network unit having a device operation information database in which information is registered, an execution operation information database in which information related to executed device operations is registered, and the network Based on information related to the device operation evaluation item sent from the device via the terminal, extract information from the device operation information database, An optimal operation setting processing unit that determines a confirmation procedure for confirming the proficiency level of the operation of the performed device and sets an optimal operation procedure indicating the most suitable operation procedure for the evaluation item from the confirmation procedure; A procedure registration processing unit for performing processing for registering information on the confirmation procedure and information on the optimum operation procedure in the device operation information database, and via the technician terminal acquired by the information acquisition unit via the network. Information on the operation of the executed device sent from the device is registered in the execution operation information database, and whether the operation of the executed device is appropriate based on the information on the operation of the executed device The information extracted from the device operation information database is evaluated, and the information related to the evaluation result is the information related to the operation of the executed device. In accordance with the operation evaluation processing unit that performs processing to be registered in the execution operation information database, and in accordance with a preset condition, the preset condition is met from the device operation information database and / or the execution operation information database. An evaluation result transmission processing unit that extracts information, edits the evaluation result information, and sends the evaluation result information from the information output unit to the technician terminal via the device. And

  The third proficiency level evaluation system of the present invention evaluates the proficiency level of the operation of the device by the technician who has learned the operation of the device and the device, and manages information related to the proficiency level of the operation of the device. The evaluation management server, the engineer terminal that remotely operates the device, and the educational institution terminal that is deployed in the organization that conducts training on the operation of the device are connected to each other via a network. The evaluation management server includes a device operation information database in which information on operation of the device is registered, and an execution operation information database in which information on operation of the executed device is registered And an evaluation item of the operation of the device sent from the device via the engineer terminal acquired by the information acquisition unit via the network Information sent from the device via the evaluation terminal transmission processing unit that performs processing to transmit the information from the information output unit to the educational institution terminal and the engineer terminal acquired by the information acquisition unit via the network. Based on the information related to the device operation evaluation item, information is extracted from the device operation information database to determine a confirmation procedure for confirming the level of proficiency of the performed device operation. The process of setting the optimum operation procedure is performed based on the information related to the optimum operation procedure indicating the operation procedure most suitable for the evaluation item of the operation of the device sent from the educational institution terminal acquired by the information acquisition unit. An optimum operation setting processing unit, a procedure register for performing processing for registering information on the confirmation procedure and information on the optimum operation procedure in the device operation information database; Registers in the execution operation information database the information regarding the operation of the device executed by the processing unit and transmitted from the device via the engineer terminal acquired by the information acquisition unit via the network, and executes the execution Based on the information regarding the operation of the device that has been performed, whether or not the operation of the performed device is appropriate is evaluated based on the information extracted from the device operation information database. An operation evaluation processing unit that performs processing to be registered in the execution operation information database in association with information related to an operation, and information and / or evaluation regarding an optimal operation procedure that matches the condition from the device operation information database according to a preset condition. Extract information about the procedure, and extract the extracted information from the information output unit via the device to the technician terminal. The proficiency level for grasping the proficiency level of the operation of the executed equipment sent from the educational institution terminal acquired by the information acquisition section via the network and the evaluation result transmission processing section that performs processing to be sent to the end Based on the proficiency grasp request information requesting grasp information, information related to the operation of the executed device and information related to the evaluation result are extracted from the execution operation information database and edited as proficiency grasp information, and the proficiency grasp is obtained. A proficiency level information processing unit for registering information in the execution operation information database and performing processing for transmitting the proficiency level grasping information from the information output unit to the educational institution terminal that has sent the proficiency level grasping request information It is characterized by.

  Here, it can be set as the structure to which the operation terminal containing an input means and an output means is connected to the said apparatus.

  The evaluation management server includes an operation screen information database in which information on an image displayed on the screen of the device, the engineer terminal, or the operation terminal is registered in the database unit when the device is operated. Further, the apparatus, the engineer, which registers the information regarding the operation of the executed device acquired via the network in the operation screen information database and acquired by the information acquisition unit via the network. An operation screen processing unit that performs processing for registering information related to the image displayed on the terminal or the screen of the operation terminal in the operation screen information database in association with information regarding the operation of the executed device is further provided. Can be configured.

  The device can be a computer device.

  According to the present invention, it is possible to accurately grasp the operation of the device performed by the engineer who has learned the operation of the device, and further, it is possible to provide an explanation of the correct operation procedure and the optimal operation procedure to the engineer. is there.

  In the present invention, when an engineer terminal that remotely operates an apparatus is connected to be able to communicate via a network, the engineer does not go directly to a place where an apparatus such as an evaluation center is installed. There is an advantage that the time restriction and the place restriction are eliminated.

  In the present invention, when an educational institution terminal placed in an educational institution that conducts education on the operation of equipment is connected to be communicable via a network, the equipment of an engineer trained in the educational institution It becomes possible to easily check the proficiency level of the operation. In addition, the processing by the proficiency level notification processing unit provided in the evaluation management server feeds back the analysis results of the performed device operations to the educational institution, so it is clear that it must be explained with priority. In addition, the point of explaining the operation of the equipment to the engineer becomes clear, and there is an advantage that the quality assurance degree of education is improved.

  In the present invention, when an operation terminal including an input unit and an output unit is connected to the device, it is very effective when the device cannot be directly operated, and the input unit and output unit of the device are defective. This is also beneficial and has the advantage of improving system reliability.

  In the present invention, when the operation management information database is provided in the evaluation management server and the operation screen processing unit is provided, the image displayed on the screen during the operation of the device is displayed regardless of the GUI or CUI. Since it is possible to replay, and even work contents using tools such as an editor can be replayed, there is an advantage that it is easier to confirm the erroneous operation contents.

  In the present invention, when the device is a computer device, the above effects become more remarkable.

  Hereinafter, preferred embodiments of the present invention will be described with reference to the accompanying drawings. FIG. 1 illustrates an example of a basic configuration of the proficiency level evaluation system of the present invention.

  The proficiency level evaluation system 1 includes a device 2, an evaluation management server 3, an engineer terminal 4, an educational institution terminal 5, and an operation terminal 6. The device 2, the evaluation management server 3, the engineer terminal 4, and the educational institution terminal 5 are connected via a network 7 so that they can communicate with each other.

  The device 2 is used for evaluating the proficiency level of an engineer who has learned the operation, and is disposed, for example, in an evaluation center. The device 2 is preferably a computer device from the viewpoint of the effect of the invention, and a server, a router, and a firewall are particularly preferable.

  The evaluation management server 3 evaluates the proficiency level of the operation of the device 2 of the engineer who has learned the operation of the device 2 and manages information related to the evaluated proficiency level. For example, the evaluation management server 3 is arranged in an evaluation center or the like. Is done.

  As shown in FIG. 1, the evaluation management server 3 includes, for example, an information acquisition unit 30, a database unit 31, an evaluation item transmission processing unit 32, an optimum operation setting processing unit 33, a procedure registration processing unit 34, an operation An evaluation processing unit 35, an evaluation result transmission processing unit 36, a proficiency level information processing unit 37, an operation screen processing unit 38, and an information output unit 39 are provided.

  The information acquisition unit 30 transmits the information regarding the evaluation item of the operation of the device 2, the information regarding the operation of the executed device 2, the device 2, the engineer terminal 4 or the operation terminal 6 sent from the device 2 via the network 7. The information regarding the image displayed on the screen is acquired, and the information 43 regarding the optimum operation procedure and the proficiency level grasp request information sent from the educational institution terminal 5 are acquired.

  As shown in FIG. 2, the database unit 31 includes a device operation information database 31a, an execution operation information database 31b, and an operation screen information database 31c.

  In the device operation information database 31a, information 41 related to device operation, information 42 related to a confirmation procedure, and information 43 related to an optimal operation procedure are registered in association with each other.

  The information 41 regarding the operation of the device includes, for example, the evaluation item of the operation of the device 2, the information regarding the order of the operation procedure, the operation procedure reference number, the item name of the operation procedure, the operation command, the information describing the operation command, and the operation procedure. Includes information to explain, information to explain operating procedures, information to explain how to recover from wrong operating procedures, information to explain the order of operations for different operating procedures, information to explain major and important operating procedures, etc. Yes.

  The information 42 on the confirmation procedure includes, for example, the evaluation item of the operation of the device 2, the checkpoint reference number listed as the confirmation procedure, information on the order of the checkpoint, the item name of the checkpoint, the checkpoint operation command, the checkpoint Information describing the operation command, information describing the checkpoint, detour flag, and the like.

  The information 43 related to the optimum operation procedure describes, for example, the evaluation item of the operation of the device 2, the information concerning the order of the optimum operation procedure, the optimum operation procedure reference number, the item name of the optimum operation procedure, the optimum operation command, and the optimum operation command. Information, information explaining the optimum operation procedure, information explaining the optimum operation procedure, and the like are included.

  In the execution operation information database 31b, information 51 related to the operation of the executed device 2, information 52 related to the evaluation result, and proficiency level grasping information 53 are registered, and information 51 related to the operation of the executed device 2 and evaluation Information 52 on the results is associated with each other.

  Information 51 concerning the operation of the device 2 that has been executed includes the name of the educational institution that the engineer has been trained in, the name of the engineer, the evaluation item of the operation of the device 2, the switches installed in the device 2, and the operation buttons And the like, information on the operation command of the device 2 executed, software used, checkpoint executed, and the like. An example of information related to the performed device operation is shown in FIG.

  The information 52 regarding the evaluation result corresponds to, for example, the name of the engineer, the evaluation item of the operation of the device 2, the checkpoint reference number corresponding to the operation procedure of the executed device 2, and the operation command of the executed device 2 Checkpoint reference number to be performed, evaluation result, confirmation procedure indication information indicating an operation other than the confirmation procedure, statistical result of the route of the operation of the device 2 executed, and the like.

  The proficiency level grasping information 53 includes, for example, a list of executed operation paths of the device 2, and for each evaluation item of the operation of the device 2, what route the engineer operated, Route information report in which the route is written and the statistical result is distinguished by the thickness and color of the line of the route, the statistical result of the route of the operation of the device 2 executed, the information about the operation whose evaluation result is not good, and the completion For example, information on the evaluation item of the operation of the device 2 that is often not performed.

  The operation screen information database 31c includes information 51 relating to the operation of the device 2 that has been executed and information 61 relating to an image displayed on the screen of the device 2, the engineer terminal 4 or the operation terminal 6 when the device 2 is operated. Registered in association with each other. An example of information registered in the operation screen information database is shown in FIG.

  As the information 61 regarding the image displayed on the screen of the device 2, the engineer terminal 4 or the operation terminal 6 when operating the device 2, for example, the name of the engineer, the evaluation item of the operation of the device 2, the executed device 2. The operation command of 2, the information about the operation procedure of the device 2 executed, the image displayed on the screen of the device 2, the engineer terminal 4 or the operation terminal 6 at every predetermined time or when the designated operation command is input Screen shot information archive, screen shot ID, screen shot file name, and the like.

  The evaluation item transmission processing unit 32 obtains information related to the evaluation item of the operation of the device 2 sent from the device 2 via the engineer terminal 4 and acquired by the information acquisition unit 30 via the network 7. 39 is a processing operation unit of a computer that performs processing to be transmitted from the terminal 39 to the educational institution terminal 5.

  The optimum operation setting processing unit 33 extracts information from the device operation information database 31a based on the information about the evaluation item of the operation of the device 2 sent from the device 2 acquired by the information acquisition unit 30 via the network 7. , A confirmation procedure for confirming the proficiency level of the operation of the executed device 2 is determined, and an optimal operation procedure indicating the most suitable operation procedure for the evaluation item of the operation of the device 2 is set from the confirmation procedure. It is a processing operation part of a computer.

  The information related to the evaluation item of the operation of the device 2 includes, for example, the name of the device 2, the type of operation of the device 2 desired to be evaluated, the purpose of operation of the device 2 desired to be evaluated, the type of operation system to be used, and the evaluation method Etc. are included. Note that the information related to the evaluation item of the operation of the device 2 may be sent directly from the device 2 or may be sent from the device 2 via the engineer terminal 4.

  The confirmation procedure is based on the information related to the evaluation item of the operation of the device 2, for example, learning of the operation of the device 2 performed from the information explaining the main and important operation procedures extracted from the device operation information database 31a. The procedure for checking the degree is determined. Each confirmation procedure is assigned a checkpoint reference number and can be associated with the optimal operation procedure reference number and the operation procedure reference number.

  The optimum operation procedure is the most suitable operation procedure for the operation item of the operation of the device 2, and is extracted from the device operation information database 31 a based on the information related to the operation item of the operation of the device 2. Confirmation procedure in consideration of order information, operation procedure reference number, operation procedure item name, operation command, information explaining operation command, information explaining operation procedure, information explaining main and important operation procedure, etc. Is selected and set.

  When the information acquisition unit 30 acquires the information 43 related to the optimum operation procedure sent from the educational institution terminal 5, the optimum operation setting processing unit 33 determines the confirmation procedure based on the information 43 about the optimum operation procedure. Processing for selecting and setting the optimum operation procedure from among them is performed.

  The procedure registration processing unit 34 is a processing operation unit of a computer that performs processing for registering information 42 on the confirmation procedure and information 43 on the optimum operation procedure in the device operation information database 31a.

  The operation evaluation processing unit 35 registers the information related to the operation of the device 2 executed and transmitted from the device 2 acquired by the information acquisition unit 30 via the network 7 and executes the operation evaluation information database 31b. Based on the information related to the operation of the device 2, whether or not the operation of the executed device 2 is appropriate is evaluated from the information extracted from the device operation information database 31 a, and information on the evaluation result is obtained from the executed device 2. It is a processing operation unit of a computer that performs a process of registering in the execution operation information database 31b in association with information related to an operation.

  In the present invention, the evaluation of whether the operation of the executed device 2 is appropriate is performed by, for example, making the executed operation of the device 2 correspond to the check point or the operation in the optimum operation procedure given as the confirmation procedure. Do it. Specifically, after extracting items related to the operation command input from the device 2, the engineer terminal 4 or the operation terminal 6 from the device operation information database 31a, the device 2, the engineer terminal 4 or the operation terminal 6 is extracted. Is compared with the operation command at the check point listed as the confirmation procedure, and whether or not the operation of the executed device 2 is appropriate is evaluated. Here, if the operation command input from the device 2, the engineer terminal 4 or the operation terminal 6 and the operation command at the check point listed as the confirmation procedure are completely the same, whether the confirmation procedure is the optimum operation procedure. To be judged. When the confirmation procedure is the optimum operation procedure, it is recorded in the execution operation information database 31b as a result of the evaluation, for example, that it is suitable. When the confirmation procedure is not the optimum operation procedure, it is recorded in the execution operation information database 31b. An operation other than the optimum operation procedure and the optimum operation procedure performed immediately before are recorded as confirmation procedure indication information. If the operation command input from the device 2, the engineer terminal 4 or the operation terminal 6 and the operation command at the check point listed as the confirmation procedure are not completely the same, the evaluation result is stored in the execution operation information database 31b, for example, The fact that it is nonconforming is recorded, and both operation commands are recorded as confirmation procedure indication information. The evaluation result and the confirmation procedure indication information are associated with the operation procedure reference number corresponding to the executed operation procedure of the device 2 and can be easily searched.

  The information regarding the operation of the executed device 2 sent from the device 2 is sent from the device 2 via the engineer terminal 4 even if it is sent directly from the device 2. Also good.

  The evaluation result transmission processing unit 36 extracts information that matches the preset condition from the device operation information database 31a and / or the execution operation information database 31b according to a preset condition, and edits and edits the evaluation result information. It is a processing operation unit of a computer that performs processing of transmitting evaluation result information from the information output unit 39 to the device 2.

  The preset condition corresponds to, for example, a case where the detour flag, the evaluation event of the operation of the device 2 is completed, or the evaluation event of the operation of the device 2 is not completed.

  The evaluation result information includes, for example, information explaining the optimum operation procedure, confirmation procedure indication information, information explaining the recovery method, and the like.

  The proficiency level information processing unit 37 acquires proficiency level grasping information for grasping the proficiency level of the operation of the executed device 2 sent from the educational institution terminal 5 acquired by the information acquisition unit 30 via the network 7. 53, information 51 relating to the operation of the device 2 executed from the execution operation information database 31b and information 52 relating to the evaluation result are extracted from the execution operation information database 31b and edited as proficiency grasp information 53. Computer processing for registering the grasp information 53 in the execution operation information database 31b and performing processing for transmitting the proficiency grasp information 53 from the information output unit 39 to the educational institution terminal 5 that has sent the proficiency grasp request information. It is an operation part.

  As the proficiency level grasp request information, for example, the name of the educational institution, the ID for identifying the educational institution terminal 5, the evaluation item of the operation of the device 2, the type of the route information report that lists the requested operation route of the device 2 Etc.

  The operation screen processing unit 38 registers information related to the operation of the executed device 2 acquired by the information acquisition unit 30 via the network 7 in the operation screen information database 31 c and at the information acquisition unit 30 via the network 7. A process of registering the acquired information related to the image displayed on the screen of the device 2, the engineer terminal 4 or the operation terminal 6 in the operation screen information database 31c in association with the information related to the operation of the executed device. It is a processing operation unit.

  The information output unit 39 transmits information regarding the evaluation item of the operation of the device 2 to the educational institution terminal 5 via the network 7, and transmits evaluation result information to the engineer terminal 4 via the device 2 or device 2. Then, the proficiency level grasping information 53 is transmitted to the educational institution terminal 5 that has sent the proficiency level grasping request information.

  The technician terminal 4 is a terminal held by a technician who has learned the operation of the devices 2 scattered throughout the country. The engineer terminal 4 is not particularly limited as long as the device 2 can be operated remotely, and examples thereof include a notebook computer, a client computer such as a desktop personal computer provided with an input unit and an output unit, and a portable terminal. The engineer terminal 4 periodically collects images displaying operations performed on the engineer terminal 4 and saves them as screen shot information and an archive of the saved screen shot information. Software having a function of transmitting to may be installed.

  The educational institution terminal 5 is deployed at an educational institution that trains engineers to operate the device 2. Examples of the educational institution terminal 5 include a notebook computer and a client computer such as a desktop personal computer provided with input means and output means.

  The educational institution terminal 5 gives the access authority to the device operation information database 31a, the execution operation information database 31b, and the operation screen information database 31c in the database unit 31 of the device 2 and the evaluation management server 3 by the evaluation management server 3. It is done.

  The operation terminal 6 is a terminal that is used effectively when the input means and output means are not connected to the device 2 or when the input means and output means connected to the device 2 do not function normally. An output unit is included, and is connected to the device 2 by, for example, a wire, so that the device 2 can be operated. Examples of the operation terminal 6 include a notebook computer and a client computer such as a desktop personal computer provided with an input unit and an output unit.

  In the following, for example, an example of how an engineer who has learned the operation procedure of a computer device performs confirmation of the operation procedure using the proficiency evaluation system of the present invention before performing work on site will be described. To do.

  First, information such as an evaluation item of the operation of the device 2 such as “Build a WEB server (Apache) with Linux 7.3J” is evaluated from the engineer terminal 4 owned by the engineer via the network 7. It is transmitted to the evaluation management server 3 arranged at the center (step A1).

  The evaluation management server 3 that has received the information regarding the evaluation item of the operation of the device 2 establishes a “WEB server (Apache) with Linux 7.3J” to the educational institution terminal 5 installed in the educational institution through the network 7. Information such as an evaluation item of the operation of the device 2 is performed. The educational institution terminal 5 that has received the notification sets, for example, the operation procedure for which the education is performed as the operation procedure most suitable for the evaluation item of the operation of the device 2, and information 43 regarding the optimum operation procedure as shown in FIG. Is transmitted to the evaluation management server 3 via the network 7 (step A2).

  The evaluation management server 3 that has received the information 43 related to the optimal operation procedure registers the information 43 related to the optimal operation procedure in the device operation information database 31a and, for example, installs Apache (checkpoint arrangement) based on the information 43 related to the optimal operation procedure. 101), Apache installation confirmation (checkpoint reference number 201), Apache setting file change (httpd.conf) (checkpoint reference number 301), WEB server restart (checkpoint reference number 501), home page (index) .Html) file creation (checkpoint reference number 601), confirmation of access to WEB server (checkpoint reference number 602), and checkpoint reference number 101 → 201 → 301 → 5 Process of setting the order of 1 → 601 → 602 as an optimum operating procedure is performed.

  Here, in the case where the device 2 is remotely operated using the computer terminal owned by the engineer who has learned the operation of the device 2 scattered throughout the country, that is, the engineer terminal 4 (step B1 / Yes), the engineer terminal 4 is periodically collected as a screen shot, and whether or not a program for saving the collected screen shot information to the local disk of the technician terminal 4 is confirmed (step A3). If installed, remote operation of the device 2 is started from the technician terminal 4 (step A4).

  When the engineer operates the device 2 at an evaluation center or the like where the device 2 is installed (step B1 / No), it is determined whether the device 2 can be operated, and the device 2 has a keyboard. And the monitor are connected (step B2 / Yes), the operation is started from the device 2 (step A4). For example, when the keyboard and the monitor are not connected to the device 2, the keyboard and the monitor are connected. If it does not function normally even if connected (step B2 / No), the operation of the device 2 is started from the operation terminal 6 connected to the device 2 (step A4). Note that the installation of the above-described program has already been completed on the device 2 and the operation terminal 6 installed such as the evaluation center.

  Information regarding the operation of the executed device 2 sent from the device 2 and acquired by the information acquisition unit 30 via the network 7 is registered in the execution operation information database 31b (step A5), and the executed device 2 is executed. Based on the information relating to the operation, whether the operation of the executed device 2 is appropriate or not is compared and evaluated (step B3).

  For example, an engineer may, for example, install Apache (checkpoint reference number 101), confirm the installation of Apache (checkpoint reference number 201), change the Apache setting file (httpd.conf) (checkpoint reference number 301), Linux System restart (checkpoint reference number 1002), WEB server start (checkpoint reference number 401), homepage (index.html) file creation (checkpoint reference number 601), access confirmation to WEB server (checkpoint) When the device 2 is operated in the order of the reference number 602), the Linux system restart (checkpoint reference number 1002) and the WEB server start (ch) are operations other than the optimum operation procedure described above. In addition, the Apache setting file change (checkpoint reference number 301), which is the optimum operation procedure performed immediately before that, is registered in the execution operation information database 31b as confirmation procedure indication information ( Step A6).

  The evaluation management server 3 compares the executed operation of the device 2 with the optimum confirmation procedure until the operation completion scheduled time (step B4). When the operation completion scheduled time is reached, it is confirmed whether or not the operation of the device 2 in the evaluation item of the operation of the device 2 is completed (step B5).

  For example, when the evaluation management server 3 confirms access to the WEB server with the checkpoint reference number 602, the evaluation item of the operation of the device 2 "Build WEB server (Apache) with Linux 7.3J" is completed. The screen shot information of the image displayed on the screen of the engineer terminal 4 stored in the local disk of the engineer terminal 4 is deleted (step A7). When the screen shot information of the image displayed on the screen of the engineer terminal 4 is deleted from the local disk of the engineer terminal 4, the evaluation management server 3 checks whether there is a detour flag in the device operation information database 31a ( Step B6). When there is a detour flag in the device operation information database 31a, the confirmation procedure indication information as shown in FIG. 10 is extracted from the execution operation information database 31b and transmitted to the engineer terminal 4 (step A8). Then, information explaining the optimum operation procedure as shown in FIG. 11 is extracted from the device operation information database 31a (step A9) and transmitted to the engineer terminal 4 (step A10).

  When the evaluation management server 3 does not confirm the access to the web server with the checkpoint reference number 602, the evaluation item of the operation of the device 2 “build a web server (Apache) on Linux 7.3J” is completed. The screen shot information of the image displayed on the screen of the technician terminal 4 stored in the local disk of the technician terminal 4 is archived and registered in the operation screen information database 31c (step A11). The screen shot information of the image displayed on the screen of the engineer terminal 4 stored in the local disk of the engineer terminal 4 is deleted (step A12). Then, the evaluation management server 3 extracts information explaining the recovery method as shown in FIG. 12 and information explaining the optimum operation procedure as shown in FIG. 11 from the device operation information database 31a (step A13). It transmits to the engineer terminal 4 (step A14).

  Even after the operation of the device 2 is completed, the evaluation management server 3 executes the execution operation according to the proficiency level grasp request information sent from the educational institution terminal 5 or every predetermined period (for example, one month). Information is extracted from the information database 31b, and a route information report that lists the route of operation of the executed device 2 as shown in FIG. 8, for example, is created (step A15) and transmitted to the educational institution terminal 5 (Step A16). In the route information report, for each evaluation item of the operation of the device 2, the route operated by the engineer, the checkpoint and the route passed are written, and the statistical result is the thickness and color of the route line. Are distinguished.

  In the educational institution, after receiving the route information report at the educational institution terminal 5, the route information report is analyzed. For example, when the evaluation management server 3 receives information about an operation whose evaluation result is not good or has not been completed By receiving the information about the evaluation item of the operation of the device having many, the educational institution terminal 5 performs the factor analysis, and analyzes and extracts points to be focused on (step A17). This makes it possible to provide accurate educational guidance for each operation item of the device.

It is a figure explaining the basic composition of the proficiency level evaluation system of the present invention. It is a figure explaining the structure of the database part in the skill level evaluation system of this invention. It is a flowchart which shows a part of example of the usage condition of the skill evaluation system of this invention. It is a flowchart which shows another part of an example of the usage condition of the skill evaluation system of this invention. It is a flowchart which shows another part of an example of the usage condition of the skill evaluation system of this invention. It is a flowchart which shows another part of an example of the usage condition of the skill evaluation system of this invention. It is a flowchart which shows another part of an example of the usage condition of the skill evaluation system of this invention. It is a figure explaining an example of the path | route information report which listed the path | route of the operation of the apparatus performed in the proficiency level evaluation system of this invention. It is a figure which shows an example of the information registered into the apparatus operation information database in the proficiency level evaluation system of this invention. It is a figure which shows an example of the confirmation procedure indication information in the proficiency level evaluation system of this invention. It is a figure which shows an example of the information regarding the optimal operation procedure in the skill level evaluation system of this invention. It is a figure which shows an example of the information explaining the recovery method in the skill evaluation system of this invention. It is a figure which shows an example of the information regarding the operation of the apparatus performed in the proficiency level evaluation system of this invention. It is a figure which shows an example of the information registered into the operation screen information database in the proficiency level evaluation system of this invention.

Explanation of symbols

DESCRIPTION OF SYMBOLS 1 Proficiency evaluation system 2 Apparatus 3 Evaluation management server 4 Engineer terminal 5 Education implementation organization terminal 6 Operation terminal 7 Network 30 Information acquisition part 31 Database part 31a Equipment operation information database 31b Execution operation information database 31c Operation screen information database 32 Evaluation item Transmission processing unit 33 Optimal operation setting processing unit 34 Procedure registration processing unit 35 Operation evaluation processing unit 36 Evaluation result transmission processing unit 37 Proficiency level information processing unit 38 Operation screen processing unit 39 Information output unit 41 Information regarding operation of device 42 Regarding confirmation procedure Information 43 Information on the optimum operation procedure 51 Information on the operation of the executed device 52 Information on the evaluation result 53 Information on proficiency level 61 Information on the image displayed on the screen of the device, engineer terminal or operation terminal

Claims (6)

A device and an evaluation management server that evaluates the proficiency level of the operation of the device by an engineer who has learned the operation of the device and manages information on the evaluated proficiency level of the operation of the device are mutually connected via a network. A proficiency assessment system connected communicably,
The evaluation management server
A database unit having a device operation information database in which information related to the operation of the device is registered, and an execution operation information database in which information related to the operation of the executed device is registered;
Based on the information related to the evaluation item of the operation of the device sent from the device acquired by the information acquisition unit via the network, information is extracted from the device operation information database, and the proficiency level of the operation of the executed device is determined. An optimal operation setting processing unit for determining a confirmation procedure to be confirmed, and performing processing for setting an optimum operation procedure indicating the most suitable operation procedure for the evaluation item from the confirmation procedure;
A procedure registration processing unit for performing processing for registering information on the confirmation procedure and information on the optimum operation procedure in the device operation information database;
Registers in the execution operation information database the information regarding the operation of the device that has been executed and sent from the device, acquired by the information acquisition unit via the network, and executes the information based on the information regarding the operation of the device that has been executed. Whether the operation of the performed device is appropriate or not is evaluated from the information extracted from the device operation information database, and the information regarding the evaluated result is associated with the information regarding the operation of the performed device, and the execution operation information An operation evaluation processing unit for performing processing to be registered in the database;
In accordance with a preset condition, information that matches the preset condition is extracted from the device operation information database and / or the execution operation information database, edited into evaluation result information, and the evaluation result information is output to the information output unit. An evaluation result transmission processing unit for performing processing to transmit from the device to the device,
A proficiency assessment system characterized by having Evaluate the device and the level of proficiency of the operation of the device by an engineer who has learned the operation of the device, manage the information related to the evaluated proficiency of the operation of the device, and remotely operate the device A proficiency evaluation system in which an engineer terminal that is connected to each other via a network is capable of communicating with each other,
The evaluation management server
A database unit having a device operation information database in which information related to the operation of the device is registered, and an execution operation information database in which information related to the operation of the executed device is registered;
The information is extracted from the device operation information database and executed based on the information related to the evaluation item of the operation of the device sent from the device via the technician terminal acquired by the information acquisition unit via the network. An optimum operation setting processing unit that performs a process of setting an optimum operation procedure indicating the most suitable operation procedure for the evaluation item from the confirmation procedure;
A procedure registration processing unit for performing processing for registering information on the confirmation procedure and information on the optimum operation procedure in the device operation information database;
Registered in the execution operation information database is information about the operation of the device executed by the information acquisition unit via the network and sent from the device via the engineer terminal, and the executed device Based on the information regarding the operation of the device, it is evaluated from the information extracted from the device operation information database whether the operation of the performed device is appropriate, and the information regarding the evaluated result is the information regarding the operation of the performed device An operation evaluation processing unit that performs a process of registering in the execution operation information database in association with
In accordance with a preset condition, information that matches the preset condition is extracted from the device operation information database and / or the execution operation information database and edited into evaluation result information. An evaluation result transmission processing unit for performing processing to be sent from the device to the technician terminal via the device;
A proficiency assessment system characterized by having Evaluate the device and the level of proficiency of the operation of the device by an engineer who has learned the operation of the device, manage the information related to the evaluated proficiency of the operation of the device, and remotely operate the device A proficiency evaluation system in which an engineer's terminal and an education implementing institution terminal deployed in an institution that conducts education on the operation of the device are connected to each other via a network,
The evaluation management server
A database unit having a device operation information database in which information related to the operation of the device is registered, and an execution operation information database in which information related to the operation of the executed device is registered;
Performs a process of transmitting, from the information output unit to the educational institution terminal, information related to the evaluation item of the operation of the device sent from the device via the engineer terminal acquired by the information acquisition unit via the network An evaluation item transmission processing unit;
The information is extracted from the device operation information database and executed based on the information related to the evaluation item of the operation of the device sent from the device via the technician terminal acquired by the information acquisition unit via the network. The confirmation procedure for confirming the proficiency level of the operation of the device is determined, and from the confirmation procedure, the evaluation item of the operation of the device sent from the educational institution terminal acquired by the information acquisition unit via the network is the most. An optimum operation setting processing unit for performing processing for setting an optimum operation procedure based on information on the optimum operation procedure indicating a suitable operation procedure;
A procedure registration processing unit for performing processing for registering information on the confirmation procedure and information on the optimum operation procedure in the device operation information database;
Registered in the execution operation information database is information on the operation of the device executed by the information acquisition unit via the network and sent from the device via the technician terminal, and Based on the information related to the operation, whether or not the performed device operation is appropriate is evaluated from the information extracted from the device operation information database, and the information related to the evaluated result is the information related to the performed device operation and An operation evaluation processing unit for performing a process of associating and registering in the execution operation information database;
In accordance with a preset condition, information related to the optimum operation procedure and / or evaluation procedure that matches the condition is extracted from the device operation information database, and the extracted information is extracted from the information output unit via the device. An evaluation result transmission processing unit that performs processing to be sent to the technician terminal;
Based on the proficiency level grasp request information for requesting proficiency level grasp information for grasping the proficiency level of the operation of the executed device sent from the education execution organization terminal acquired by the information acquisition unit via the network, From the execution operation information database, information on the executed device operation and information on the evaluation result are extracted and edited as proficiency level grasping information, and the proficiency level grasping information is registered in the execution operation information database, and A proficiency level information processing unit that performs processing to transmit proficiency level grasping information from the information output unit to the educational institution terminal that has sent the proficiency level grasping request information;
A proficiency assessment system characterized by having   The proficiency level evaluation system according to any one of claims 1 to 3, wherein an operation terminal including an input unit and an output unit is connected to the device. The evaluation management server
The database unit further includes an operation screen information database in which information about images displayed on the screen of the device, the technician terminal, or the operation terminal is registered when the device is operated,
While registering in the operation screen information database information related to the operation of the executed device acquired by the information acquisition unit via the network, the device, the engineer terminal or the acquired by the information acquisition unit via the network An operation screen processing unit for performing processing for associating information related to the image displayed on the screen of the operation terminal with information related to the operation of the executed device and registering the information in the operation screen information database;
The proficiency level evaluation system according to any one of claims 1 to 4, further comprising:   The proficiency level evaluation system according to any one of claims 1 to 5, wherein the device is a computer device.

Images