CN112400197B - Training teaching material display system and training teaching material display method - Google Patents

Training teaching material display system and training teaching material display method Download PDF

Info

Publication number
CN112400197B
CN112400197B CN201980045885.8A CN201980045885A CN112400197B CN 112400197 B CN112400197 B CN 112400197B CN 201980045885 A CN201980045885 A CN 201980045885A CN 112400197 B CN112400197 B CN 112400197B
Authority
CN
China
Prior art keywords
training
display
work
input
information
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Active
Application number
CN201980045885.8A
Other languages
Chinese (zh)
Other versions
CN112400197A (en
Inventor
藤原贵之
土屋慎太郎
大西健太郎
菊地克朗
成田贺仁
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
Hitachi Systems Ltd
Original Assignee
Hitachi Systems Ltd
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Hitachi Systems Ltd filed Critical Hitachi Systems Ltd
Priority to CN202310087370.2A priority Critical patent/CN115841777A/en
Publication of CN112400197A publication Critical patent/CN112400197A/en
Application granted granted Critical
Publication of CN112400197B publication Critical patent/CN112400197B/en
Active legal-status Critical Current
Anticipated expiration legal-status Critical

Links

Images

Classifications

    • G—PHYSICS
    • G06—COMPUTING; CALCULATING OR COUNTING
    • G06F—ELECTRIC DIGITAL DATA PROCESSING
    • G06F3/00—Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
    • G06F3/01—Input arrangements or combined input and output arrangements for interaction between user and computer
    • G06F3/048—Interaction techniques based on graphical user interfaces [GUI]
    • G06F3/0484—Interaction techniques based on graphical user interfaces [GUI] for the control of specific functions or operations, e.g. selecting or manipulating an object, an image or a displayed text element, setting a parameter value or selecting a range
    • G—PHYSICS
    • G06—COMPUTING; CALCULATING OR COUNTING
    • G06Q—INFORMATION AND COMMUNICATION TECHNOLOGY [ICT] SPECIALLY ADAPTED FOR ADMINISTRATIVE, COMMERCIAL, FINANCIAL, MANAGERIAL OR SUPERVISORY PURPOSES; SYSTEMS OR METHODS SPECIALLY ADAPTED FOR ADMINISTRATIVE, COMMERCIAL, FINANCIAL, MANAGERIAL OR SUPERVISORY PURPOSES, NOT OTHERWISE PROVIDED FOR
    • G06Q10/00—Administration; Management
    • G—PHYSICS
    • G09—EDUCATION; CRYPTOGRAPHY; DISPLAY; ADVERTISING; SEALS
    • G09B—EDUCATIONAL OR DEMONSTRATION APPLIANCES; APPLIANCES FOR TEACHING, OR COMMUNICATING WITH, THE BLIND, DEAF OR MUTE; MODELS; PLANETARIA; GLOBES; MAPS; DIAGRAMS
    • G09B19/00—Teaching not covered by other main groups of this subclass
    • G—PHYSICS
    • G09—EDUCATION; CRYPTOGRAPHY; DISPLAY; ADVERTISING; SEALS
    • G09B—EDUCATIONAL OR DEMONSTRATION APPLIANCES; APPLIANCES FOR TEACHING, OR COMMUNICATING WITH, THE BLIND, DEAF OR MUTE; MODELS; PLANETARIA; GLOBES; MAPS; DIAGRAMS
    • G09B5/00—Electrically-operated educational appliances
    • G09B5/02—Electrically-operated educational appliances with visual presentation of the material to be studied, e.g. using film strip
    • G—PHYSICS
    • G09—EDUCATION; CRYPTOGRAPHY; DISPLAY; ADVERTISING; SEALS
    • G09B—EDUCATIONAL OR DEMONSTRATION APPLIANCES; APPLIANCES FOR TEACHING, OR COMMUNICATING WITH, THE BLIND, DEAF OR MUTE; MODELS; PLANETARIA; GLOBES; MAPS; DIAGRAMS
    • G09B9/00—Simulators for teaching or training purposes

Abstract

Provided are a training teaching material display system and a training teaching material display method, wherein the training teaching material display system comprises: an information input device (10, 30) that acquires information of operation input of a simulated work; a storage device that stores a work target portion for maintenance work, a tool used, and a procedure of operation input; an output information generation device (20) that generates one or more display screens capable of displaying or executing any one or more of a tool, a work target site, and an operation input to the work target site, which are required for the maintenance work, based on the storage information of the storage device; and a display output device (30) that displays and outputs each of the one or more display screens according to a predetermined output condition, each of the one or more display screens including: an instruction display area that requests a selection operation or the like; and an operation target image display area that displays the operation target image so that a selection operation or the like can be performed.

Description

Training teaching material display system and training teaching material display method
Technical Field
The present invention relates to a training teaching material presentation system and a training teaching material presentation method for presenting a training teaching material for maintenance work of target equipment to a trainee.
Background
Before maintenance work for a target device is performed, training is performed to make an operator understand the process and content of the maintenance work. In general, training is performed in the form of centralized education in which a lecturer describes the structure of a target device, the procedure and content of maintenance work, and the like using an actual target device.
On the other hand, the following training systems are also known: instead of or in combination with intensive education, a worker is trained individually with a computer (see, for example, patent document 1).
Patent document 1 discloses a maintenance education training system for plant equipment, which edits multimedia data such as pictures, images, texts, and voices, which provide preparation work, necessary tools, and work contents in maintenance work, to be used as a teaching material.
Documents of the prior art
Patent literature
Patent document 1 Japanese patent application laid-open No. H10-268746
Disclosure of Invention
Problems to be solved by the invention
However, in the conventional maintenance education training system for plant equipment described in patent document 1, it is assumed that a trainee has a certain level of expertise on target equipment for maintenance work, and even if there is no expertise on target equipment for maintenance work, it is not considered at all that the trainee is made to know the process and content of the maintenance work.
The present invention has been made to solve the above-described problems, and an object of the present invention is to provide a maintenance work training system and a maintenance work training method that enable a trainee to easily and accurately grasp a work process without actual equipment even if the trainee does not have professional knowledge of equipment to be maintained.
Means for solving the problems
In order to achieve the above object, a training teaching material presentation system 1 according to the present invention is a training teaching material presentation system 1 for presenting a training teaching material including a three-dimensional image related to a maintenance work of a target device 401 together with a work space display and changing a presentation content of the training teaching material in accordance with an operation input of a simulation work corresponding to each stage of the maintenance work, the training teaching material presentation system including: information input devices 10 and 30 that acquire information of operation input of the simulation work; a storage device 220 that stores a work target portion 402 for the maintenance work and a tool 404 for the maintenance work as a plurality of operation target images 400 and 403 that can be displayed and selectively operated, and stores a procedure of operation input for the simulation work; an output information generating device 20 that generates one or more display screens 70A, 70B, 70C capable of displaying or outputting, based on the storage information of the storage device, each of the one or more display screens 70A, 70B, 70C capable of displaying or executing at least one of a specific tool 404 necessary for any one of the maintenance jobs in the plurality of operation target images, a work target portion 402 of a specific process in the plurality of operation target images, and an operation input 405 to the simulated job to the work target portion of the specific process; and a display output device 30 that displays and outputs each of the one or more display screens on a display screen in accordance with a predetermined output condition, each of the one or more display screens including: an instruction display area 701 that requests the selection operation or the operation input; and an operation target image display area 702 for displaying a specific operation target image corresponding to the display content of the instruction display area among the plurality of operation target images so that the selection operation on the operation target image or the operation input of the simulation job can be performed.
According to this configuration, in the training teaching material presentation system, each of the one or more display screens includes: a command display area that requests a selection operation of a tool or a work target portion or an operation input to a selected work target portion; and an operation target image display area capable of performing a selection operation or a simulated work operation input of a specific operation target image corresponding to the display content, so that the screen display content is sequentially changed in accordance with the operation input by the user for each screen, and the work process can be easily and accurately grasped without an actual device.
In addition, the training teaching material display system of the present invention may have the following structure: the information input apparatus is capable of acquiring: first input information which is information of the selection operation or the operation input of the simulation job by the lecturer 3; and second input information which is information of the selection operation performed by the training person 4 or the operation input of the simulation work, and the output information generation device sets the predetermined output condition corresponding to the process of the operation input of the simulation work based on the first input information.
According to this configuration, the training materials and the practice materials can be easily and quickly produced in accordance with the required maintenance work process based on the standard operation input of the instructor.
In addition, the training teaching material display system of the present invention may have the following structure: the output information generating device sets, as a part of the predetermined output conditions, the specific tool to be selected on the one or more display screens, the work target site of the specific process to be selected on the one or more display screens, and the content of the reference operation input of the simulation work to be executed on the one or more display screens, respectively, based on the first input information.
According to this configuration, accurate training materials and practice materials can be easily and quickly produced based on standard operation input by the instructor.
The training teaching material presentation system according to the present invention may be configured to have an educational teaching material presentation function of displaying, on the one or more display screens, the specific tool to be selected on the one or more display screens, the work target site of the specific process to be selected on the one or more display screens, and the content of the reference operation input of the simulation work to be executed on the one or more display screens, in a guided manner.
According to this structure, the trainee learns based on the guidance display, and can easily and accurately grasp the maintenance work process in a state where no actual equipment is present.
In addition, the training teaching material display system of the present invention may have a structure having a training teaching material display function as follows: and executing a command display for requesting the selection operation on the one or more display screens or requesting the execution of the operation input of the simulation task on the one or more display screens, in the command display area on the one or more display screens, acquiring the input content of the selection operation on the one or more display screens or the content of the operation input of the simulation task on the one or more display screens from the second input information, and changing the display content of the training material in the command display area and the operation target image display area and executing the training of the simulation task by the person, based on the content of the reference operation input of the simulation task, the content of the specific tool, the operation target part of the specific process, and the specific tool set based on the first input information, and the content of the selection operation or the operation input of the simulation task acquired from the second input information.
According to this structure, training personnel perform exercises, so that the maintenance work process can be easily and accurately grasped without actual equipment.
In addition, the training teaching material display system of the invention can also be in the following structure: the output information generating device acquires, from the second input information, a content of the selection operation on the one or more display screens or an operation input of the simulation task on the one or more display screens for at least a part of the maintenance task, and compares the content of the selection operation or the operation input of the simulation task with the specific tool to be selectively operated on the one or more display screens, the work target site of the specific process to be selected on the one or more display screens, and the content of the operation input of the simulation task to be executed on the one or more display screens, thereby having a function of evaluating the proficiency level of the simulation task by the training staff and a function of managing the evaluation result of the proficiency level of the simulation task by the training staff.
According to this configuration, since the proficiency level of the trainee can be evaluated and managed for the maintenance work, the enthusiasm of the trainee can be increased and the trainee can be appropriately guided.
A training teaching material display method according to the present invention is a training teaching material display method for displaying a training teaching material including a three-dimensional image relating to a maintenance work for a target device together with a work space display, and changing a display content of the training teaching material in accordance with an operation input of a simulation work corresponding to each stage of the maintenance work, the training teaching material display method including: information input steps S1 and S9 for acquiring information of operation input of the simulation job; storing steps S2 and S3 for storing a work target portion for the maintenance work and a tool used for the maintenance work as a plurality of operation target images that can be displayed and can be selectively operated, and storing a procedure of an operation input for the simulation work; an output information generating step S4 of generating one or more display screens 70A, 70B, and 70C capable of displaying or executing any one of the specific tools required for the maintenance work in the plurality of operation target images, the operation target site 402 for the specific process in the plurality of operation target images, and the operation input 405 for the simulated work to the operation target site for the specific process, so that the one or more display screens 70A, 70B, and 70C can display or execute any one of the specific tools, the operation target site 402 for the specific process in the plurality of operation target images, respectively, based on the storage information stored in the storage step; and a display output step S8 of displaying and outputting each of the one or more display screens on a display screen in accordance with a predetermined output condition, each of the one or more display screens including: an instruction display area that requests the selection operation or the operation input; and an operation target image display area for displaying a specific operation target image corresponding to a display content of the instruction display area among the plurality of operation target images so that the selection operation on the operation target image or the operation input of the simulated job can be executed.
According to this configuration, in the training teaching material display method, each of the one or more display screens includes: a command display area that requests a selection operation of a tool or a work target portion or an operation input to a selected work target portion; and an operation target image display area capable of performing a selection operation or a simulated work operation input of a specific operation target image corresponding to the display content, so that the screen display content is sequentially changed in accordance with the operation input by the user for each screen, and the work process can be easily and accurately grasped without an actual device.
Effects of the invention
According to the present invention, it is possible to provide a training teaching material presentation system and a training teaching material presentation method that enable a training person to easily and accurately grasp a work process without actual equipment even if the training person does not have professional knowledge of equipment to be maintained.
Drawings
Fig. 1 is a block diagram of a training teaching material presentation system according to an embodiment of the present invention.
Fig. 2 is a configuration diagram of the operation acquisition terminal shown in fig. 1.
Fig. 3 is a structural diagram of the job information record database shown in fig. 2.
Fig. 4 is a block diagram of the training teaching material generation server shown in fig. 1.
Fig. 5 is a block diagram of the template database shown in fig. 4.
Fig. 6 is a block diagram of a training teaching material execution terminal shown in fig. 1.
Fig. 7 is a structural diagram of the execution information recording database shown in fig. 6.
Fig. 8 is a flowchart of the training teaching material display method according to the present embodiment.
Fig. 9 is a diagram showing a configuration (education mode) of a display screen of the training teaching material execution terminal.
Fig. 10 is a diagram showing a configuration (education mode) of a display screen of the training teaching material execution terminal.
Fig. 11 is a diagram showing a configuration (education mode) of a display screen of the training teaching material execution terminal.
Fig. 12 is a diagram showing a configuration (practice mode) of a display screen of the training teaching material execution terminal.
Fig. 13 is a diagram showing a configuration (practice mode) of a display screen of the training teaching material execution terminal.
Fig. 14 is a diagram showing a configuration (exercise mode) of a display screen of the training material execution terminal.
Fig. 15 is a diagram showing an example of display (education mode) of a screen of a training teaching material execution terminal.
Fig. 16 is a diagram showing an example of display (exercise mode) of a screen of a training teaching material execution terminal.
Fig. 17 is a diagram showing an example of display (exercise mode) of a screen of a training material execution terminal.
Fig. 18 is a diagram showing an example of display (exercise mode) of a screen of a training material execution terminal.
Fig. 19A is a diagram showing an example of display of a screen (for explanation of the device configuration) of a training material execution terminal.
Fig. 19B is a diagram showing an example of display of a screen (for explanation of the device configuration) of the training material execution terminal.
Detailed Description
Hereinafter, a training teaching material display system according to an embodiment of the present invention will be described with reference to the drawings.
The training teaching material presentation system 1 of the present embodiment is a system for presenting training teaching materials for learning a technique of maintenance work of target equipment, particularly, a work process, to a trainee. Hereinafter, a body-building bicycle (registered trademark) will be described as an example of the target equipment, but the target equipment for maintenance work is not limited to this.
In the training material presentation system 1 of the present embodiment, a training material including a Three-dimensional image (3 DCG (Three-dimensional computer graphics) data) related to a maintenance operation of the target device 401 is presented together with a work space display, and the presentation content of the training material is changed in accordance with an operation input of a simulation work corresponding to each stage of the maintenance operation.
Fig. 1 is a block diagram showing a structure of a training teaching material presentation system 1 according to an embodiment of the present invention. As shown in fig. 1, the training teaching material presentation system 1 includes an operation acquisition terminal 10, a training teaching material generation server 20, and a training teaching material execution terminal 30, and these operation acquisition terminal 10, training teaching material generation server 20, and training teaching material execution terminal 30 are connected via a communication network 40.
The training materials presentation system 1 may be configured without the communication network 40, and may be implemented as one device (or a server or a terminal) by combining two arbitrary devices among the motion acquisition terminal 10, the training materials generation server 20, and the training materials execution terminal 30, or may be implemented as one device by integrating three devices.
Action acquisition terminal
First, the operation acquisition terminal 10 will be described.
The action acquisition terminal 10 is a tablet terminal, a Personal Computer (PC), a smartphone, or the like, and acquires information of a training material for generating (compiling) a maintenance job. Specifically, the operation acquisition terminal 10 acquires information (referred to as first input information) of a selection operation or an operation input by the lecturer 3 in a simulation job corresponding to each stage of the maintenance job. The operation acquisition terminal 10 corresponds to the information input device and the output information generation device of the present invention.
For example, in the case where the equipment to be subjected to the maintenance work is a exercise bicycle, the "selection operation and operation input" of the simulation work corresponding to the stage of detaching the console of the exercise bicycle is the selection operation of the tool to be used, the selection operation of the working target portion (for example, a hexagon bolt) to which the tool is to be used, the operation input of moving the console in a specific direction for detachment, or the like.
The motion acquisition terminal 10 may acquire information such as an image, a video, a voice, a body motion, and position information of a work place of the lecturer 3 in the simulation work. By analyzing these pieces of information through image processing or the like, information on selection operation and operation input in the simulation job can be obtained.
Fig. 2 is a configuration diagram showing the configuration of the operation acquisition terminal 10. As shown in fig. 2, the operation acquisition terminal 10 includes a control unit 100, a memory 110 in which various processing programs are stored, a storage 120 in which various databases are stored, a communication unit 101, a sensing unit 102, a recording unit 103, a recording unit 104, a display unit 105, an operation unit 106, and a power supply unit 107, and these units are connected by a connection line (or bus) 130.
The control unit 100 may be configured by a computer having a CPU, a ROM, a RAM, an input/output interface, an external storage device, and the like, and a part or all of the functions thereof may be realized by the CPU executing various processing programs stored in the memory 110.
The communication unit 101 communicates with the training materials generation server 20 and the training materials execution terminal 30 via the communication network 40.
The recording unit 103 includes a microphone, and records the voice of the lecturer 3 at the time of the work, the sound emitted from the work target apparatus, the surrounding sound, and the like.
The video recording unit 104 includes a camera or a video camera, and records a job so that the apparatus to be worked is reflected on the arm of the lecturer 3, for example.
The display unit 105 is, for example, a liquid crystal display, and is configured by a display unit such as a Personal Computer (PC) or a tablet terminal.
The operation unit 106 includes, for example, a keyboard, a mouse, a touch panel, and the like, and is capable of detecting an input operation from the lecturer 3.
The sensor unit 102 includes a ToF (Time Of Flight) sensor, and measures the distance between the work target apparatus and the lecturer 3 to detect the spatial positional relationship Of the lecturer 3 with respect to the work target apparatus. This enables, for example, detection of contact between the instructor 3 and the work target apparatus. The sensor unit 102 can detect the position of the operation acquisition terminal 10 by using a GPS (Global Positioning System).
The power supply unit 107 supplies power necessary for driving the operation acquisition terminal 10.
The memory 110 stores various processing programs constituting the operation accumulation processing unit 111, the teaching material generation processing unit 112, and the information transmission/reception processing unit 113. These processing programs are executed by the CPU of the control section 100, so that the respective processing functions can be realized.
The operation integration processing unit 111 acquires information on the operation (selection operation, operation input) of the lecturer 3 and integrates the information by executing the processing program by the CPU of the control unit 100. The information on the actions of lecturer 3 is stored in job information record database 121 stored in storage 120.
The teaching material generation processing unit 112 executes a processing program executed by the CPU of the control unit 100, and executes processing for creating a training teaching material (content) by using the 3DCG engine.
The information transmission/reception processing unit 113 executes a processing program executed by the CPU of the control unit 100, drives and controls the communication unit 101, and executes processing for transmitting and receiving information to and from the training teaching material generation server 20 or the training teaching material execution terminal 30.
A job information record database 121 is stored in the storage 120.
Fig. 3 is a configuration diagram showing the configuration of the job information record database 121. As shown in fig. 3, the items recorded in each record (row) of the job information recording database 121 are a lecturer number, a job number, a procedure number, a tool number for use, a part to be operated, an operation, a recorded video, and a recorded voice.
The lecturer number is an identification number uniquely assigned to each lecturer 3. The job number is a number uniquely assigned to specify a job. The process number is a number for specifying which process among the job processes for the job specified by the job number.
The tool number to be used is an identification number uniquely assigned to the tool used for the process designated by the work number and the process number. The work target portion is a target portion to be operated by the tool. The operation indicates the content of an operation performed using a tool for the work target portion.
The recorded video is recorded with the video file name of the recorded work, and the recorded video stored in the memory 220 of the training teaching material generation server 20 can be accessed. The recorded speech includes a speech file name in which speech is recorded at the time of work, and can access recorded speech stored separately in the memory 220 of the training teaching material generation server 20.
Note that, in the case where the lecturer 3 performs the selection operation using the operation unit 106 on the image displayed on the display unit 105 of the operation acquisition terminal 10 in a selectable or operable manner, recording of the video and recording of the voice may not be necessary.
Every time the lecturer 3 performs the work process specified by the work number and the procedure number, the (line) data is additionally recorded in the work information recording database 121.
Training teaching material generation server
Next, the training teaching material generation server 20 will be explained.
Fig. 4 is a block diagram of the training teaching material generation server 20. As shown in fig. 4, the training teaching material generation server 20 includes a control unit 200, a memory 210 in which various processing programs are stored, a storage 220 in which various databases are stored, a communication unit 201, a display unit 205, an operation unit 206, and a power supply unit 207, and these units are connected by a connection line (or bus) 230.
The training material generation server 20 corresponds to the output information generation device of the present invention, and the storage 220 corresponds to the storage device of the present invention.
The control unit 200 may be configured by a computer having a CPU, a ROM, a RAM, an input/output interface, an external storage device, or the like, and a part or all of the functions of the training teaching material generation server 20 may be realized by executing various processing programs stored in the memory 210 by the CPU.
The communication unit 201 communicates with the operation acquisition terminal 10 and the training teaching material execution terminal 30 via the communication network 40.
The display unit 205 is configured by a liquid crystal display or the like, and can display training materials, work videos of the lecturer 3, management status of the training material presentation system, and the like.
The operation unit 206 includes, for example, a keyboard, a mouse, a touch panel, and the like, and is capable of detecting an input operation from an operator.
The power supply unit 207 supplies power necessary for driving the training teaching material generation server 20.
The memory 210 stores various processing programs constituting the operation accumulation processing unit 211, the teaching material generation processing unit 212, and the information transmission/reception processing unit 213. These processing programs are executed by the CPU of the control unit 200, whereby the respective processing functions can be realized.
The operation accumulation processing unit 211 performs accumulation processing of the job information transmitted from the operation acquisition terminal 10 by executing the processing program by the CPU of the control unit 200.
The teaching material generation processing unit 212 executes a processing program by the CPU of the control unit 200, and performs a training teaching material generation process using the 3DCG engine based on the work information transmitted from the motion acquisition terminal 10.
The information transmission/reception processing unit 213 executes a processing program executed by the CPU of the control unit 200, drives and controls the communication unit 201, and executes processing for transmitting and receiving information to and from the operation acquisition terminal 10 or the training material execution terminal 30.
The storage 220 stores a template database 221 and a training teaching material database 222.
Fig. 5 is a configuration diagram showing the configuration of the template database 221. As shown in fig. 5, the items of each record (row) recorded in the template database 221 are a template number, a progress pattern number, and a screen configuration number.
The template number is an identification number uniquely assigned to a template used by the training materials. The progress pattern number is an identification number uniquely assigned to a pattern in which the screen progress is displayed by an operation input by the training person 4. For example, when the progress pattern number is 1, the screen configuration displayed on the display unit 205 changes (progresses) so that the screen configuration number 1 → the screen configuration number 2 → the screen configuration number 4 every time an operation by the trainee 4 is input.
The screen configuration number is an identification number uniquely assigned to the screen configuration displayed on the display unit 205. For example, as shown in fig. 9, a screen configuration number 1 indicates a configuration mode in which an instruction display area 501 is provided in the upper right of the screen, an operation target image display area 502 is provided in the lower right of the screen, a guidance display area 503 is provided in the left of the screen, and an operation target image 400 indicating the target device 401 is displayed in the operation target image display area 502.
The teaching material generation processing unit 212 can specify the progress pattern of the training screen by specifying the template number registered in the template database 221.
Every time a new progressing pattern is designed, data is additionally recorded (line).
The training materials database 222 stores training materials generated by the materials generation processing unit 212. The training materials are linked by the material number uniquely assigned to each material, the name of the target device, the work content, and the like, and can be retrieved and acquired based on information such as the material number.
Training teaching material execution terminal
The training teaching material execution terminal 30 will be explained below.
The training teaching material execution terminal 30 is, for example, a tablet terminal, a PC, or the like. The training material execution terminal 30 corresponds to the information input device and the display output device of the present invention.
Fig. 6 is a block diagram showing the configuration of the training teaching material execution terminal 30. As shown in fig. 6, the training teaching material execution terminal 30 includes a control unit 300, a memory 310 in which various processing programs are stored, a storage 320 in which various databases are stored, a communication unit 301, a display unit 305, an operation unit 306, and a power supply unit 307.
The control unit 300 may be configured by a computer having a CPU, a ROM, a RAM, an input/output interface, an external storage device, and the like, and a part or all of the functions thereof may be realized by executing various processing programs stored in the memory 310 by the CPU.
The communication unit 301 communicates with the training materials generation server 20 and the operation acquisition terminal 10 via the communication network 40.
The display unit 305 is, for example, a liquid crystal display, and is configured by a display unit such as a tablet terminal or a PC.
The operation unit 306 includes, for example, a keyboard, a mouse, a touch panel, and the like, and is capable of detecting an input operation from the trainee 4.
The power supply unit 307 supplies power necessary for driving the training teaching material execution terminal 30.
The memory 310 stores various processing programs constituting a teaching material execution processing unit 311, an execution data accumulation processing unit 312, and an information transmission/reception processing unit 313. These processing programs are executed by the CPU of the control unit 300, and thereby the respective processing functions can be realized.
The teaching material execution processing unit 311 executes the processing program by the CPU of the control unit 300, and executes the processing for executing the training teaching material distributed from the training teaching material generation server 20. The implementation of the training materials means that the display screen included in the training materials is displayed on the display unit 305, and training and education are performed in accordance with the operation input from the training staff 4 to the operation unit 306.
The execution data accumulation processing unit 312 acquires information of the selection operation and the operation input performed by the training person 4 by executing the processing program by the CPU of the control unit 300, and accumulates the information. The execution information of the trainee 4 is stored in the execution information record database 321 stored in the storage 320.
The information transmission/reception processing unit 313 executes a processing program by the CPU of the control unit 300, drives and controls the communication unit 301, and executes processing for transmitting and receiving information to and from the training teaching material generation server 20 or the action acquisition terminal 10.
The storage 320 stores an execution information record database 321.
Fig. 7 is a configuration diagram showing the configuration of the execution information recording database 321. As shown in fig. 7, the items recorded in each record (row) of the execution information recording database 321 are a trainee number, a work number, a procedure number, a tool number for use, a work target portion, an operation, accuracy, and proficiency.
The training person number is an identification number uniquely assigned to each training person 4. The job number is a number uniquely assigned to specify a job. The process number is a number for specifying which process among the job processes for the job specified by the job number.
The tool number to be used is a number uniquely assigned to the tool used in the process designated by the work number or the process number. The work target portion is a target portion to be operated by a tool. The operation indicates the content of an operation performed using a tool for the work target portion.
The accuracy indicates whether or not the work content (tool usage, work target site, operation) performed by the trainer 4 matches the work content of the lecturer 3. For example, O marks indicate agreement, and x marks indicate disagreement.
The proficiency level indicates the proficiency level of the work performed by the trainer 4, and is ranked according to the degree to which the work content (the use tool, the work target site, and the operation) performed by the trainer 4 matches the work content of the lecturer 3. The proficiency is expressed, for example, in three stages (A > B > C) of A, B, C, and in FIG. 7, two of the processes 1 to 3 are correct and one is incorrect, so the proficiency is B in the middle.
Every time the training person 4 performs a job designated by the job number and the procedure number, the execution information recording database 321 additionally records (line) data.
Next, a training material presentation method according to the present embodiment will be described.
Fig. 8 is a flowchart of the training teaching material display method according to the present embodiment. First, a generation stage of the training materials will be explained.
In the training material generation step, the lecturer 3 performs a simulation task and acquires information on operation input in the simulation task at the operation acquisition terminal 10 (S1). Specifically, the lecturer 3 operates the operation unit 106 such as a mouse, a keyboard, and a touch panel on the image of the 3DCG data of the target device operatively displayed on the display screen of the operation acquisition terminal 10, and acquires information input by the operation from the operation acquisition terminal 10.
The information of the operation input in the simulation job may be acquired by image processing or the like based on the image taken of the simulation job performed by the lecturer 3.
On the other hand, the training teaching material generation server 20 stores the work target site of the maintenance work and the tool for the maintenance work in the memory 220 as a plurality of operation target images that can be displayed and can be selectively operated (S2), and stores the procedure of the operation input of the simulation work in the memory 220 based on the information of the operation input acquired in step S1 (S3).
Then, the training teaching material generation server 20 generates a display screen of the training teaching material including the first to third display screens so as to be able to display and output the training teaching material based on the stored information stored in steps S2 and S3 (S4). The first display screen (70A in fig. 16) is a screen for displaying a specific tool necessary for any one step of the maintenance work among the plurality of operation target images stored in step S2. The second display screen (70B in fig. 17) is a screen for displaying a work target portion of a specific step in a plurality of operation target images. The third display screen (70C in fig. 18) is a screen on which an operation input of a simulation job for a work target portion of a specific process can be executed.
As described above, each of the first display screen, the second display screen, and the third display screen includes the instruction display area 701 and the operation target image display area 702. The instruction display area is a display area in which a selection operation or an operation input is requested. The operation target image display area is a display area for displaying a specific operation target image corresponding to the display content of the instruction display area among the plurality of operation target images so that a selection operation for the operation target image or an operation input for a simulation job can be performed.
Next, the execution phase of the training materials will be described.
As shown in fig. 8, first, the training staff 4 inputs the device name and the training menu to be maintained to the training teaching material execution terminal 30 (S5). Examples of the items of the training menu include an education mode and an exercise mode.
Then, the device name and the information of the training menu inputted by the training person 4 are transmitted to the training teaching material generation server 20 (S6).
The training materials generation server 20 searches for the corresponding training materials (contents) based on the device name and the information of the training menu received from the training materials execution terminal 30, and distributes the training materials found in the search to the training materials execution terminal 30 (S7).
Next, the training material execution terminal 30 displays each of the first display screen, the second display screen, and the third display screen on which the distributed training material is output, on the display screen of the display unit 305, according to a predetermined output condition (S8).
The training staff 4 operates the operation unit 306 in accordance with the instruction displayed in the instruction display area of the display screen of the training teaching material execution terminal 30, and the training teaching material execution terminal 30 acquires information of the operation input in the simulation work (S9).
In step S10, it is determined whether training or a process is completed, and if not, the process returns to step S8, and if so, the process proceeds to step S11.
In step S11, the operation input of the trainee 4 acquired in step S9 and the operation input by the instructor 3 acquired in step 1 of the generation stage of the training teaching material are compared and determined, and the proficiency level of the maintenance work is evaluated based on the degree of matching (S11). For example, the proficiency may be ranked by A, B, C (proficiency is a > B > C) and an integer of 1 to 10 (the greater the proficiency is), and the like.
The training teaching material execution terminal 30 records and manages the proficiency level of the training staff 4 in the maintenance work in the execution information recording database 321 of the storage 320 (S12).
Next, the execution of the training materials in the training material execution terminal 30 will be described with reference to the display screen of the display unit 305.
First, a case where the mode of the training menu is "education" will be described.
Fig. 9, 10, and 11 are views illustrating a part of the training materials in the education mode, and showing the configuration of the display screen of the display unit 305 of the training material execution terminal 30. As shown in fig. 9, the display screen 50A in the education mode includes an instruction display area 501, an operation target image display area 502, and a guide display area 503.
The instruction display area 501 is an area for displaying the instruction contents to the trainee 4, and is displayed, for example, "please click" the replacement valve ", or the like.
The operation target image display area 502 is an area in which an image of the target device 401 of the job is displayed, and for example, displays an image of the target device 401 specified by the device name a.
The guidance display area 503 is an area where guidance information for training is displayed, and information such as a device name, a mode of a training menu, work content, and a work procedure is displayed.
In the display screen 50A of fig. 9, when the trainee 4 clicks the "replacement valve" provided in the guide display area 503 with the mouse, the display color of the corresponding member (the work target site 402) of the target device 401 displayed in the operation target image 400 in the operation target image display area 502 changes.
Next, the user enters the display screen 50B of fig. 10 and displays "please click" (1) to detach the cover "in the instruction display area 501. The corresponding work target portion 402 (screw) of the target device 401 displayed in the operation target image 400 in the operation target image display area 502 is displayed in a blinking manner. Further, a tool image 403 in which a tool 404 (a screwdriver) is displayed near the work target portion 402. The user can know that the item has ended by clicking the item in the guide display area 503 and displaying the item with a color change, underlining, or thickening. In this state, the trainee 4 clicks "(1) remove cover" in the guidance display area 503 with a mouse or the like.
Next, the process proceeds to a display screen 50C of fig. 11. The command display area 501 displays "please click" (3) to detach the valve ". In addition, the attention display area 504 is displayed so as to overlap with the operation target image display area 502. The attention attracting display area 504 blinks to display "the rotation direction before the detachment is noticed", and the like, and communicates the rotation direction at the time when the valve is to be noticed to be detached to the trainee 4. When the trainee 4 clicks the "(3) removal cover" in the guidance display area 503 with a mouse or the like, the trainee proceeds to the next display screen. In this way, the trainee 4 can understand the process and the content of the maintenance work by clicking the item in the guidance display area 503 in accordance with the instruction displayed in the instruction display area 501.
Next, a case where the mode of the training menu is "exercise" will be described.
Fig. 12, 13, and 14 are diagrams illustrating a part of the training materials in the practice mode, and showing the configuration of the display screen of the display unit 305 of the training material execution terminal 30. As shown in fig. 12, the training mode display screen 60A includes an instruction display area 601, an operation target image display area 602, a guide display area 603, and a tool display area 604.
The instruction display area 601 is an area for displaying instruction contents to the trainee 4, and is displayed, for example, "please select a tool necessary for detaching the cover" or the like.
The operation target image display area 602 is an area in which an image of the target device 401 of the job is displayed, and displays, for example, an image of the target device 401 specified by the device name a.
The guidance display area 503 is an area for displaying guidance information for training, and displays information such as a device name, a mode of a training menu, work content, and a work procedure.
In the tool display area 604, images 403a, 403b, 403c, 403d, … of tools used for maintenance work are displayed in a scrollable manner in the horizontal direction. The trainee 4 selects a tool used among the tools displayed in the tool display area 604 by using a mouse or the like in accordance with the instruction of the instruction display area 601.
If the tool selected by the trainee 4 is correct, "correct" is displayed, and if not, "incorrect" is displayed, and the screen proceeds to the display 60B of fig. 13. If not, the selection operation may be repeated until correct.
In the display screen 60B of fig. 13, the command display area 601 displays "please click the number of roots at the position of the screw necessary for cover removal".
An image of the 3DCG model of the target device 401 embedded in the working target site 402 (screw) is displayed in the working target image display area 602. If the trainee 4 clicks the required number of times with a mouse or the like, the clicked position is the work target portion, and "correct" and "incorrect" are displayed, and the next question, i.e., the display screen 60C of fig. 14, is entered.
In the display screen 60C of fig. 14, the command display area 601 displays "please select the purpose of cover removal".
Answer articles 606a, 606b, 606c are displayed in the answer display area 605. The trainee 4 clicks the answer considered to be correct among the answer articles to select. If the answer article selected by the training person 4 is correct, "correct" is displayed, and if wrong, "incorrect" is displayed, and the next display screen is entered. In this way, the trainee 4 can answer the exercise questions of the maintenance work by performing the selection operation in accordance with the instruction displayed on the instruction display area 601.
Next, a description will be given of a display screen of the display section 305 of the training teaching material execution terminal 30 in a case where the target device 401 is a body-building bicycle as an example.
Fig. 15 is a diagram showing the display screen 80 of the training material execution terminal 30 in the education mode. As shown in fig. 15, the display screen 80 includes an instruction display area 801, an operation target image display area 802, guide display areas 803 and 805, and an attention attracting display area 804.
The guide display area 803 lists work items, and the "replacement of the belt" (1) release of the fixing screws "item is selected by the trainee 4. The selected item is subjected to highlighting such as change of character color, addition of underline, and bold conversion.
The guidance display area 805 is an area for displaying which process (job) among the maintenance jobs is performed, and is displayed as, for example, "process: replacement of the drive belt "and the like.
An operation target image 400 showing the exercise bike as the target device 401 is displayed in the operation target image display area 802. Further, an attention attracting display area 804 is provided so as to overlap the operation target image display area 802, and the trainee 4 is notified of "attention, screw is slightly loosened and not detached". "equal" (1) loosen the set screw "operation. Further, the fixing screw as the operation target portion may be blinked or the display color may be changed to highlight the operation target portion.
An instruction to the trainee 4 is displayed in the instruction display area 801, and displayed here as "user operation: please click after confirmation. "and the like. The trainee 4 knows the operation target portion of the "replacement of the belt" (1) loosening the fixing screw "operation and the attention point of the operation, and clicks the next operation, that is" (2) loosening the belt tensioner ". The next display screen is entered by the training person 4 clicking.
Next, a description will be given of a display screen of the display section 305 of the training teaching material execution terminal 30 in a case where the target device 401 is a body-building bicycle as an example.
Fig. 16 is a diagram showing a display screen 70A of the training material execution terminal 30 in the exercise mode. As shown in fig. 16, the display screen 70A includes an instruction display area 701, an operation target image display area 702, a guide display area 703, and a tool display area 704. The display screen 70A corresponds to the display screen of the present invention.
The guidance display area 703 lists work items, and is a state in which the "change console" item is selected by the training person 4. The selected item is subjected to highlighting such as change of character color, addition of underline, and bold conversion.
An operation target image 400 showing the exercise bike as the target apparatus 401 is displayed in the operation target image display area 702.
In the tool display area 704, a plurality of tool images 403a, 403b, 403c, 403d, and … showing a plurality of tools 404a, 404b, 404c, 404d, and … are displayed, respectively. In fig. 16, four tool images are displayed, but by scrolling in the lateral direction, other tool images can be displayed. For example, a tool image may be prepared for all tools used for maintenance work on a fitness bike and displayed in tool display area 704.
In the instruction display area 701, as an instruction to the trainee 4, the "user operation: please select the tool when disassembling the console ". The trainee 4 selects a tool to be used when the console is detached from the tool group displayed in the tool display area 704. The selection can be performed by a click operation in a state where the selection object is instructed by a pointer such as a mouse.
If the tool selected by the trainee 4 is correct, "correct" is displayed, and if not, "incorrect" is displayed, and then the screen for displaying the next question shown in fig. 17 is entered.
Fig. 17 is a diagram showing a display screen 70B of the next problem.
An operation target image 400 showing the exercise bike as the target apparatus 401 is displayed in the operation target image display area 702. In the instruction display area 701, as an instruction to the trainee 4, a "user operation: please click the number of times of the root number for the position of the hex bolt for disassembling the console. ".
The trainee 4 clicks and selects the position of the hexagon bolt (the work site 402) in the work target image 400 showing a part of the exercise bike displayed in the work target image display area 702. If all the positions of the clicked hexagon bolts are correct, "correct" is displayed, and if one is wrong, "incorrect" is displayed, and then the process proceeds to the display screen for the next question shown in fig. 18. Further, this display screen 70B corresponds to a second display screen of the present invention.
Fig. 18 is a diagram showing a display screen 70C of the next problem.
An operation target image 400 showing a portion of a console of the exercise bicycle as the target apparatus 401 is displayed in the operation target image display area 702. Three arrows are shown in the vicinity of the console, which arrows indicate the direction in which the console is moved when it is removed. In the instruction display area 701, as an instruction to the trainee 4, a "user operation: when the console is removed from the column, please choose the direction in which to initially move the console. ".
The trainer 4 clicks and selects an arrow indicating a direction of detaching the console of the exercise bike, which is displayed in the operation target image display area 702, and determines that the arrow is correct. If the direction indicated by the clicked arrow is correct, "correct" is displayed, and if the direction indicated by the clicked arrow is incorrect, "incorrect" is displayed, and then the display screen of the next question is entered. In this way, the trainee 4 can exercise the maintenance work by performing the selection operation or the operation input according to the instruction displayed in the instruction display area 701. Further, this display screen 70C corresponds to a third display screen of the present invention.
In the above description, the structure of the training teaching material database 222 is to generate: a first display screen 70A for displaying a specific tool 404 necessary for any one of the steps of the maintenance work among the plurality of operation target images; a second display screen 70B for displaying a work target portion 402 of a specific process in the plurality of operation target images; and a third display screen 70C on which an operation input 405 for a simulation job for the job target site 402 of the specific process can be executed, but the configuration is not limited to this. The training textbook database 222 may also have the following structure: based on the storage information of the storage 220 (storage device), one or more display screens capable of displaying or executing: a specific tool 404 required for any one step of the maintenance work among the plurality of operation target images; a work target portion 402 for a specific process in the plurality of operation target images; and at least one of the operation inputs 405 for the simulation operation on the operation target portion 402 of the specific step.
For example, a specific tool 404 necessary for any one step of the maintenance work among the plurality of operation target images and a work target site 402 of a specific step among the plurality of operation target images may be displayed on the first display screen 70A. For example, a specific tool 404 necessary for any one step of the maintenance work among the plurality of operation target images and a work target site 402 of a specific step among the plurality of operation target images may be displayed on the first display screen 70A, and an operation input 405 of the simulation work to the work target site 402 of the specific step may be displayed so as to be executable. In this case, one display screen may be generated for the specific process. For example, the second display screen 70B may display the work target portion 402 of the specific process in the plurality of operation target images, and may display the operation input 405 of the simulated job for the work target portion 402 of the specific process in an executable manner. In either case, on each of the display screens 70A, 70B, and 70C, the content of the training materials is changed in accordance with the operation input or selection operation of the simulation work corresponding to each stage of the maintenance work.
Fig. 19 is a diagram showing another example of the display screen of the display unit 305 of the training teaching material execution terminal 30. As shown in fig. 19A, an image of the attached exercise bicycle is displayed on the display unit 305. When the trainee 4 performs a predetermined operation, for example, an operation of clicking an arbitrary position on the display screen, using the operation unit 306, an exploded view as shown in fig. 19B is shown.
In fig. 19A and 19B, the exercise bicycle or the component group thereof may be rotated in the towing direction by, for example, performing a towing operation on the mouse. By doing so, the exercise bicycle or its component groups can be viewed from arbitrary directions, and the structure of the subject apparatus is more easily understood.
Next, the operation and effect will be explained.
As described above, in the training materials presentation system 1 and the training materials presentation method according to the present embodiment, each of the first to third display screens 70A, 70B, and 70C includes: a command display area 701 for requesting a selection operation of the tool 404 and the work target portion 402 or an operation input 405 to the selected work target portion; and an operation target image display area 702 capable of performing a selection operation or a simulated job operation input of a specific operation target image 400 corresponding to the display content. According to this configuration, the screen display contents are sequentially changed in accordance with the user operation input to each screen, and the work process can be easily and accurately grasped without actual equipment.
In the training teaching material presentation system 1 according to the present embodiment, the operation acquisition terminal 10 can acquire first input information, which is information on a selection operation performed by the lecturer 3 or an operation input of a simulation task, the training teaching material execution terminal 30 can acquire second input information, which is information on a selection operation performed by the training person 4 or an operation input of a simulation task, and the training teaching material generation server 20 sets predetermined output conditions corresponding to a procedure of the operation input of the simulation task based on the first input information. With this configuration, the training materials and the practice materials can be easily and quickly created according to the required maintenance work process based on the standard operation input of the instructor 3.
In the training teaching material presentation system 1 according to the present embodiment, the training teaching material generation server 20 sets, as part of predetermined output conditions, based on the first input information input by the instructor 3: a specific tool 404 that should be selected using the first display 70A; a work target portion 402 for a specific process to be selected on the second display screen 70B; and the contents of the reference operation input 405 of the simulation job to be executed with the third display screen 70C. With this configuration, accurate training materials and practice materials can be easily and quickly produced based on the standard operation input by the instructor 3.
The training teaching material presentation system 1 according to the present embodiment has a teaching material presentation function of displaying, on a display screen, guidance for: a specific tool 404 to be selected on the first display screen 70A; a work target portion 402 for a specific process to be selected on the second display screen 70B; and the contents of the reference operation input 405 of the simulation job to be executed with the third display screen 70C. With this configuration, the trainee 4 can learn based on the guidance display, and can easily and accurately grasp the maintenance work process without actual equipment.
In addition, the training materials presentation system 1 of the present embodiment has a training materials presentation function of: an instruction display area 701 on the display screen executes an instruction display for requesting a selection operation on the first display screen 70A or the second display screen 70B or an operation input for requesting execution of a simulation task on the third display screen 70C, acquiring an input content of the selection operation on the first display screen 70A or the second display screen 70B or an input content of the operation input of the simulation task on the third display screen 70C from the second input information input by the training staff 4, and changing the display content of the training material in the instruction display area 701 and the operation target image display area 702 based on the specific tool set based on the first input information, the content of the work target part of the specific process and the reference operation input of the simulation task, and the content of the selection operation or the operation input of the simulation task acquired from the second input information, and causing the training staff to execute the practice of the simulation task. According to this configuration, the trainee 4 performs the exercise, thereby being able to easily and accurately grasp the maintenance work process without actual equipment.
In the training teaching material presentation system 1 according to the present embodiment, the training teaching material generation server 20 has a function of evaluating the proficiency level of the simulation task performed by the training staff 4 and a function of managing the evaluation result of the proficiency level of the simulation task performed by the training staff 4 by acquiring the contents of the selection operation on the first display screen 70A to the third display screen 70C or the operation input of the simulation task on the third display screen 70C from the second input information input by the training staff 4, and comparing the contents of the selection operation or the operation input of the simulation task with the contents of the specific tool to be selected on the first display screen 70A, the work target part of the specific process to be selected on the second display screen 70B, and the operation input of the simulation task to be executed on the third display screen 70C. According to this configuration, since the proficiency of the trainee can be evaluated and managed with respect to the maintenance work, the enthusiasm of the trainee 4 for training can be improved and the trainee 4 can be appropriately guided.
As described above, the present invention has an effect of enabling a trainee to easily and accurately grasp a work process without actual equipment even if the trainee does not have professional knowledge of a target equipment for maintenance work, and is useful for all training material presentation systems and training material presentation methods.
Description of reference numerals:
1: training teaching material display system
3: lecturer
4: training personnel
10: action acquisition terminal (information input device)
20: training teaching material generation server (output information generation device)
30: training teaching material execution terminal (information input device, display output device)
40: communication network
50A, 50B, 50C, 60A, 60B, 60C: displaying an image
70A: a first display picture
70B: second display screen
70C: third display screen
100. 200 and 300: control unit
101. 201, 301: communication unit
102: sensing part
103: recording part
104: video recording part
105. 205, 305: display unit
106. 206, 306: operation part
107. 207, 307: power supply unit
110. 210, 310: memory device
111. 211: action accumulation processing part
112. 212, and (3): teaching material generation processing unit
113. 213, 313: information transmitting/receiving processing unit
120. 220, 320: accumulator (storage device)
121: job information record database
221: template database
222: training teaching material database
311: teaching material execution processing unit
312: execution data accumulation processing unit
321: execution information record database
400: operation object image
401: object device
402: work target site
403: tool image
404: tool with a locking mechanism
405a, 405b, 405c: operation input
501. 601, 701, 801: instruction display area
502. 602, 702, 802: operation target image display area
503. 603, 703, 803, 805: guide display area
504. 804: attention-calling display area
604. 704: tool display area
605: answer display area
606a, 606b, 606c: answering article

Claims (6)

1. A training teaching material presentation system (1) that presents a training teaching material including a three-dimensional image relating to a maintenance work for a target device (401) together with a work space display and changes the presentation content of the training teaching material in accordance with an operation input of a simulation work corresponding to each stage of the maintenance work, the training teaching material presentation system comprising:
an information input device (10, 30) that acquires information of operation input of the simulated work;
a storage device (220) that stores a work target portion (402) for the maintenance work and a tool (404) for the maintenance work as a plurality of operation target images (400) that can be displayed and that can be selectively operated, and that stores a procedure of operation input for the simulation work;
an output information generation device (20) that generates, based on the storage information of the storage device, a plurality of display screens (50A, 50B, 50c, 60a, 60B, 60c 70a, 70B, 7080) that can display or execute any one of a specific tool (404) required for any one of the maintenance tasks, a work target site (402) for a specific procedure, and an operation input (405) to the simulated task for the work target site for the specific procedure, from among the plurality of operation target images, so as to be capable of displaying output; and
a display output device (30) for displaying and outputting each of the plurality of display screens on the display screen according to a predetermined output condition,
each of the plurality of display screens includes: an instruction display area (501, 601; and an operation target image display area (502, 602, 802) for displaying a specific operation target image corresponding to the display content of the instruction display area among the plurality of operation target images so that the selection operation for the operation target image or the operation input for the simulated job can be executed,
the information input apparatus is capable of acquiring: first input information which is information of the selection operation or the operation input of the simulation operation performed by a lecturer (3); and second input information which is information of the selection operation performed by a training person (4) or the operation input of the simulation work,
the output information generation device sets the predetermined output condition corresponding to a process of an operation input of the simulated work based on the first input information, and when each of a plurality of training display screens (50A, 50B, 50C 60A, 60B, 60C 80) requesting acquisition of the second input information is output in the instruction display area, a guide display area (503, 603).
2. The training teaching material presentation system of claim 1,
the output information generation device sets, as a part of the predetermined output condition, the contents of the specific tool to be selected on any one of the plurality of training display screens, the work target site of the specific process to be selected on any one of the plurality of training display screens, and the reference operation input of the simulated work to be executed on any one of the plurality of training display screens, respectively, based on the first input information, and displays the plurality of operation contents together while highlighting the selected operation content as compared with the display of the other operation contents in the display of the plurality of operation contents in the guidance display areas (503, 603.
3. The training teaching material presentation system according to claim 1 or 2,
the training teaching material display system has a teaching material display function for education, and the teaching material display function for education is as follows: displaying, on the plurality of training display screens, the specific tool to be selected, the work target site of the specific process to be selected, and the content of the reference operation input for the simulated work to be executed in a guided manner,
in the case of a predetermined educational training mode in which the educational material presentation function is exhibited, the mode display of the predetermined educational training mode and the project name of the simulation task including the plurality of operation contents as a procedure are included in the display in the guide display area on each screen of the training display screen.
4. The training teaching material presentation system according to claim 1 or 2,
the training teaching material display system has the function of displaying the training teaching material,
the teaching material for exercise-display function is as follows:
executing an instruction display requesting the selection operation or an operation input requesting execution of the simulation task in the instruction display area on each of the training display screens, and,
acquiring an input content of the selection operation or an operation input content of the simulation job from the second input information,
changing the contents of the training materials displayed in the command display area and the operation target image display area and causing the trainee to execute the training for the simulation work based on the contents of the specific tool, the work target site of the specific process, and the reference operation input for the simulation work set based on the first input information, and the contents of the selection operation or the operation input for the simulation work acquired from the second input information,
in the case of a predetermined training mode for practice that exhibits the training teaching material display function, the mode display of the predetermined training mode for practice and the project name of the simulation task including the plurality of operation contents as a procedure are included in the display in the guidance display area on each screen of the training display screen.
5. The training teaching material display system of claim 4,
the output information generation device acquires, from the second input information, contents of the selection operation or the operation input of the simulation task on each of the plurality of training display screens for at least a part of the maintenance task, and compares the contents of the selection operation or the operation input of the simulation task with the specific tool to be selectively operated on the plurality of display screens, the part to be operated in the specific process, and the contents of the operation input of the simulation task to be executed on the plurality of display screens, thereby having a function of evaluating the proficiency level of the simulation task by the training staff and a function of managing the evaluation result of the proficiency level of the simulation task by the training staff.
6. A training material presentation method for presenting a training material including a three-dimensional image relating to maintenance work for a target device together with a work space display, and changing presentation contents of the training material in accordance with operation input of simulation work corresponding to each stage of the maintenance work, the training material presentation method comprising:
an information input step of acquiring operation input information of the simulation work by the action acquisition terminal and the training teaching material execution terminal, respectively;
a storage step of storing, by the training teaching material generation server, a work target portion for the maintenance work and a tool used for the maintenance work as a plurality of operation target images that can be displayed and can be selectively operated, and storing a procedure of an operation input of the simulation work;
an output information generation step of generating, by the training teaching material generation server, a plurality of display screens capable of displaying or executing, on the basis of the stored information stored in the storage step, at least one of a specific tool required for any one of the maintenance work, a work target site for a specific process, and an operation input to the simulation work for the work target site for the specific process, among the plurality of work target images, so as to be capable of outputting the display screens; and
a display output step of displaying and outputting each of the plurality of display screens on a display screen according to a predetermined output condition through the training material execution terminal,
each of the plurality of display screens includes: an instruction display area that requests the selection operation or the operation input; and an operation target image display area for displaying a specific operation target image corresponding to display contents of the instruction display area among the plurality of operation target images so that the selection operation on the operation target image or the operation input of the simulated job can be executed,
in the information input step, first input information that is information of the selection operation by the lecturer or the operation input of the simulation task may be acquired by the action acquisition terminal, and second input information that is information of the selection operation by the training person or the operation input of the simulation task may be acquired by the action acquisition terminal,
in the output information generating step, the predetermined output condition corresponding to a procedure of an operation input of the simulated work is set based on the first input information, and when each of a plurality of training display screens requesting acquisition of the second input information is output in the instruction display area, a guide display area showing a procedure of an operation of the simulated work requesting acquisition of the second input information by display of a plurality of operation contents is included in each of the training display screens together with the operation target image display area.
CN201980045885.8A 2018-11-20 2019-07-29 Training teaching material display system and training teaching material display method Active CN112400197B (en)

Priority Applications (1)

Application Number Priority Date Filing Date Title
CN202310087370.2A CN115841777A (en) 2018-11-20 2019-07-29 Training teaching material display system and training teaching material display method

Applications Claiming Priority (3)

Application Number Priority Date Filing Date Title
JP2018217702A JP7014698B2 (en) 2018-11-20 2018-11-20 Training material presentation system and training material presentation method
JP2018-217702 2018-11-20
PCT/JP2019/029594 WO2020105221A1 (en) 2018-11-20 2019-07-29 Training teaching material presenting system and training teaching material presenting method

Related Child Applications (1)

Application Number Title Priority Date Filing Date
CN202310087370.2A Division CN115841777A (en) 2018-11-20 2019-07-29 Training teaching material display system and training teaching material display method

Publications (2)

Publication Number Publication Date
CN112400197A CN112400197A (en) 2021-02-23
CN112400197B true CN112400197B (en) 2023-04-14

Family

ID=70773987

Family Applications (2)

Application Number Title Priority Date Filing Date
CN202310087370.2A Pending CN115841777A (en) 2018-11-20 2019-07-29 Training teaching material display system and training teaching material display method
CN201980045885.8A Active CN112400197B (en) 2018-11-20 2019-07-29 Training teaching material display system and training teaching material display method

Family Applications Before (1)

Application Number Title Priority Date Filing Date
CN202310087370.2A Pending CN115841777A (en) 2018-11-20 2019-07-29 Training teaching material display system and training teaching material display method

Country Status (3)

Country Link
JP (2) JP7014698B2 (en)
CN (2) CN115841777A (en)
WO (1) WO2020105221A1 (en)

Families Citing this family (2)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN113065524A (en) * 2021-04-26 2021-07-02 深圳市商汤科技有限公司 Intelligent workbench management system, intelligent workbench, method, device and medium
CN117745496A (en) * 2024-02-19 2024-03-22 成都运达科技股份有限公司 Intelligent evaluation method, system and storage medium based on mixed reality technology

Family Cites Families (14)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
JPH10293525A (en) * 1996-12-24 1998-11-04 Toko Seiki Kk Intellectual educational training method and system therefor
JP2001318584A (en) 2000-05-11 2001-11-16 Mitsubishi Electric Corp Simulated repairing device and recording medium
JP2002073600A (en) 2000-09-01 2002-03-12 Shimadzu Corp Storage device stored software for guide storage learning
JP2002304112A (en) * 2001-04-06 2002-10-18 Mitsubishi Heavy Ind Ltd Method and device for plant design, and program
WO2002101689A1 (en) 2001-06-08 2002-12-19 Anabasis Software, Llc Software-based system for educational tools
JP2006099558A (en) * 2004-09-30 2006-04-13 Seiko Epson Corp Production navigation system and navigation terminal
JP2006139163A (en) * 2004-11-15 2006-06-01 Osaka Gas Co Ltd Security work training system
US20120270196A1 (en) 2011-04-21 2012-10-25 Applied Computer Education Services, Inc. Systems and methods for virtual wound modules
JP6159217B2 (en) * 2013-10-11 2017-07-05 三菱重工業株式会社 Plant operation training apparatus, control method, program, and plant operation training system
US9911351B2 (en) 2014-02-27 2018-03-06 Microsoft Technology Licensing, Llc Tracking objects during processes
JP6272249B2 (en) * 2015-02-09 2018-01-31 株式会社日立製作所 Assembly navigation system and assembly navigation method
JP6736298B2 (en) 2016-01-25 2020-08-05 キヤノン株式会社 Information processing apparatus, information processing method, and program
CN106157725A (en) * 2016-08-31 2016-11-23 安徽伟合电子科技有限公司 A kind of virtual emulation teaching training system
CN107886453A (en) * 2017-12-26 2018-04-06 广州水镜信息科技有限公司 Education/training management system and education training method

Also Published As

Publication number Publication date
WO2020105221A1 (en) 2020-05-28
JP2020086041A (en) 2020-06-04
JP2022064925A (en) 2022-04-26
CN112400197A (en) 2021-02-23
CN115841777A (en) 2023-03-24
JP7014698B2 (en) 2022-02-01
JP7393445B2 (en) 2023-12-06

Similar Documents

Publication Publication Date Title
Carruth Virtual reality for education and workforce training
Webel et al. An augmented reality training platform for assembly and maintenance skills
Martin et al. A real-time ergonomic monitoring system using the Microsoft Kinect
JP7393445B2 (en) Training material presentation system and training material presentation method
JP5050779B2 (en) Training work curriculum creation device
WO1998052175A2 (en) Machining tool operator training system
CA2476420A1 (en) Interactive computerized performance support system and method
Ruipérez-Valiente et al. Ideating and developing a visualization dashboard to support teachers using educational games in the classroom
Bertrand et al. The effects of presentation method and simulation fidelity on psychomotor education in a bimanual metrology training simulation
KR20170083807A (en) Virtual training system for disassemble and assemble a pipe
Gorobets et al. A VR-based approach in conducting MTM for manual workplaces
Sekaran et al. Haptic-based virtual reality system to enhance actual aerospace composite panel drilling training
JP2020003708A (en) Content presentation system, and content presentation method
Wang et al. Multi-person collaborative augmented reality assembly process evaluation system based on hololens
Ikeda et al. An AR debugging tool for robotics programmers
CN110942519B (en) Computer assembly virtual experiment system and implementation method thereof
US20230169885A1 (en) Virtual integrated machining simulator
Hsieh Lessons learned from remote access 3-D printing machine for manufacturing education
Han et al. An intelligent navigation experimental system based on multi-mode fusion
Budiyanta et al. PD controller computer vision and robotics integration based for student’s programming comprehension improvement
Grandi et al. A training methodology based on virtual reality to promote the learning-by-doing approach
Vahdatikhaki et al. Feedback support system for training of excavator operators
JP7012632B2 (en) Training material presentation system and training material presentation method
Angel et al. Developing an AR Based Tool for Teaching Motion Analysis on Assembly Tasks
Glushkova et al. Gesture Recognition Technologies for Gestural Know-how Management-Preservation and Transmission of Expert Gestures in Wheel Throwing Pottery

Legal Events

Date Code Title Description
PB01 Publication
PB01 Publication
SE01 Entry into force of request for substantive examination
SE01 Entry into force of request for substantive examination
GR01 Patent grant
GR01 Patent grant