JP7034518B1 - Systems, information processing equipment, methods, programs - Google Patents

Abstract

PROBLEM TO BE SOLVED: To carry out more effective vocational training. SOLUTION: A first biological information including at least the amount of sweating of a means for displaying a first image related to vocational training, a means for accepting an operation from a student who takes vocational training, and a student who visually recognizes the first image. It is equipped with a means for acquiring the first value, a means for calculating the first value regarding the stress of the student from the first biometric information, and a means for estimating the characteristics of the student for vocational training and the corresponding work based on the first value. System to do. [Selection diagram] FIG. 8

Description

The present disclosure relates to systems, information processing devices, methods and programs.

The development of technology for analyzing the mental and physical conditions such as the stress level of the subject from the biological information acquired by the sensing device attached to the subject's body is in progress. In Patent Document 1, a biometric information acquisition device having a sensor is used to measure vital signs such as a user's pulse, fever, and sweating, and a stress evaluation value is estimated based on the measured vital signs.

Japanese Unexamined Patent Publication No. 2020-010881

For example, devices such as those mentioned above may be used to manage stress so that employees can work soundly. However, it is not evaluated based on the degree of stress whether the job involved is suitable for oneself.

The purpose of this disclosure is to provide more effective vocational training.

Means for displaying the first image related to vocational training, means for accepting operations from students who take vocational training, and means for acquiring first biometric information including at least the amount of sweating of the students who visually recognize the first image. A system including a means for calculating a first value regarding a student's stress from the first biometric information, and a means for estimating the characteristics of the student for vocational training and corresponding work based on the first value.

According to the present disclosure, more effective vocational training can be carried out.

It is a block diagram which shows the example of the hardware composition of the system 1. It is a block diagram which shows the example of the hardware composition of the main body apparatus 11 shown in FIG. It is a block diagram which shows the structural example of the training apparatus 10 shown in FIG. 1 and FIG. It is a figure which shows the example of the functional configuration of a server 20. It is a figure which shows the data structure of the employee information DB 2021. It is a figure which shows the data structure of the training information DB 2022. It is a figure which shows the data structure of the content information DB 2023. It is a schematic diagram which shows the example of the structure when a worker carries out vocational training using a training device 10. It is a flowchart which shows the example of the operation when the training apparatus 10 shown in FIG. 8 makes a student perform a vocational training. It is a flowchart which shows the example of the operation of the training apparatus 10 during training shown in FIG. It is a schematic diagram which shows the example of the image displayed on the display of the terminal apparatus 30 shown in FIG. It is a flowchart which shows the example of the operation when the server 20 shown in FIG. 8 evaluates the characteristic and the proficiency level of a student. It is a schematic diagram which shows the example of the image displayed on the display of the terminal apparatus 30 shown in FIG. It is a schematic diagram which shows the hand tracking function by a training apparatus 10. It is a schematic diagram which shows the example of the image displayed on the display of the terminal apparatus 30 shown in FIG.

Hereinafter, embodiments of the present disclosure will be described with reference to the drawings. In the following description, the same parts are designated by the same reference numerals. Their names and functions are the same. Therefore, the detailed description of them will not be repeated.

<Summary>
The system according to the present embodiment measures the stress received in the vocational training by the worker who receives the virtual vocational training in real time. The system manages the characteristics of the workers obtained in the vocational training and the proficiency level of the predetermined work. The system determines the work of the worker based on the information to be managed. For example, the system determines the assignment or shift of workers based on the information it manages.

<1 Configuration diagram of the entire system>
FIG. 1 is a block diagram showing an example of the hardware configuration of the system 1. The system 1 shown in FIG. 1 includes, for example, a training device 10, a server 20, and a terminal device 30. The training device 10, the server 20, and the terminal device 30 communicate with each other via, for example, the network 80.

Although FIG. 1 shows an example in which the system 1 includes one training device 10, the number of the training devices 10 included in the system 1 is not limited to one. The number of training devices 10 included in the system 1 may be two or more.

In the present embodiment, an aggregate of a plurality of devices may be used as one server. The method of allocating the plurality of functions required to realize the server 20 according to the present embodiment to one or a plurality of hardware is in view of the processing capacity of each hardware and / or the specifications required for the server 20. Can be determined as appropriate.

The training device 10 shown in FIG. 1 is, for example, a device used by a worker who receives virtual vocational training. The training device 10 includes, for example, a main body device 11, a controller 101, a sweating amount sensor 102, a pulse wave sensor 103, and a temperature sensor 104.

The main body device 11 is a device capable of displaying a VR (Virtual Reality) image related to vocational training. The VR video related to vocational training is a video created by imitating an actual work site. An avatar in the shape of a person is displayed in the VR image, and the image composition is such that the vocational training participants can experience the events in the image as the avatar. The avatar in the VR video walks or performs a predetermined action on the object according to the operation from the student. In the VR video related to vocational training, for example, there are a plurality of vocational training courses according to the type of business or the work (work) content. In the vocational training course, for example, a plurality of missions are set in advance according to the content of the course, and the student operates the avatar to perform the set mission.

The main body device 11 is realized by, for example, an HMD (Head Mount Display). The video related to vocational training is not limited to the VR video, and may be a general two-dimensional video. When vocational training is performed using a general two-dimensional image, the main unit 11 may be, for example, a stationary PC (Personal Computer) or a laptop PC.

The controller 101 is a device that is grasped by a student who wears the main body device 11 to receive vocational training and receives input from the student. The shape of the controller 101 may be any shape. For example, the controller 101 may have a shape in which the controller for the left hand and the controller for the right hand are separated and can be operated by each hand. Further, the controller 101 may have a shape that can be operated with only one hand. Further, the controller 101 may have a shape that can be operated with both hands. For example, the controller 101 may be shaped like a controller for operating a video game, or may be shaped like a handle.

The sweating amount sensor 102 is a sensor that measures the sweating amount of the palm or the finger. The sweating amount sensor 102 is an example of a sensor that acquires biological information. The sweating amount sensor 102 has a structure that can be miniaturized and reduced in price. For example, the sweating amount sensor 102 measures the sweating amount based on the humidity of the space formed including the living body (palm or finger).

Specifically, for example, the sweating amount sensor 102 has a member that forms a space so as to block one surface with a living body, an intake path that supplies air to the space, and an exhaust path that exhausts air from the space. Humidity sensors are provided in the intake path and the exhaust path, respectively. The sweating amount sensor 102 calculates the amount of sweat vaporized from the living body to the space based on the humidity of the air supplied to the space and the humidity of the air exhausted from the space. As a result, the sweating amount sensor 102 acquires the sweating amount.

The sweating amount sensor 102 is provided in the controller 101, for example. For example, a member that forms a space for the sweating amount sensor 102 is provided in the area of the controller 101 that the student holds. As a result, the sweating amount sensor 102 can measure the sweating amount of the student when the student grips and uses the controller 101.

When the controller 101 is separated into a controller for the left hand and a controller for the right hand and has a shape that can be operated by each hand, the sweating amount sensor 102 is provided on, for example, one of the controllers. At this time, it is desirable that the sweating amount sensor 102 is provided on the controller held by the non-dominant hand. The sweating amount sensor 102 is not provided on the controller 101 and may be separately attached to the student.

The pulse wave sensor 103 measures the pulse wave of the student. The pulse wave sensor 103 is an example of a sensor that acquires biometric information. The pulse wave sensor 103 is attached to the student's finger, for example, and measures the pulse wave at a preset cycle. When the sweating amount sensor 102 is independently attached to the student's finger, the pulse wave sensor 103 is attached to, for example, a finger different from the finger to which the sweating amount sensor 102 is attached. The pulse wave sensor 103 may be attached to a device other than the finger as long as the pulse wave can be measured. Further, when the temperature sensor 104 is provided, the pulse wave sensor 103 may not be provided.

The temperature sensor 104 measures the body temperature of the student. The temperature sensor 104 is an example of a sensor that acquires biometric information. The temperature sensor 104 is provided in the controller 101, for example, and measures the body temperature at a preset cycle. The temperature sensor 104 is not provided on the controller 101 and may be separately attached to the student. Further, when the pulse wave sensor 103 is provided, the temperature sensor 104 may not be provided.

FIG. 2 is a block diagram showing an example of the hardware configuration of the main unit 11 shown in FIG. The main unit 11 shown in FIG. 2 includes, for example, a communication IF (Interface) 12, an output device 14, a memory 15, a storage 16, and a processor 19.

The communication IF 12 is for inputting / outputting signals for the training device 10 to communicate with devices in the system 1, such as the server 20, the controller 101, the sweating amount sensor 102, the pulse wave sensor 103, and the temperature sensor 104. It is an interface.

The output device 14 is a device (display, speaker, etc.) for presenting information to the user.

The memory 15 is for temporarily storing a program, data processed by the program, or the like, and is, for example, a volatile memory such as a DRAM (Dynamic Random Access Memory).

The storage 16 is for storing data, and is, for example, a flash memory or an HDD (Hard Disc Drive).

The processor 19 is hardware for executing an instruction set described in a program, and is composed of an arithmetic unit, registers, peripheral circuits, and the like.

The server 20 shown in FIG. 1 manages, for example, information about an employee who is a worker. Specifically, for example, the server 20 manages the characteristics of the employee, the proficiency level of the employee's work, and the like. In this embodiment, employee characteristics include, for example, the following elements:
・ Work that is easy to feel stress
・ Work (work) that you are not good at or are good at
・ Time to be continuously involved in work (work) ・ Aptitude for work (work)

The server 20 is realized by, for example, a computer connected to the network 80. As shown in FIG. 1, the server 20 includes a communication IF 22, an input / output IF 23, a memory 25, a storage 26, and a processor 29.

The communication IF 22 is an interface for inputting / outputting signals for the server 20 to communicate with a device in the system 1 such as the training device 10.

The input / output IF 23 functions as an interface with an input device for receiving an input operation from the user and an output device for presenting information to the user.

The memory 25 is for temporarily storing a program, data processed by the program, or the like, and is, for example, a volatile memory such as a DRAM.

The storage 26 is for storing data, for example, a flash memory or an HDD.

The processor 29 is hardware for executing an instruction set described in a program, and is composed of an arithmetic unit, registers, peripheral circuits, and the like.

The terminal device 30 shown in FIG. 1 is, for example, a terminal used by a vocational training manager or a manager who manages the work of employees. The terminal device 30 is realized by, for example, a stationary PC (Personal Computer), a laptop PC, or the like. Further, the terminal device 30 may be a mobile terminal such as a smartphone or a tablet.

The terminal device 30 receives a request from the administrator and transmits the received request to the server 20. The terminal device 30 receives the information output from the server 20 in response to the request, and presents the received information to the administrator.

<1.1 Configuration of training equipment>
FIG. 3 is a block diagram showing a configuration example of the training device 10 shown in FIGS. 1 and 2. The training device 10 shown in FIG. 3 includes a main body device 11, a controller 101, a sweating amount sensor 102, a pulse wave sensor 103, and a temperature sensor 104. As shown in FIG. 3, the main body device 11 includes a communication unit 120, an output device 14, a voice processing unit 17, a microphone 171 and a speaker 172, a camera 160, a motion sensor 150, a storage unit 180, and a control unit 190. Each block included in the training device 10 is electrically connected by, for example, a bus or the like.

The communication unit 120 performs processing such as modulation / demodulation processing for the training device 10 to communicate with other devices. The communication unit 120 performs transmission processing on the signal generated by the control unit 190, and transmits the signal to the outside (for example, the server 20). The communication unit 120 performs reception processing on the signal received from the outside and outputs the signal to the control unit 190. Although one communication unit 120 is shown in FIG. 3, it does not indicate that one communication standard can be supported by the training device 10. The training device 10 can support a plurality of existing communication standards.

The output device 14 is a device for presenting information to the user who wears the training device 10. The output device 14 is, for example, a display device that displays an image on a display panel 141 such as an organic EL panel located in front of the user by wearing the main body device 11 on his / her head. For example, the image may be viewed stereoscopically by generating a parallax image viewed from the left and right viewpoints and displaying the display screen in the left and right regions divided into two. One image may be displayed on the entire display screen. The display panel 141 displays, for example, an image under the control of the control unit 190.

The voice processing unit 17 performs, for example, digital-to-analog conversion processing of a voice signal. The voice processing unit 17 converts the signal given from the microphone 171 into a digital signal, and gives the converted signal to the control unit 190. Further, the voice processing unit 17 gives a voice signal to the speaker 172. The voice processing unit 17 is realized by, for example, a processor for voice processing. The microphone 171 accepts a voice input and gives a voice signal corresponding to the voice input to the voice processing unit 17. The speaker 172 converts the voice signal given from the voice processing unit 17 into voice and outputs the voice to the outside of the training device 10.

The camera 160 is a device for receiving light by a light receiving element and outputting it as a shooting signal. The camera 160 is installed, for example, at a position where the front of the main body device 11 can be photographed, for example, a position where the wearer's line-of-sight direction can be photographed. The image taken by the camera 160 is used, for example, to read the movement of the user. When the sensor for detecting the movement of the user is provided separately from the main body device 11, the camera 160 may not be provided.

The motion sensor 150 includes an acceleration sensor, an angular velocity sensor, a magnetic sensor, and the like, and detects the movement of the student who wears the main body device 11. For example, the motion sensor 150 detects the acceleration of the trainee who carries out the vocational training by the training device 10. In addition, the motion sensor 150 detects the rotation of the student's head and the change in orientation. The main body device 11 may include a sensor that tracks the position of the main body device 11. By using the output from these sensors, it is possible to identify the movement of the student's head and synchronize it with the student's view in real time.

The storage unit 180 stores data and programs realized by, for example, a memory 15 and a storage 16 and used by the training device 10. The storage unit 180 stores, for example, employee information 181 and training information 182, and content information 183.

Employee information 181 includes, for example, information about an employee as a student using the training device 10. Information about an employee includes, for example, information that identifies the employee, the employee's name, gender, date of joining the company, characteristics of the work content, and proficiency level of the work content. The characteristics of the work content and the proficiency level of the work content are based on, for example, information acquired in vocational training using the training device 10. Information about the employee may further include age, address, date of birth, telephone number, email address and the like.

The training information 182 includes, for example, information acquired in vocational training using the training device 10. Specifically, for example, training information 182 includes the results of vocational training. The result of vocational training is represented by, for example, the degree of achievement of the mission set in the vocational training course. Training information 182 includes, for example, information measured in vocational training. The information measured in the vocational training includes, for example, data on the heart rate, the amount of sweating, the body temperature, etc. measured in the vocational training. The training information 182 includes, for example, a stress value calculated based on the information measured in vocational training.

The content information 183 includes, for example, information about content provided in vocational training using the training device 10, for example, a vocational training course. Information about a vocational training course includes, for example, information that identifies the course, the name of the course, the classification of the course, the corresponding industry, the corresponding work content, and the like.

For example, if the industry is the construction industry, the vocational training course is a "pre-start preparation course" for training pre-start work preparation and a "pre-start inspection" for training on-site inspections before start. Includes "Course", "Slope Work Course" for training on slope work, "High Height Scaffolding Work Course" for training on high altitude scaffolding, etc.

The control unit 190 is realized by the processor 19 reading a program stored in the storage unit 180 and executing an instruction included in the program. The control unit 190 controls the operation of the training device 10. By operating according to the program, the control unit 190 exhibits functions as an operation reception unit 191, a transmission / reception unit 192, and a training control unit 193.

The operation reception unit 191 performs a process for receiving an operation input from the controller 101. The instructions input via the controller 101 or the like are, for example, as follows.
・ Contents of vocational training, for example, selection of vocational training course ・ Input of predetermined movements during vocational training

Further, the operation reception unit 191 receives a voice instruction input from the microphone 171. Specifically, for example, the operation reception unit 191 receives an audio signal input from the microphone 171 and converted into a digital signal by the audio processing unit 17. The operation reception unit 191 acquires an instruction from the user, for example, by analyzing the received audio signal and extracting a predetermined noun.

The transmission / reception unit 192 performs a process for the training device 10 to transmit / receive data to / from an external device such as a server 20 according to a communication protocol. Specifically, for example, the transmission / reception unit 192 receives the measurement data measured by the sweating amount sensor 102, the pulse wave sensor 103, and the temperature sensor 104 during vocational training. The transmission / reception unit 192 transmits the acquired measurement data and the stress value calculated from the measurement data to the server 20. Further, the transmission / reception unit 192 receives information about the students who receive the vocational training from the server 20.

The training control unit 193 performs a process for the worker to receive virtual vocational training. Specifically, for example, the training control unit 193 calibrates the students before starting the vocational training. Calibration is a process for comparing the student's condition with the measured value of each sensor. The image displayed in the calibration is, for example, an example of a second image in which a predetermined stress value is assumed.

The training control unit 193 displays, for example, an image in which the student is expected to be extremely nervous in calibration, and is based on the measured values of the sweating amount sensor 102, the pulse wave sensor 103, and the temperature sensor 104 at that time. The stress value calculated by the above is taken as the maximum value of the student's stress value. At this time, the biological information obtained by the sweating amount sensor 102, the pulse wave sensor 103, and the temperature sensor 104 is, for example, an example of the second biological information. Further, the stress value calculated at this time is, for example, an example of a second value related to stress.

Further, the training control unit 193 displays, for example, an image in which the student is expected to relax in the calibration, and is based on the measured values of the sweating amount sensor 102, the pulse wave sensor 103, and the temperature sensor 104 at that time. The stress value calculated by the above is set as the minimum value of the stress value of the student. At this time, the biological information obtained by the sweating amount sensor 102, the pulse wave sensor 103, and the temperature sensor 104 is, for example, an example of the second biological information. Further, the stress value calculated at this time is, for example, an example of a second value related to stress.

Further, the training control unit 193 makes the student perform a simple exercise, for example, in calibration. In the calibration, the image displayed for the student to perform a simple exercise is, for example, an example of a third image for causing a moderate exercise. The training control unit 193 determines whether or not the student has a constitution that makes it easy to sweat, based on the measured value of the sweating amount sensor 102 at that time. The biometric information obtained by the sweating amount sensor 102 at this time is, for example, an example of the third biometric information.

When the calibration is completed, the training control unit 193 displays a video related to the vocational training on the display panel 141 of the output device 14. The video regarding vocational training here is an example of the first image regarding vocational training. The training control unit 193 displays an avatar that the student can operate via the controller 101 in the video related to the vocational training. The training control unit 193 moves the avatar according to the operation input from the controller 101. The training control unit 193 stores the image during vocational training in the storage unit 180. The training control unit 193 calculates, for example, the degree of achievement of vocational training according to the number of students who have solved the tasks set in the vocational training.

During vocational training, the training control unit 193 controls, for example, the sweating amount sensor 102, the pulse wave sensor 103, and the temperature sensor 104 so as to measure the value at a predetermined cycle. The training control unit 193 acquires the information measured by the sweating amount sensor 102, the pulse wave sensor 103, and the temperature sensor 104. The training control unit 193 corrects the acquired information based on the information obtained by the calibration. The training control unit 193 calculates the stress value based on the corrected information, for example. The training control unit 193 calculates the stress value using, for example, the amount of sweating, the pulse rate, and the body temperature. Specifically, for example, the training control unit 193 calculates the stress value by multiplying the sweating amount, the pulse rate, and the body temperature by predetermined coefficients and adding the values obtained by multiplying the coefficients. At this time, the biological information obtained by the sweating amount sensor 102, the pulse wave sensor 103, and the temperature sensor 104 is, for example, an example of the first biological information. Further, the stress value calculated at this time is, for example, an example of the first value related to stress.

The training control unit 193 may calculate the stress value using, for example, the amount of sweating and the pulse rate. Further, the training control unit 193 may calculate the stress value using, for example, the amount of sweating and the body temperature. Further, the stress value may be calculated by the server 20.

<1.2 Functional configuration of the server>
FIG. 4 is a diagram showing an example of a functional configuration of the server 20. As shown in FIG. 4, the server 20 functions as a communication unit 201, a storage unit 202, and a control unit 203.

The communication unit 201 performs a process for the server 20 to communicate with an external device.

The storage unit 202 has, for example, an employee information database (DB) 2021, a training information database (DB) 2022, a content information database (DB) 2023, a shift information database (DB) 2024, and the like.

The employee information DB 2021 is, for example, a database for holding information about employees. Details will be described later.

The training information DB 2022 is, for example, a database for holding information acquired in vocational training using the training device 10. The information acquired in the vocational training includes, for example, the result of the vocational training, the information measured in the vocational training, the stress value calculated from the measured information, and the like. Details will be described later.

The content information DB 2023 is, for example, a database for holding information about the content provided in the vocational training using the training device 10, for example, the vocational training course. Details will be described later.

The shift information DB 2024 is a database for holding information about a worker's schedule to work.

The control unit 203 is realized by the processor 29 reading the program stored in the storage unit 202 and executing the instruction included in the program. By operating according to the program, the control unit 203 exerts the functions shown as the reception control module 2031, the transmission control module 2032, the analysis module 2033, the assignment determination module 2034, the shift setting module 2035, and the presentation module 2036.

The reception control module 2031 controls a process in which the server 20 receives a signal from an external device according to a communication protocol. Specifically, for example, the reception control module 2031 receives the information measured by the training device 10 and the stress value calculated based on the measured information transmitted from the training device 10.

The transmission control module 2032 controls a process in which the server 20 transmits a signal to an external device according to a communication protocol.

The analysis module 2033 analyzes the information acquired in the vocational training by the training device 10 and estimates the characteristics of the students who have taken the vocational training. In addition, the analysis module 2033 analyzes the information acquired in the vocational training and estimates the proficiency level of the students in the vocational training and the corresponding work.

Specifically, for example, the analysis module 2033 calculates an index value of a stress value for a predetermined work content based on the calculated stress value when the vocational training course is completed. For example, the analysis module 2033 calculates the average stress value and the maximum stress value for a predetermined work content based on the calculated stress value. The vocational training course and the business content of a predetermined industry are associated with each other as follows, for example.
・ One vocational training course is associated with one job content of a predetermined industry ・ Multiple vocational training courses are associated with one job content of a predetermined industry ・ Vocational training course Elements that represent the characteristics of are set, and each element is associated with the background required for the business content of a given industry.

The analysis module 2033 estimates the suitability for the type of business and the business content based on, for example, the information acquired in the vocational training. That is, the analysis module 2033 estimates whether there is a work (work) that the employee is likely to feel stressed, and whether there is a work (work) that he / she is not good at or is good at.

The analysis module 2033 may estimate the aptitude in any way. For example, the analysis module 2033 collates the result of the vocational training course and the index value of the stress value acquired by taking the vocational training course with a preset look-up table, and estimates the aptitude. Further, for example, the analysis module 2033 has been trained to output the aptitude of the result of the vocational training course and the index value of the stress value acquired by taking the vocational training course based on the result and the index value. Aptitude may be obtained by inputting to the model.

In addition, the analysis module 2033 may acquire aptitude from the results and index values acquired based on the vocational training course taken this time. For example, when the result is good and the difference between the average stress value and the maximum stress value is small, the analysis module 2033 evaluates that the employee has high aptitude for a predetermined work content. On the other hand, the analysis module 2033 evaluates that, for example, when the result is not preferable and the difference between the average stress value and the maximum stress value is large, the employee is not suitable for a predetermined work content.

Further, the analysis module 2033 may acquire aptitude based on the transition of the result of the vocational training course taken in the past and the transition of the index value calculated in the vocational training course taken in the past. In the analysis module 2033, for example, when the result becomes better as the number of attendances increases and the difference between the average stress value and the maximum stress value becomes smaller, the employee is highly suitable for a predetermined work content. Evaluate as. On the other hand, in the analysis module 2033, for example, when the result does not improve even if the number of attendances increases and the difference between the average stress value and the maximum stress value remains high, the employee concerned with respect to the predetermined work content. It is evaluated that the suitability of is low. The analysis module 2033 may express the aptitude by a rank in alphabet or the like, or may express it by a score.

The information referenced by the analysis module 2033 is not limited to the above. For example, the analysis module 2033 presets a predetermined threshold value for the stress value. The analysis module 2033 may also refer to the time when the calculated stress value was the threshold value, the number of times the threshold value was exceeded, and the like.

The analysis module 2033 calculates the time during which employees are continuously engaged in work, that is, the recommended working time, according to the evaluated aptitude. The analysis module 2033 may evaluate the recommended working time in any way. For example, the analysis module 2033 may collate the evaluated aptitude with a preset look-up table to obtain the recommended working time. Further, for example, the analysis module 2033 may acquire the recommended working time by inputting the evaluated aptitude into a trained model trained to output the recommended working time based on the aptitude. The analysis module 2033 is set, for example, to lengthen the recommended work time for employees with high aptitude and to shorten the recommended work time for employees with low aptitude.

The analysis module 2033 estimates the proficiency level based on the information acquired in the vocational training, for example. The analysis module 2033 may estimate the proficiency level in any way. Specifically, for example, the analysis module 2033 inputs the transition of the result of the vocational training course taken in the past and the transition of the index value calculated in the vocational training course taken in the past into a predetermined function. The proficiency level may be calculated.

Further, for example, the analysis module 2033 inputs the transition of the result of the vocational training course taken in the past and the transition of the index value of the stress value calculated in the vocational training course taken in the past into the trained model. , You may acquire proficiency level. At this time, the trained model is trained to output the proficiency level based on, for example, the transition of the result of the vocational training course and the transition of the index value of the stress value calculated in the vocational training course. The analysis module 2033 may express the proficiency level by a rank in alphabet or the like, or may express it by a score.

The assignment determination module 2034 determines the assignment destination of the employee based on the employee information shown in the employee information DB 2021. Specifically, for example, when the terminal device 30 requests the assignment determination module 2034 to present the assignment destination of the designated employee together with the designation of the employee, the assignment determination module 2034 assigns the designated employee to the employee. It is determined based on the proficiency level and the characteristics of the employee shown in the member information DB 2021.

The assignment determination module 2034 may determine the assignment destination in any way. For example, the control unit 203 may collate the proficiency level and the characteristics of the employee with a preset look-up table to determine the assignment destination. Further, for example, the assignment determination module 2034 may determine the assignment destination by inputting the proficiency level and the characteristics of the employee into the trained model. At this time, the trained model is trained to output the assignment destination based on, for example, the proficiency level and the characteristics of the employee. The assignment determination module 2034 may propose an industry and business content suitable for employees based on the information stored in the employee information DB 2021.

The shift setting module 2035 determines the shift of the employee based on the employee information shown in the employee information DB 2021. When the assignment determination module 2034 receives a designation of a predetermined day or a predetermined period from the terminal device 30, for example, the employee's work schedule for the specified date or period is shown in the employee information DB 2021. Determined based on working hours.

The presentation module 2036 presents the information managed by the server 20 to the administrator via the terminal device 30. Further, the presentation module 2036 presents, for example, real-time information about the vocational training being carried out to the manager via the terminal device 30.

<2 data structure>
5 to 7 are diagrams showing the data structure of the database stored in the server 20. It should be noted that FIGS. 5 to 7 are examples, and data not described is not excluded.

FIG. 5 is a diagram showing a data structure of the employee information DB 2021. As shown in FIG. 5, each of the records of the employee information DB 2021 has, for example, an item "employee ID", an item "employee name", an item "gender", and an item "date of joining the company". Item "affiliation", item "business content", item "average stress value", item "maximum stress value", item "proficiency level", item "aptitude", item "recommended work time" include.

The item "employee ID" indicates information for identifying an employee.

The item "employee name" indicates the name of the employee.

The item "Gender" indicates the gender of the employee.

The item "Date of joining the company" indicates the date of joining the company.

The item "affiliation" indicates the affiliation of the employee.

The item "business content" indicates the content of the business whose proficiency level and characteristics have been evaluated by vocational training. In the item "business content", for example, a plurality of operations are stored for each employee. In the example shown in FIG. 5, there is no description about the type of business, but for example, the business is linked to the type of business.

The item "average stress value" and the item "maximum stress value" indicate values as an example of index values for stress values. In the item "mean stress value", for example, the average value of the stress value calculated based on the information measured in the vocational training course corresponding to the work content is stored. In the item "maximum stress value", for example, the maximum stress value calculated based on the information measured in the vocational training course corresponding to the work content is stored.

The item "proficiency level" indicates the degree of proficiency of the employee in the corresponding work. The item "proficiency" is evaluated based on vocational training. Specifically, the item "proficiency level" is evaluated based on, for example, an index value calculated based on vocational training and the result of vocational training.

The item "aptitude" indicates the degree of suitability of an employee for the relevant work. The item "aptitude" is evaluated based on vocational training. Specifically, the item "aptitude" is evaluated based on, for example, an index value calculated based on vocational training and the result of vocational training.

The item "Recommended working time" indicates the time during which an employee is continuously engaged in work. The item "recommended working time" is calculated based on, for example, the item "aptitude".

For the item "average stress value", item "maximum stress value", item "proficiency level", item "aptitude", and item "recommended work time", the values acquired in the past are stored for each work content. May be good.

FIG. 6 is a diagram showing a data structure of the training information DB 2022. As shown in FIG. 6, each of the records of the training information DB 2022 has, for example, the item "employee ID", the item "training date", the item "training ID", the item "Time", and the item "heart rate". , The item "sweat amount", the item "body temperature", the item "stress value", and the item "achievement degree".

The item "employee ID" indicates information for identifying an employee.

The item "training date" indicates the date on which the vocational training was conducted.

The item "training ID" indicates information for identifying the vocational training taken. Specifically, the item "training ID" indicates, for example, information for identifying the vocational training course taken.

The item "Time" indicates the elapsed time since the start of vocational training. Specifically, the item "Time" indicates, for example, the elapsed time since the start of the vocational training course selected by the student.

The item “heart rate” indicates a value measured by the pulse wave sensor 103 during vocational training.

The item “sweat amount” indicates a value measured by the sweat amount sensor 102 during vocational training.

The item "body temperature" indicates a value measured by the temperature sensor 104 during vocational training.

The item "stress value" indicates a value indicating the degree of stress, which is calculated based on the measured value.

The item "Achievement" indicates how well the requirements imposed by vocational training were met. The item "achievement level" is evaluated according to, for example, how well the mission set in the vocational training course has been completed. The item "achievement degree" may be expressed by a rank in alphabet or the like, or may be expressed by a score.

FIG. 7 is a diagram showing a data structure of the content information DB 2023. As shown in FIG. 7, each of the records of the content information DB 2023 has an item "training ID", an item "training name", an item "classification", an item "industry", an item "business content", and an item. Includes "mission".

The item "training ID" indicates information for identifying vocational training.

The item "training name" indicates the name of vocational training. Specifically, the item "training name" indicates, for example, the name of a vocational training course.

The item "classification" indicates the classification to which the vocational training belongs. Specifically, the item "classification" indicates, for example, the classification to which the vocational training course belongs. For example, the type of business associated with each category and the business content may be set.

The item "industry" indicates the industry to which vocational training is associated. Specifically, the item "industry" indicates, for example, the industry to which the vocational training course is associated.

The item "business content" indicates the business content to which vocational training is associated. Specifically, the item "business content" indicates, for example, the business content to which the vocational training course is associated.

The item "Mission" indicates the mission set for vocational training. Specifically, the item "mission" indicates, for example, a mission set in a vocational training course. For example, a plurality of missions are set for each vocational training course.

<3 operation>
The operation of the training device 10 and the server 20 will be described.

FIG. 8 is a schematic diagram showing an example of a configuration when a worker carries out vocational training using the training device 10. In the following description, as shown in FIG. 8, a case where the training device 10 has a sweating amount sensor 102, a pulse wave sensor 103, and a temperature sensor 104 will be described. In addition, the main body device 11 displays a VR image related to vocational training. The training device 10 stores the first to third courses as vocational training. The first to third courses are associated with, for example, one business content of a predetermined industry.

(Vocational training with training device 10)
FIG. 9 is a flowchart showing an example of the operation of the training device 10 shown in FIG. 8 when the trainee is made to carry out vocational training.

First, the student wears the main body device 11 on his / her head. The student holds the controller 101 in both hands, for example. At this time, the controller 101 gripped by a non-dominant hand is provided with a sweating amount sensor 102 and a temperature sensor 104. Further, the pulse wave sensor 103 is attached to the non-dominant hand. When the student is ready for the vocational training, the student inputs an instruction to start the vocational training from, for example, the controller 101.

In step S11, the control unit 190 of the training device 10 compares the state of the student with the measured value of each sensor by performing calibration. Specifically, the control unit 190 displays, for example, an image in which the trainee is expected to be extremely nervous by the training control unit 193. The video on which the student is expected to be extremely nervous is, for example, a video in which he / she feels fear, for example, a video located at a high place, a video of an accident, or the like. The training control unit 193 acquires the measured values of the sweating amount sensor 102, the pulse wave sensor 103, and the temperature sensor 104 at that time, and calculates the stress value based on the acquired measured values. The training control unit 193 sets the calculated stress value as the maximum value of the stress value of the student.

The training control unit 193 displays, for example, an image in which the student is expected to relax. The images that the students are expected to relax are, for example, images of a quiet forest or a calm sea. The training control unit 193 acquires the measured values of the sweating amount sensor 102, the pulse wave sensor 103, and the temperature sensor 104 at that time, and calculates the stress value based on the acquired measured values. The training control unit 193 sets the calculated stress value as the minimum value of the stress value of the student.

The training control unit 193 displays, for example, an image for making a student perform a simple exercise. The training control unit 193 acquires the tendency of the sweating amount of the trainee based on the measured value of the temperature sensor 104 at that time.

In step S12, the control unit 190 starts vocational training. For example, the training control unit 193 displays the selection screens of the first to third courses and accepts the selection of the course from the students. When the vocational training course is selected by the student, the training control unit 193 causes the main unit 11 to display a VR image related to the selected vocational training course.

FIG. 10 is a flowchart showing an example of the operation of the training device 10 during training shown in FIG. In the training shown in FIG. 10, the control unit 190 receives the operation of the avatar in the VR image to be displayed on the display panel 141.

In step S121, the control unit 190 acquires the measurement data measured by the sweating amount sensor 102, the pulse wave sensor 103, and the temperature sensor 104 worn on the student by the transmission / reception unit 192 at a predetermined cycle. The control unit 190 corrects the measurement data regarding the sweating amount acquired by the training control unit 193 based on the tendency of the sweating amount of the student obtained by the calibration.

In step S122, the training control unit 193 calculates the stress value based on, for example, the corrected information. Specifically, for example, the training control unit 193 calculates the stress value based on the pulse wave measured by the pulse wave sensor 103, the body temperature measured by the temperature sensor 104, and the corrected sweating amount. The training control unit 193 standardizes the calculated stress value based on, for example, the minimum value and the maximum value of the stress value obtained by the calibration. The training control unit 193 stores the acquired pulse wave, body temperature, corrected sweating amount, and standardized stress value in the training information 182. The control unit 190 transmits the acquired pulse wave, body temperature, corrected sweat amount, and standardized stress value to the server 20 by the transmission / reception unit 192.

The server 20 stores the data received from the training device 10 in the training information DB 2022.

In step S123, the control unit 190 determines whether or not the vocational training course has been completed by the training control unit 193. If not completed, the training control unit 193 repeats the processes of steps S121 to S123. When finished, the process proceeds to step S124.

In step S124, the control unit 190 imparts a degree of achievement according to the mission solved in the vocational training course, for example, by the training control unit 193. The training control unit 193 stores the assigned achievement level in the training information 182. The control unit 190 transmits the assigned achievement level to the server 20 by the transmission / reception unit 192, and ends the processing for the vocational training course.

The server 20 stores the data received from the training device 10 in the training information DB 2022.

For example, in step S12 shown in FIG. 9, when the next vocational training course is selected by the student, the control unit 190 executes the process shown in FIG. 10 for the selected vocational training course.

The terminal device 30 shown in FIG. 8 accesses the training device 10 or the server 20 in response to an instruction from the administrator who operates the terminal device 30. The terminal device 30 causes the display of the terminal device 30 to display the state of the vocational training being carried out in response to the instruction from the manager. For example, on the display of the terminal device 30, the vocational training being carried out is selectively displayed. When the vocational training is selected by the administrator, the terminal device 30 requests the server 20 for information about the selected vocational training, for example, a VR image during training, a sweating amount, a pulse wave, a body temperature, and a stress value. The terminal device 30 may request the training device 10 to provide information about the selected vocational training.

The training device 10 or the server 20 in which the information about the vocational training is requested from the terminal device 30 transmits the requested information to the terminal device 30. The terminal device 30 receives the information and displays an image based on the received information on the display.

FIG. 11 is a schematic diagram showing an example of an image displayed on the display of the terminal device 30 shown in FIG. The images shown in FIG. 11 include a VR play image 31 displayed to the student, a chart 32 showing the transition of the sweating amount, a chart 33 showing the transition of the heart rate, and a chart 34 showing the transition of the stress value. A display area 35 representing the current measured value is displayed. The manager who operates the terminal device 30 visually recognizes the image displayed on the display of the terminal device 30 and confirms the state of the vocational training.

It is possible to hide at least one of the VR play video 31, the charts 33 to 34, and the display area 35 according to the instruction from the administrator. This enables the manager to check the state of vocational training by focusing on the information that he / she wants to see.

(Evaluation of student characteristics and proficiency level by server 20)
FIG. 12 is a flowchart showing an example of the operation of the server 20 shown in FIG. 8 when evaluating the characteristics and proficiency of the students. The control unit 203 executes the process shown in FIG. 8 in the following cases, for example.
・ When notified that the vocational training for the students has been completed ・ When the administrator who operates the terminal device 30 requests the evaluation of the characteristics and proficiency of the predetermined students ・ The predetermined cycle ・When the specified time is reached

In step S13, the control unit 203 calculates an index value of a stress value for a predetermined work content. Specifically, for example, the control unit 203 refers to the training information DB 2022 by the analysis module 2033, and based on the stress value calculated while taking the first to third courses, the first to third Calculate the average stress value and the maximum stress value for the work content associated with the course. The analysis module 2033 stores the calculated average stress value and the maximum stress value in the employee information DB 2021.

In step S14, the control unit 203 estimates the aptitude and proficiency level for a predetermined work content. Specifically, for example, the control unit 203 refers to the training information DB 2022 by the analysis module 2033, and describes the achievement level of the first to third courses and the business contents associated with the first to third courses. The calculated average stress value and maximum stress value are collated with a preset look-up table, and the aptitude is acquired. Further, for example, the analysis module 2033 uses a trained model of the achievement level of the first to third courses and the average stress value and the maximum stress value calculated for the work contents associated with the first to third courses. You may acquire aptitude by inputting in. The analysis module 2033 stores the evaluated aptitude in the employee information DB 2021.

In the analysis module 2033, the transition of the achievement level of the first to third courses from the past, and the transition of the average stress value and the maximum stress value calculated for the work contents associated with the first to third courses from the past. You may acquire aptitude based on.

Further, the analysis module 2033 has, for example, the transition of the achievement level of the first to third courses from the past, and the average stress value and the maximum stress value calculated for the work contents associated with the first to third courses. The proficiency level is calculated by inputting the transition from the past into a predetermined function. Further, for example, the analysis module 2033 determines the transition of the achievement level of the first to third courses from the past, and the average stress value and the maximum stress value calculated for the work contents associated with the first to third courses. You may acquire the proficiency level by inputting the transition from the past into the trained model. The analysis module 2033 stores the evaluated proficiency level in the employee information DB 2021.

In step S15, the control unit 203 calculates the recommended work time for the predetermined work content according to the evaluated aptitude. Specifically, for example, the control unit 203 collates the evaluated aptitude with the preset lookup table from the analysis module 2033, and acquires the recommended working time. Further, for example, the analysis module 2033 may acquire the recommended working time by inputting the estimated aptitude into the trained model. The analysis module 2033 stores the acquired recommended work time in the employee information DB 2021 and ends the process.

The terminal device 30 shown in FIG. 8 accesses the server 20 in response to an instruction from the administrator who operates the terminal device 30. The terminal device 30 causes the display of the terminal device 30 to display information on the characteristics and proficiency of the employee in response to an instruction from the manager.

FIG. 13 is a schematic diagram showing an example of an image displayed on the display of the terminal device 30 shown in FIG. In the image shown in FIG. 13, a table 300 showing information about the employee is displayed. The manager who operates the terminal device 30 visually recognizes the image displayed on the display of the terminal device 30 and confirms the information about the employee.

(Decision of employee assignment by server 20)
The server 20 determines the assignment destination of employees in response to a request from an administrator who uses the terminal device 30. Specifically, for example, the administrator operates the terminal device 30, designates a predetermined employee while referring to the screen shown in FIG. 13, and proposes the assignment destination of the designated employee to the server. Request to 20. The control unit 203 receives an instruction to specify an employee from the terminal device 30 by the reception control module 2031. Further, the reception control module 2031 receives a request for presenting the assignment destination of the employee from the terminal device 30. The assignment determination module 2034 determines the assignment destination of the designated employee based on the employee information DB 2021.

For example, the assignment determination module 2034 collates the average stress value, the maximum stress value, the proficiency level, and the aptitude acquired for each work content with a preset look-up table, and assigns the specified employee. To determine. Further, for example, the assignment determination module 2034 may determine the assignment destination by inputting the average stress value, the maximum stress value, the proficiency level, and the aptitude acquired for each work content into the trained model. ..

The presentation module 2036 transmits information about the determined assignment destination to the terminal device 30 and displays it on the display of the terminal device 30.

(Decision of employee shift by server 20)
The server 20 determines the shift of employees in response to a request from the administrator who uses the terminal device 30. Specifically, for example, the manager operates the terminal device 30 and specifies a day or a period during which it is necessary to determine a person to work for a predetermined business. The administrator, for example, specifies an employee who can work and requests the server 20 to propose a shift of the employee.

The control unit 203 receives an instruction for designating the business content from the terminal device 30 by the reception control module 2031. Further, the reception control module 2031 receives an instruction for designating a predetermined day or a predetermined period from the terminal device 30. Further, the reception control module 2031 receives an instruction for designating an employee from the terminal device 30. Further, the reception control module 2031 receives a request for presenting the shift of the employee from the terminal device 30. The shift setting module 2035 sets the shift of the employee on the specified day or period based on the employee information DB 2021.

For example, the shift setting module 2035 sets the employee's work schedule for the specified work content based on the recommended work time. The assignment determination module 2034 sets the work schedule of the employee by filling the work frame of the employee based on the recommended working time.

The presentation module 2036 transmits the set information regarding the shift of the employee to the terminal device 30, and displays the information on the display of the terminal device 30.

As described above, in the above embodiment, the main body device 11 displays the first image related to the vocational training on the display panel 141. The main body device 11 receives an operation from a student who takes vocational training via the controller 101. The main body device 11 acquires the first biological information including at least the sweating amount of the student who visually recognizes the first image, which is measured by the sweating amount sensor 102, the pulse wave sensor 103, and the temperature sensor 104. The main body device 11 calculates the first value regarding the stress of the student from the first biometric information. The server 20 estimates the characteristics of the student regarding the vocational training and the corresponding work based on the first value. This makes it possible to grasp from vocational training which work the employee feels stressful and which work is not good at it.

Currently, in a predetermined industry, there are various problems such as diversification of work and operation, increase in price and complexity of machines used in the work, or diversification of skill level of workers. In such an environment, vocational training using VR video can handle various situations, it is not necessary to prepare an actual work machine, and it is possible to take it repeatedly according to the proficiency level. There are merits such as being there and not causing an accident. By using vocational training using VR video, it is possible to improve the ability of workers and reduce human error during work while reducing the cost of training workers. Further, according to the vocational training using the training device 10 according to the present embodiment, it becomes clear which work the employee feels stressful and which work is not good, so that appropriate staffing is possible. In addition, it is possible to efficiently train workers. Therefore, more effective vocational training can be carried out.

Further, in the above embodiment, the main body device 11 displays a second image in which a predetermined stress is assumed in the calibration. The main body device 11 acquires the second biological information including at least the sweating amount of the student who visually recognizes the second image, which is measured by the sweating amount sensor 102, the pulse wave sensor 103, and the temperature sensor 104. The main body device 11 calculates the minimum value and the maximum value of the stress value based on the second biological information. The main body device 11 calculates the first value from the first biological information and the minimum and maximum values of the stress value. This enables accurate measurement based on the state of the student at the time of the course. That is, it is possible to calculate the stress value with high accuracy.

Further, in the above embodiment, the main body device 11 displays a third image for exercising an appropriate amount in the calibration. The main body device 11 acquires the third biological information including at least the sweating amount of the student who visually recognizes the third image, which is measured by the sweating amount sensor 102, the pulse wave sensor 103, and the temperature sensor 104. The main body device 11 corrects the first biometric information based on the third biometric information. As a result, the training device 10 can accurately calculate the stress value even when the amount of sweating differs depending on the constitution of the trainee.

Further, in the above embodiment, the main body device 11 evaluates the achievement level of the vocational training when the vocational training is completed. The server 20 estimates the characteristics based on the first value and the degree of achievement. This allows the server 20 to more accurately estimate the characteristics of the student.

Further, in the above embodiment, the main body device 11 displays a VR image. As a result, the sense of presence of vocational training is improved, and it becomes possible to calculate the stress value more accurately.

Further, in the above embodiment, the sweating amount sensor 102 is a sensor that measures the humidity of the space formed including a part of the student's body. More specifically, the sweating amount sensor 102 has a humidity sensor installed in a first path for supplying air to the space, a second path for discharging air from the space, a first path, and a second path. As a result, a sweating amount sensor that is small in size, inexpensive, and capable of measuring the amount of sweating with high accuracy is realized, and therefore, when the sweating amount sensor 102 is used in vocational training, the burden of wearing is reduced.

Further, in the above embodiment, the sweating amount sensor 102 is provided on the grip portion of the controller 101. As a result, the amount of sweating is measured when operating using the controller 101, so that the burden on the student can be suppressed.

Further, in the above embodiment, the server 20 estimates the aptitude of the trainee for the vocational training and the corresponding work based on the first value. As a result, the server 20 can clarify the work that the student is good at and the work that the student is not good at.

Further, in the above embodiment, the time during which the student is continuously engaged in the work is calculated based on the aptitude. As a result, the server 20 can quantitatively represent how much time the student is engaged in the work.

Further, in the above embodiment, the server 20 estimates the aptitude based on the first value calculated in the vocational training taken in the past and the first value calculated in the vocational training this time. This makes it possible to estimate the aptitude more accurately.

Further, in the above embodiment, the server 20 estimates the proficiency level of the trainees regarding the vocational training and the corresponding work based on the first value and the achievement level. This makes it possible to quantitatively express how much skill the student has.

Further, in the above embodiment, the server 20 determines the proficiency level based on the first value and achievement level calculated in the vocational training taken in the past and the first value and achievement level calculated in the current vocational training. presume. This makes it possible to estimate the proficiency level more accurately.

Further, in the above embodiment, the server 20 determines the assignment of the student based on the characteristics of the student. As a result, the server 20 can be appropriately assigned according to the students.

Further, in the above embodiment, the server 20 determines at least one of the work schedules of the plurality of students based on the calculated time for the plurality of students who have taken the vocational training. This allows the server 20 to make shifts in an appropriate arrangement. In addition, the server 20 can reduce the labor of the administrator when forming a shift.

Further, in the above embodiment, the server 20 proposes to take vocational training based on the characteristics of the students. As a result, the students can efficiently take vocational training.

Further, in the above embodiment, the server 20 proposes to take vocational training based on the proficiency level of the students. This enables students to efficiently repeat vocational training until they acquire the skills.

Further, in the above embodiment, the server 20 determines that it is not necessary to take vocational training based on the proficiency level and characteristics of the students. As a result, the server 20 can reduce unnecessary attendance of vocational training.

<4 Modification example>
(Operation using hand tracking)
In the above embodiment, an example in which the student operates the avatar in the VR image by the controller 101 has been described. However, the operation of the avatar is not limited to that by the controller 101. When the training device 10 has a hand tracking function, the student may operate the avatar by moving his / her hand.

FIG. 14 is a schematic diagram showing a hand tracking function by the training device 10. In the example shown in FIG. 14, the training device 10 acquires the movement of the student's hand by photographing the student's hand with the camera 160 installed in the main body device 11. The training device 10 expresses, for example, the movement of the student's hand as the movement of the avatar's hand in the VR image. Further, the training device 10 moves the avatar according to the movement of the student's hand.

The hands to be subject to hand tracking may be both hands of the student or one hand. If the training device 10 tracks the movement of one hand, the controller 101 may be held in the other hand. When the controller 101 is held by the other hand, the training device 10 may accept an input by hand tracking and an input by the controller 101.

In the above embodiment, the sweating amount sensor 102 and the temperature sensor 104 are mounted on the controller 101, for example. If both hands of the student are subject to hand tracking, the student cannot grasp the controller 101. Therefore, when both hands of the student are subject to hand tracking, the sweating amount sensor 102 and the temperature sensor 104 are separately attached to the student.

(Acquisition of employee characteristics and proficiency by hand tracking)
In the above embodiment, the proficiency level and the characteristics of the employee are acquired based on the sweating amount measured by the sweating amount sensor 102, the pulse wave measured by the pulse wave sensor 103, and the body temperature measured by the temperature sensor 104. An example was explained. However, proficiency and employee characteristics may be acquired based on the results of hand tracking.

For example, the control unit 190 of the training device 10 calculates the stress value based on the information on the hand movement obtained by the hand tracking. Specifically, for example, the control unit 190 compares the information regarding the movement of the student's hand with the pre-stored ideal movement of the hand. The control unit 190 detects, for example, the tremor of the hand and the finger, the moving speed of the hand, the position of the hand and the finger, and the like from the information about the movement of the hand, and calculates the stress value based on the difference from the ideal movement. .. The control unit 190 may calculate the stress value from the characteristics of the student's hand movement, regardless of the comparison with the ideal movement. At this time, the image related to vocational training may be, for example, an image related to vocational training related to medical treatment.

The control unit 203 of the server 20 analyzes the information acquired in the vocational training by the training device 10 and acquires the characteristics of the students who have taken the vocational training. In addition, the control unit 203 analyzes the information acquired in the vocational training and acquires the proficiency level of the trainees regarding the vocational training and the corresponding work.

Specific operations of the training device 10 are as follows, for example.

The control unit 190 of the training device 10 first performs calibration to compare the state of the trainee with the movement of the hand. Specifically, the control unit 190 displays, for example, an image in which the trainee is expected to be extremely nervous by the training control unit 193. The training control unit 193 acquires information on the movement of the hand at that time, and calculates a stress value based on the acquired information. The training control unit 193 sets the calculated stress value as the maximum value of the stress value of the student.

The training control unit 193 displays, for example, an image in which the student is expected to relax. The training control unit 193 acquires information on the movement of the hand at that time, and calculates a stress value based on the acquired information. The training control unit 193 sets the calculated stress value as the minimum value of the stress value of the student.

The training control unit 193 displays, for example, an image for making a student perform a simple exercise. The training control unit 193 acquires the tendency of the student's movement based on the information on the hand movement at that time.

When the calibration is completed, the control unit 190 starts vocational training. The control unit 190 receives the operation of the avatar in the VR image displayed on the display panel 141 by the training control unit 193 by tracking the movement of the student's hand. The training control unit 193 stores information regarding the tracked hand movement in the training information 182, for example, at a predetermined cycle. The training control unit 193 corrects the acquired information on the hand movement based on, for example, the tendency of the student's movement obtained by calibration.

The training control unit 193 calculates the stress value based on, for example, the acquired information on the hand movement. The training control unit 193 standardizes the calculated stress value based on, for example, the minimum value and the maximum value of the stress value obtained by the calibration. The training control unit 193 stores the standardized stress value in the training information 182. The control unit 190 transmits information on hand movements and standardized stress values to the server 20 by the transmission / reception unit 192.

The training control unit 193, for example, assigns a degree of achievement according to the difference between the mission solved in the vocational training course and the ideal hand movement. The training control unit 193 stores the assigned achievement level in the training information 182. The control unit 190 transmits the assigned achievement level to the server 20 by the transmission / reception unit 192.

The server 20 stores the data received from the training device 10 in the training information DB 2022.

The terminal device 30 shown in FIG. 8 displays, for example, the state of the vocational training being carried out on the display of the terminal device 30 in response to an instruction from the manager who operates the terminal device 30.

FIG. 15 is a schematic diagram showing an example of an image displayed on the display of the terminal device 30 shown in FIG. The images shown in FIG. 15 include a VR play image 31 displayed to the students, charts 36 and 37 showing changes in information grasped from information on hand movements, and charts 34 showing changes in stress values. A display area 38 representing the current measured value is displayed. In FIG. 15, for example, a numerical value relating to hand tremor is displayed in chart FIG. 36, and a numerical value relating to, for example, a hand movement speed is displayed in chart FIG. 37. The information displayed in these charts is not limited to these. The manager who operates the terminal device 30 visually recognizes the image displayed on the display of the terminal device 30 and confirms the state of the vocational training.

At least one of the VR play video 31, the charts 34, 36, 37, and the display area 38 can be hidden according to an instruction from the administrator. This enables the manager to check the state of vocational training by focusing on the information that he / she wants to see.

Since the student's proficiency level and the employee's characteristics are evaluated based on the hand movement acquired by hand tracking, a sweating amount sensor, a pulse wave sensor, a temperature sensor, etc. are not required. Therefore, it is possible to lower the hurdles for conducting vocational training. In addition, it is possible to reduce the cost of introducing a system for vocational training.

In the above, the case of estimating the proficiency level of the students based on the stress value has been described. The control unit 203 is not limited to the stress value, and may estimate the proficiency level by comparing it with its own past hand movements.

<5 Other Embodiments>
The server 20 may propose vocational training to employees based on the information stored in the training information DB 2022. For example, the control unit 203 proposes to an employee who has a work with a low proficiency level to take vocational training associated with the work with a low proficiency level. Further, if there is an employee whose proficiency level is not low but whose average stress value and maximum stress value are higher than a predetermined value, the control unit 203 is associated with the corresponding work for the employee. Propose to attend vocational training.

In an organization with many employees, employees can engage in highly qualified work instead of poorly qualified work. However, in an organization with a small number of employees, it may not be possible to substitute for work. In such cases, although less aptitude, it may be desirable to increase proficiency. The control unit 203 may propose to an employee who has a job with low aptitude and proficiency to take vocational training associated with the job. That is, the control unit 203 increases the training for the work that the employee feels weak or stress-prone.

On the contrary, the control unit 203 may propose to the employee who has a highly suitable work to take the vocational training associated with the work. That is, the control unit 203 increases the training for the work that the employee feels good at or the work that the employee is less likely to feel stress.

Further, the server 20 may determine the end of the vocational training for the employee based on the information stored in the training information DB 2022. For example, the control unit 203 informs the employee that when the employee's proficiency level reaches a predetermined level, he / she no longer needs to receive vocational training for the corresponding work. The control unit 203 does not determine that the vocational training has been completed when the average stress value and the maximum stress value are higher than the predetermined threshold value even if the proficiency level has reached a predetermined height. May be good.

In the above embodiment, the case where the vocational training course and the business content of a predetermined industry are associated with each other has been described. Vocational training courses may be organized in chapters so that the corresponding work changes over time. In this case, the control unit 203 estimates the characteristics of the student's work by associating the time variation of the stress value with the chapter structure of the vocational training course.

In the above embodiment, the characteristics of the students are estimated for the work associated with the vocational training that they have taken. The control unit 203 may estimate the characteristics of the work for which the vocational training has not been taken, depending on the degree of similarity with the work for which the characteristics are estimated.

Although some embodiments of the present disclosure have been described above, these embodiments can be implemented in various other embodiments, and various omissions, replacements, and modifications are made without departing from the gist of the invention. It can be performed. These embodiments and variations thereof shall be included in the scope of the invention described in the claims and the equivalent scope thereof, as well as in the scope and gist of the invention.

<Additional notes>
The matters described in each of the above embodiments are added below.
(Appendix 1)
The first image including at least the amount of sweating of the means (11) for displaying the first image related to the vocational training, the means (101) for accepting the operation from the students who take the vocational training, and the students who visually recognize the first image. Means for acquiring biometric information (102), means for calculating the first value regarding the student's stress from the first biometric information (11), and for the trainees regarding vocational training and corresponding work based on the first value. A system comprising means (20) for estimating characteristics.
(Appendix 2)
The means for displaying displays the second image in which a predetermined stress is assumed, and the means for acquiring the second image is a means for acquiring and calculating the second biological information including at least the amount of sweating of the student who visually recognizes the second image. Is the system according to (Appendix 1), which calculates a second value related to stress based on the second biological information, and calculates the first value from the first biological information and the second value.
(Appendix 3)
The means for displaying displays the third image for causing appropriate exercise, and the means for acquiring the first biometric information is based on the third biometric information including at least the amount of sweating of the student who visually recognizes the third image. The system according to (Appendix 1) or (Appendix 2).
(Appendix 4)
When the vocational training is completed, a means for evaluating the achievement level of the vocational training is provided, and the estimation means is one of (Appendix 1) to (Appendix 3) for estimating the characteristics based on the first value and the achievement level. The system described in.
(Appendix 5)
The means for displaying is the system according to any one of (Appendix 1) to (Appendix 4) for displaying a VR image.
(Appendix 6)
The system according to any one of (Appendix 1) to (Appendix 5), wherein the acquisition means acquires the amount of sweating by a sensor that measures the humidity of the space formed including a part of the student's body.
(Appendix 7)
The system according to an appendix (Appendix 6), wherein the sensor has a humidity sensor installed in a first path for supplying air to the space, a second path for discharging air from the space, a first path, and a second path.
(Appendix 8)
The system according to (Appendix 6) or (Appendix 7), wherein the means for receiving the operation is a controller, and the sensor is provided with a space in the grip portion of the controller.
(Appendix 9)
The means for estimating is the system according to any one of (Appendix 1) to (Appendix 8), which estimates the aptitude of a student for vocational training and corresponding work based on the first value.
(Appendix 10)
The means for estimating is the system according to (Appendix 9), which calculates the time during which a student is continuously engaged in work based on aptitude.
(Appendix 11)
The means for estimating is the system according to (Appendix 10), which estimates aptitude based on the first value calculated in the vocational training taken in the past and the first value calculated in the current vocational training.
(Appendix 12)
The means for estimating is the system according to (Appendix 4), which estimates the proficiency level of the students in the vocational training and the corresponding work based on the first value and the achievement level.
(Appendix 13)
The means for estimating is to estimate the proficiency level based on the first value and achievement level calculated in the vocational training taken in the past and the first value and achievement level calculated in this vocational training (Appendix 12). ).
(Appendix 14)
The system according to any one of (Appendix 1) to (Appendix 13), which comprises means for determining the assignment of students based on the characteristics of the students.
(Appendix 15)
The system according to (Appendix 10), which comprises a means for determining at least one of the work schedules of a plurality of students based on the calculated time for a plurality of students who have undergone vocational training.
(Appendix 16)
The system according to any one of (Appendix 1) to (Appendix 15), which comprises means for proposing attendance of vocational training based on the characteristics of the students.
(Appendix 17)
The system according to (Appendix 12) or (Appendix 13), which comprises means for proposing attendance of vocational training based on the proficiency level of the student.
(Appendix 18)
The system according to (Appendix 12), (Appendix 13), or (Appendix 17), which comprises means for determining that attendance of vocational training is unnecessary based on the proficiency level and characteristics of the student.
(Appendix 19)
The first means to display the first image related to vocational training, the means to accept operations from the students based on the movements of the hands of the students who take the vocational training, and the first means related to the stress of the students from the movements of the students' hands. A system including a means for calculating a value and a means for estimating the characteristics of a student regarding vocational training and corresponding work based on the first value.
(Appendix 20)
An information processing device including a control unit and a storage unit, wherein the control unit displays a first image related to vocational training on a display unit, and accepts operations from students who take vocational training. An information processing device that executes a step of acquiring a first biological information including at least the amount of sweating of a student who visually recognizes a first image, and a step of calculating a first value regarding the student's stress from the first biological information.
(Appendix 21)
It is a method executed by a system including a plurality of information processing devices including a control unit and a storage unit, and at least one of the plurality of information processing devices causes a display unit to display a first image related to vocational training. The step, the step of accepting the operation from the student who takes the vocational training, the step of acquiring the first biometric information including at least the amount of sweating of the student who visually recognizes the first image, and the student from the first biometric information. A method of performing a step of calculating a first value for stress and a step of estimating the characteristics of a student for vocational training and corresponding work based on the first value.
(Appendix 22)
It is a program to be executed by a computer equipped with a processor and a memory, and the program performs a step of displaying a first image related to vocational training on a display unit and an operation from a student who takes vocational training. The step of accepting, the step of acquiring the first biometric information including at least the amount of sweating of the student who visually recognizes the first image, and the step of calculating the first value regarding the student's stress from the first biometric information are executed. program.

1 ... System 10 ... Training device 101 ... Controller 102 ... Sweat amount sensor 103 ... Pulse wave sensor 104 ... Temperature sensor 11 ... Main device 12 ... Communication IF
120 ... Communication unit 14 ... Output device 141 ... Display panel 15 ... Memory 16 ... Storage 150 ... Motion sensor 160 ... Camera 17 ... Voice processing unit 171 ... Microphone 172 ... Speaker 180 ... Storage unit 181 ... Employee information 182 ... Training information 183 ... Content information 19 ... Processor 190 ... Control unit 191 ... Operation reception unit 192 ... Transmission / reception unit 193 ... Training control unit 20 ... Server 22 ... Communication IF
23 ... Input / output IF
25 ... Memory 26 ... Storage 29 ... Processor 201 ... Communication unit 202 ... Storage unit 2021 ... Employee information DB
2022 ... Training information DB
2023 ... Content information DB
2024 ... Shift information DB
203 ... Control unit 2031 ... Reception control module 2032 ... Transmission control module 2033 ... Analysis module 2034 ... Assignment determination module 2035 ... Shift setting module 2036 ... Presentation module 30 ... Terminal device 80 ... Network

Claims (26)

A means of displaying the first image of vocational training,
Means for accepting operations from students who take the vocational training,
A means for acquiring first biological information including at least the amount of sweating of the student who visually recognizes the first image, and
A means for calculating the first value regarding the stress of the student from the first biometric information, and
A means for estimating the characteristics of the student regarding the vocational training and the corresponding work based on the first value is provided .
The display means displays a second image in which a predetermined stress is assumed, and displays the second image.
The acquisition means acquires the second biological information including at least the amount of sweating of the student who visually recognizes the second image.
The calculation means is a system that calculates a second value related to stress based on the second biological information, and calculates the first value from the first biological information and the second value . A means of displaying the first image of vocational training,
Means for accepting operations from students who take the vocational training,
A means for acquiring first biological information including at least the amount of sweating of the student who visually recognizes the first image, and
A means for calculating the first value regarding the stress of the student from the first biometric information, and
As a means for estimating the characteristics of the student regarding the work corresponding to the vocational training based on the first value.
Equipped with
The display means displays a third image for moderate exercise, and displays the third image.
The acquisition means is a system that corrects the first biological information based on the third biological information including at least the amount of sweating of the student who visually recognizes the third image. The display means displays a second image in which a predetermined stress is assumed, and displays the second image.
The acquisition means acquires the second biological information including at least the amount of sweating of the student who visually recognizes the second image.
The first value is calculated from the first biological information and the second value by calculating the second value regarding stress based on the second biological information, according to claim 2 . system When the vocational training is completed, a means for evaluating the achievement level of the vocational training is provided.
The system according to any one of claims 1 to 3, wherein the estimation means estimates the characteristics based on the first value and the achievement level. The system according to any one of claims 1 to 4, wherein the means for displaying the VR image is displayed. The system according to any one of claims 1 to 5, wherein the acquisition means acquires the amount of sweating by a sensor that measures the humidity of a space formed including a part of the student's body. The system according to claim 6, wherein the sensor has a first path for supplying air to the space, a second path for discharging air from the space, and humidity sensors installed in the first path and the second path. The means for accepting the operation is a controller.
The system according to claim 6 or 7, wherein the sensor is provided with the space in the grip portion of the controller. A means of displaying the first image of vocational training,
Means for accepting operations from students who take the vocational training,
A means for acquiring first biological information including at least the amount of sweating of the student who visually recognizes the first image, and
A means for calculating the first value regarding the stress of the student from the first biometric information, and
As a means for estimating the characteristics of the student regarding the work corresponding to the vocational training based on the first value.
Equipped with
The estimation means estimates the aptitude of the student for the work corresponding to the vocational training based on the first value, and based on the aptitude, the time for the student to be continuously engaged in the work is determined. System to calculate . The system according to claim 9 , wherein the estimation means estimates the aptitude based on the first value calculated in the vocational training taken in the past and the first value calculated in the current vocational training. The system according to claim 4, wherein the estimation means estimates the proficiency level of the student in the work corresponding to the vocational training based on the first value and the achievement level. The estimation means estimates the proficiency level based on the first value and achievement level calculated in the vocational training taken in the past and the first value and achievement level calculated in the current vocational training. Item 1 The system according to 1. The system according to any one of claims 1 to 12, comprising means for determining the assignment of the student based on the characteristics of the student. The system according to claim 9 , further comprising means for determining a work schedule of at least one of the plurality of students based on the time calculated for the plurality of students who have taken the vocational training. The system according to any one of claims 1 to 14, comprising means for proposing attendance of vocational training based on the characteristics of the student. The system according to claim 11 or 12 , comprising means for proposing attendance of vocational training based on the proficiency level of the student. The system according to claim 1 , 1, 2 , or 16 , which comprises means for determining that attendance of vocational training is unnecessary based on the proficiency level and characteristics of the student. An information processing device including a control unit and a storage unit, wherein the control unit
The step of displaying the first image related to vocational training on the display unit,
Steps to accept operations from students who take the vocational training,
The step of acquiring the first biological information including at least the amount of sweating of the student who visually recognizes the first image, and
The step of calculating the first value regarding the stress of the student from the first biometric information is executed .
In the step of displaying, a second image in which a predetermined stress is assumed is displayed on the display unit.
The acquisition step acquires the second biological information including at least the amount of sweating of the student who visually recognizes the second image.
The calculation step is an information processing device that calculates a second value related to stress based on the second biological information, and calculates the first value from the first biological information and the second value . A method executed in a system including a plurality of information processing devices including a control unit and a storage unit, wherein at least one of the plurality of information processing devices is
The step of displaying the first image related to vocational training on the display unit,
Steps to accept operations from students who take the vocational training,
The step of acquiring the first biological information including at least the amount of sweating of the student who visually recognizes the first image, and
The step of calculating the first value regarding the stress of the student from the first biometric information, and
The step of estimating the characteristics of the student regarding the vocational training and the corresponding work based on the first value is executed .
In the step of displaying, a second image in which a predetermined stress is assumed is displayed on the display unit.
The acquisition step acquires the second biological information including at least the amount of sweating of the student who visually recognizes the second image.
The calculation step is a method of calculating a second value related to stress based on the second biological information, and calculating the first value from the first biological information and the second value . A program for causing a computer having a processor and a memory to execute the program, wherein the program causes the processor to execute the program.
The step of displaying the first image related to vocational training on the display unit,
Steps to accept operations from students who take the vocational training,
The step of acquiring the first biological information including at least the amount of sweating of the student who visually recognizes the first image, and
The step of calculating the first value regarding the stress of the student from the first biometric information is executed .
In the step of displaying, a second image in which a predetermined stress is assumed is displayed on the display unit.
The acquisition step acquires the second biological information including at least the amount of sweating of the student who visually recognizes the second image.
The calculation step is a program that calculates a second value related to stress based on the second biological information, and calculates the first value from the first biological information and the second value . An information processing device including a control unit and a storage unit, wherein the control unit
The step of displaying the first image related to vocational training on the display unit,
Steps to accept operations from students who take the vocational training,
The step of acquiring the first biological information including at least the amount of sweating of the student who visually recognizes the first image, and
With the step of calculating the first value regarding the stress of the student from the first biometric information
And run
In the step of displaying, a third image for causing appropriate exercise is displayed on the display unit.
The acquisition step is an information processing device that corrects the first biological information based on the third biological information including at least the amount of sweating of the student who visually recognizes the third image. A method executed in a system including a plurality of information processing devices including a control unit and a storage unit, wherein at least one of the plurality of information processing devices is
The step of displaying the first image related to vocational training on the display unit,
Steps to accept operations from students who take the vocational training,
The step of acquiring the first biological information including at least the amount of sweating of the student who visually recognizes the first image, and
The step of calculating the first value regarding the stress of the student from the first biometric information, and
With the step of estimating the characteristics of the student regarding the work corresponding to the vocational training based on the first value.
And run
In the step of displaying, a third image for causing appropriate exercise is displayed on the display unit.
The acquisition step is a method of correcting the first biological information based on the third biological information including at least the amount of sweating of the student who visually recognizes the third image. A program for causing a computer having a processor and a memory to execute the program, wherein the program causes the processor to execute the program.
The step of displaying the first image related to vocational training on the display unit,
Steps to accept operations from students who take the vocational training,
The step of acquiring the first biological information including at least the amount of sweating of the student who visually recognizes the first image, and
With the step of calculating the first value regarding the stress of the student from the first biometric information
To execute,
In the step of displaying, a third image for causing appropriate exercise is displayed on the display unit.
The acquisition step is a program for correcting the first biological information based on the third biological information including at least the amount of sweating of the student who visually recognizes the third image. An information processing device including a control unit and a storage unit, wherein the control unit
The step of displaying the first image related to vocational training on the display unit,
Steps to accept operations from students who take the vocational training,
The step of acquiring the first biological information including at least the amount of sweating of the student who visually recognizes the first image, and
The step of calculating the first value regarding the stress of the student from the first biometric information, and
With the step of estimating the characteristics of the student regarding the work corresponding to the vocational training based on the first value.
And run
The estimation means estimates the aptitude of the student for the work corresponding to the vocational training based on the first value, and based on the aptitude, the time for the student to be continuously engaged in the work is determined. Information processing device to calculate. A method executed in a system including a plurality of information processing devices including a control unit and a storage unit, wherein at least one of the plurality of information processing devices is
The step of displaying the first image related to vocational training on the display unit,
Steps to accept operations from students who take the vocational training,
The step of acquiring the first biological information including at least the amount of sweating of the student who visually recognizes the first image, and
The step of calculating the first value regarding the stress of the student from the first biometric information, and
With the step of estimating the characteristics of the student regarding the work corresponding to the vocational training based on the first value.
And run
The estimation means estimates the aptitude of the student for the work corresponding to the vocational training based on the first value, and based on the aptitude, the time for the student to be continuously engaged in the work is determined. How to calculate. A program for causing a computer having a processor and a memory to execute the program, wherein the program causes the processor to execute the program.
The step of displaying the first image related to vocational training on the display unit,
Steps to accept operations from students who take the vocational training,
The step of acquiring the first biological information including at least the amount of sweating of the student who visually recognizes the first image, and
The step of calculating the first value regarding the stress of the student from the first biometric information, and
With the step of estimating the characteristics of the student regarding the work corresponding to the vocational training based on the first value.
To execute,
The estimation means estimates the aptitude of the student for the work corresponding to the vocational training based on the first value, and based on the aptitude, the time for the student to be continuously engaged in the work is determined. Program to calculate.

Images