JP7335044B2 - Work skill determination system, work skill determination method, and work skill determination program - Google Patents

Description

The present invention relates to a work skill determination system, a work skill determination method, and a work skill determination program.

Patent Literature 1 relates to a work support system, and describes "a video acquisition device 11 that acquires a video of the work performed by an expert 2, a voice acquisition device 12 that acquires the voice of the expert during the work, and a video acquisition device. A work check information generation device that generates work check information that serves as a reference for work check based on the video of the work acquired by 11 and the information of the sound acquired by the audio acquisition device 12, and the work performed by the worker 3. It comprises an image acquisition device 21 that acquires an image, a determination device that determines the success or failure of the work performed by the worker 3, and a support information output device 23 that outputs the determination result of the determination device as work support information. The success or failure of the work is judged by comparing the video of the work of the expert 2 and the video of the work of the worker 3 based on the work check information. In Patent Document 1, since the same image is uniformly provided to workers who are determined to be inexperienced, there is a large skill level difference between the inexperienced worker who actually performs the work and the skilled worker. In some cases, working videos may not be very helpful and may not be very effective in improving work skills.

Patent Document 2 relates to a know-how information processing system, method, and device, and describes "Emotional information acquisition for acquiring emotional information indicating the emotional state of a subject based on biological information acquired by a biological information acquisition unit (34). Part (58)” is described.

Patent Document 3 relates to a work support device, and states, “A work support device (10) includes a line-of-sight measurement unit (111) that measures line-of-sight information of a worker, and based on the measurement result of the line-of-sight measurement unit (111), A line-of-sight movement direction measurement unit (112) for measuring a line-of-sight movement direction and outputting a measurement amount of the line-of-sight movement direction; comparing the measurement amount with a reference amount prepared in advance; a skill level determination unit (114) for determining the skill level indicating the skill level of the skill level determination unit (114), and work support information having content corresponding to the skill level determined by the skill level determination unit (114) is output from the information output unit (SP, 13) and an output control unit (102) for outputting.". In Patent Document 3, in order to determine the proficiency level, it is necessary to acquire image information in advance for each device to be worked on, and even if only a limited number of devices can be candidates for work, This is not a big problem, but if many devices are candidates for work, it takes a lot of time and effort to make preliminary preparations for recognizing the devices.

Patent Document 4 relates to a work procedure display device, and describes a work procedure display device A that is used for instructing or learning work procedures for manufacturing or inspection performed at a manufacturing work site, and is used as a model. and a data processing means 1 capable of displaying an image Ia of the work on the display unit 4, and an imaging means 6 capable of imaging the work situation of the work learner. 6 and the image Ia of the work that serves as a model can be displayed on the display unit 4 at the same time.”. In Patent Document 4, since the same image is uniformly provided to workers who are determined to be inexperienced, there is a large skill level difference between the inexperienced worker who actually performs the work and the skilled worker. In some cases, working videos may not be very helpful and may not be very effective in improving work skills.

WO2020/235120 Republished Patent No. 2018/221488 Republished Patent No. 2017/119127 JP 2015-005206 A

The following analysis is given by the present invention. Equipment and systems installed in offices and stores generally include products from multiple manufacturers. management becomes complicated, and the maintenance cost also increases.

Therefore, at present, multi-vendor maintenance services, in which maintenance contact points for products of a plurality of manufacturers are unified, are becoming widespread.

In developing this multi-vendor maintenance service, maintenance service providers will conduct in-house training aimed at improving the work skills of workers so that workers can smoothly perform maintenance work on products from various manufacturers. , is putting more effort into it.

However, since work skills vary among workers, it is preferable to educate workers according to their work skills, and for that purpose, it is desirable to accurately determine the work skills of each worker.

An object of the present invention is to provide a work skill determination system, a work skill determination method, and a work skill determination program that contribute to accurately determining the work skill of a worker.

According to a first aspect of the present invention, a work skill determination system that determines the work skill of a worker performing a series of tasks including a plurality of work items and provides a reference video based on the determination result,
a vital data analysis unit that acquires vital data from the outside and outputs emotion data that can determine a specific emotion;
A first video analysis that obtains work video data obtained by photographing a work situation, divides the work video data for each work item based on the behavior included in the work video data, and has the divided work video data. a video analysis unit that outputs data;
Acquiring emotion data output from the vital data analysis unit, acquiring the first video analysis data output from the video analysis unit, and combining data obtained by combining the emotion data and the first video analysis data a data matching unit to be output;
a determination unit that determines the work skill of the worker for each work item based on the combined data output from the data collation unit;
a notification unit that notifies the determination result determined by the determination unit;
The first video analysis data corresponding to the work item determined to be good in the determination result output from the determination unit is stored as second video analysis data, and the work determined to be unskillful for the work item a video management unit that transmits the stored second video analysis data to a person;
A work skill determination system can be provided, characterized by comprising:

According to a second aspect of the present invention, a work skill determination method for determining the work skill of a worker performing a series of tasks including a plurality of work items and providing a reference image based on the determination result,
a vital data analysis step of acquiring vital data from the outside and outputting emotion data from which a specific emotion can be determined;
A first video analysis that obtains work video data obtained by photographing a work situation, divides the work video data for each work item based on the behavior included in the work video data, and has the divided work video data. a video analysis step for outputting data;
Acquiring emotion data output in the vital data analysis step, acquiring first video analysis data output in the video analysis step, and outputting combined data combining the emotion data and the first video analysis data. a data matching step to
a determination step of determining the work skill of the worker for each work item based on the combined data output in the data collation step;
a notification step of notifying the determination result determined in the determination step;
The first video analysis data corresponding to the work item determined to be good in the determination result output in the determination step is stored as second video analysis data, and the work determined to be unskillful for the work item a video management step of transmitting the stored second video analysis data to a person;
A work skill determination method can be provided, characterized by comprising:

According to a third aspect of the present invention, a computer executes work skill determination processing for determining the work skill of a worker who performs a series of tasks including a plurality of work items and providing a reference image based on the determination result. A program that causes the work skill determination process to
Vital data analysis processing that acquires vital data from the outside and outputs emotional data that can determine specific emotions,
A first video analysis that obtains work video data obtained by photographing a work situation, divides the work video data for each work item based on the behavior included in the work video data, and has the divided work video data. video analysis processing for outputting data;
acquire emotion data output in the vital data analysis process, acquire first video analysis data output in the video analysis process, and output combined data combining the emotion data and the first video analysis data; a data matching process to
a determination process for determining the work skill of the worker for each work item based on the combined data output in the data collation process;
A notification process for notifying a determination result determined in the determination process;
The first video analysis data corresponding to the work item determined to be good in the determination result output in the determination process is stored as second video analysis data, and the work determined to be unskillful for the work item a video management process for transmitting the stored second video analysis data to a person;
A program can be provided, characterized by comprising: This program can be recorded in a computer-readable storage medium. The storage medium can be non-transient such as semiconductor memory, hard disk, magnetic recording medium, optical recording medium, and the like. The invention can also be embodied as a computer program product.

According to the present invention, it is possible to provide a work skill determination system, a work skill determination method, and a work skill determination program that contribute to accurately determining the work skill of a worker.

1 is a diagram showing the configuration of a work skill determination system according to one embodiment of the present invention; FIG. It is a figure showing an example of the whole composition including the work skill judging system of a 1st embodiment of the present invention. It is a figure which shows an example of the combined data of the work skill determination system of the 1st Embodiment of this invention. FIG. 4 is a diagram showing a flowchart of operations of the work skill determination system according to the first embodiment of the present invention; FIG. 9 is a diagram showing an example of the configuration of a vital data analysis unit of the work skill determination system according to the second embodiment of the present invention; FIG. 12 is a diagram showing an example of the configuration of a video analysis unit of the work skill determination system according to the third embodiment of the present invention; It is a figure which shows an example of a structure of the data collation part of the work skill determination system of the 4th Embodiment of this invention. FIG. 11 is a diagram showing an example of the configuration of a determination unit of a work skill determination system according to a fifth embodiment of the present invention; It is a figure which shows an example of a structure of the notification part of the work skill determination system of the 6th Embodiment of this invention. FIG. 20 is a diagram showing an example of the configuration of a video management unit of the work skill determination system according to the seventh embodiment of the present invention; 1 is a diagram showing the configuration of a computer that constitutes the work skill determination system of the present invention; FIG.

First, an outline of an embodiment of the present invention will be described with reference to the drawings. It should be noted that the drawing reference numerals added to this overview are added to each element for convenience as an example to aid understanding, and are not intended to limit the present invention to the illustrated embodiments. Also, connection lines between blocks in drawings and the like referred to in the following description include both bidirectional and unidirectional connections. The unidirectional arrows schematically show the flow of main signals (data) and do not exclude bidirectionality.

FIG. 1 is a diagram showing the configuration of a work skill determination system according to one embodiment of the present invention. In one embodiment of the present invention, as shown in FIG. It can be realized by the work skill determination system 1 including.

More specifically, the work skill determination system 1 of one embodiment of the present invention determines the work skill of a worker who performs a series of tasks including a plurality of work items, and based on the determination result, a reference video is displayed. I will provide a.

The vital data analysis unit 101 of the work skill determination system 1 acquires vital data from the outside and outputs emotion data from which a specific emotion can be determined.

The video analysis unit 102 acquires work video data obtained by photographing a work situation, divides the work video data for each work item based on the behavior included in the work video data, and divides the work video data into sections having the divided work video data. 1 Output video analysis data.

The data matching unit 103 acquires the emotion data output from the vital data analysis unit 101, acquires the first image analysis data output from the image analysis unit 102, and combines the emotion data and the first image analysis data. Output the combined data.

The determination unit 104 determines the work skill of the worker for each work item based on the combined data output from the data collation unit 103 .

The notification unit 105 notifies the determination result determined by the determination unit 104 .

The image management unit 106 stores the first image analysis data corresponding to the work item determined to be good in the determination result output from the determination unit 104 as the second image analysis data, and determines that the work item is unskilled. The stored second video analysis data is transmitted to the operator who received the data.

As described above, according to the work skill determination system 1 of one embodiment of the present invention, based on the work image data and the vital data, it is possible to accurately determine whether the worker is good or bad at each work item among the work performed by the worker. Therefore, it is possible to provide the work skill determination system 1 that contributes to the accurate determination of the work skill of the worker.

[First embodiment]
Next, the work skill determination system 1 of the first embodiment of the present invention will be described with reference to the drawings. FIG. 2 is a diagram showing an example of the overall configuration including the work skill determination system 1 according to the first embodiment of the present invention. In FIG. 2, constituent elements having the same reference numerals as in FIG. 1 indicate the same constituent elements as in FIG.

Referring to FIG. 2, there is shown an overall configuration including a wearable device 202 worn by a worker 201 and a work skill determination system 1 connected to photographing equipment 203 for photographing work images of the worker 201 . The work skill determination system 1 includes a vital data analysis unit 101 , an image analysis unit 102 , a data collation unit 103 , a determination unit 104 , a notification unit 105 and an image management unit 106 . It should be noted that the result of determination by the work skill determination system 1 is notified to the boss 211 and the worker 201 himself (the worker 201 whose work video was captured).

Vital data analysis unit 101 analyzes the vital data collected by wearable device 202 and outputs the analysis result to data matching unit 103 as emotion data DE.

Specifically, the vital data analysis unit 101, for example, analyzes the variation of the pulse included in the vital data over a certain period of time to determine emotions such as irritability and impatience, and outputs the determination result as emotion data DE. .

The video analysis unit 102 receives work video data DM captured by a camera or the like, generates first video analysis data DM1 edited for each work item, and outputs the first video analysis data DM1 to the data matching unit 103 .

Specifically, the video analysis unit 102 stores in advance data related to the behavior of the worker for each work item (hereinafter referred to as behavior data), and compares the behavior data with the work video data DM to determine whether the work is performed. It is possible to identify the work items that the person is performing. For example, when behaviors a1 to a3 are required to complete work item a, and if behavior data for behaviors a1 to a3 are included in the work video data DM, the video analysis unit 102 determines that the worker is performing the work It can be determined that item a has been completed. It should be noted that it is preferable to consider the order of the detected behavior data as well.

Furthermore, the video analysis unit 102 generates first video analysis data DM1 by adding chapters to the work video data DM for each specified work item, and outputs the first video analysis data DM1 to the data matching unit 103 .

Note that the video analysis unit 102 can also record inappropriate behavior data for each work item in advance. Specifically, it is possible to store data related to the behavior of proceeding with work while cluttering the work space, or the behavior of neglecting to check when it should be checked. The image analysis unit 102 confirms whether or not these behaviors are included in the acquired work image data DM, and the confirmation result is output to the determination unit 104 via the data collation unit 103 .

Subsequently, the data matching unit 103 receives the emotion data DE from the vital data analysis unit 101 and receives the first video analysis data DM1 from the video analysis unit 102 . The two pieces of data received are collated for each work item and output to determination unit 104 as combined data DC (see FIG. 3) that combines (combines first video analysis data and emotion data).

FIG. 3 is a diagram showing an example of combined data of the work skill determination system according to the first embodiment of the present invention. For the first video analysis data and the emotion data, a and 1, b and 2, c and 3, and d and 4 are collated, respectively, and each of the first video analysis data a, b, c, and d is emotion data 1. , 2, 3, 4, respectively. Note that the horizontal axis indicates the time axis.

The determination unit 104 determines whether each work item is a good work or not based on the combined data DC. Then, the determination result is output to the notification unit 105 and the video management unit 106 .

Specifically, it is determined whether or not the worker was in a hurry based on the emotion data DE of the combined data DC, and whether or not the work was completed within a predetermined time based on the first video analysis data DM1 of the combined data DC. Based on this, it is possible to determine whether or not each work item is a good work. The work skill can also be determined based on the time when the work is completed and the presence or absence of impatience. Note that it is also possible to divide work skills into a plurality of levels for determination.

Also, the determination unit 104 receives the first video analysis data DM1 including the confirmation result as to whether or not inappropriate behavior is included from the data matching unit 103, and utilizes it for determination of strengths and weaknesses. A determination result is output to the notification unit 105 and the video management unit 106 .

The notification unit 105 notifies the determination result received from the determination unit 104 to the worker to be determined and the superior thereof. As a result, the worker can reconfirm his or her work skills, and the superior can make an appropriate evaluation according to the work skills.

The video management unit 106 transfers to the worker reference video data corresponding to the work item determined to be unskilled based on the determination result. As a result, the worker can improve his work skill.

The image management unit 106 also receives the first image analysis data DM1, and if the determination result received from the determination unit 104 is good, the data determined to be good among the first image analysis data DM1 is 2 can be stored and managed as video analysis data DM2. That is, the second image analysis data DM2 can be used as reference image data. More specifically, the image management unit 106 can transmit the stored second image analysis data DM2 to the worker who is determined to be unskilled at the work item.

Furthermore, when the determination unit 104 determines the work skill, the image management unit 106 stores the second image analysis data DM2 for each work skill level, and provides the work image of the work skill level suitable for the worker. can be done. As a result, workers can improve their work skills more efficiently.

Next, with reference to FIG. 4, operation of the first embodiment of the present invention shown in FIG. 3 will be described in detail. FIG. 4 is a diagram showing a flowchart of the operation of the work skill determination system 1 according to the first embodiment of the present invention.

First, the vital data analysis unit 101 receives the vital data DV from the wearable device 202 and generates emotion data based on the vital data value corresponding to each recorded emotion (step S01). The generated emotion data is output to data matching section 103 .

Next, the video analysis unit 102 receives the work video data DM shot by the shooting equipment 203, and adds a chapter for each work item (step S02). The video analysis unit 102 stores in advance the behavior performed for each work item, and can determine that the work is completed by checking the behavior. You can add chapters that separate

Next, data matching unit 103 receives emotion data DE from vital data analysis unit 101 and receives first video analysis data DM1 from video analysis unit 102 . The data matching unit 103 generates combined data DC by combining emotion data DE with each chapter of the first video analysis data. Combined data DC is output to determination unit 104 (step S03).

After that, the determination unit 104 receives the combined data DC from the data matching unit 103, and determines the strengths and weaknesses of each work item based on the emotion data part and the first video analysis data DM1 part in the combined data DC. (step S04). Specifically, for each work item, from the portion of the first image analysis data DM1, how long it took for the worker to complete the work, and what kind of behavior (behavior) was used to complete the work. can grasp. Furthermore, from the part of the emotion data DE, it is possible to grasp with what kind of emotion the worker was working on the work. That is, the determination unit 104 determines strengths and weaknesses based on the three elements of work time, behavior during work, and emotion during work. Note that the determining unit 104 may determine not only the two choices of strengths and weaknesses for each work item, but also work skill levels consisting of a plurality of levels. A determination result is output to the notification unit 105 .

Further, when the determination unit 104 determines that the user is good at the combined data DC (Yes in step S04), the second image analysis data obtained by cutting out only the portion determined to be good from the first image analysis data DM1. DM2 is sent to the video management unit 106 . The transmitted second video analysis data DM2 is stored in the video management unit 106 (step S05).

Subsequently, the notification unit 105 receives the determination result from the determination unit 104 and notifies the worker 201 and the worker's boss 211 of the determination result (step S06). Specifically, when the determination result received from the determination unit 104 is good, the notification unit 105 notifies the worker 201 and his boss 211 to that effect. On the other hand, if the judgment result received from the judging unit 104 is unsatisfactory, it not only notifies the worker 201 himself and his boss but also stores the work item corresponding to the work item judged unsatisfactory. The second image analysis data DM2 stored in the image can be transmitted to the operator 201 himself.

However, the present invention is not limited to the above description. For example, in the above explanation, for the sake of convenience, it is explained that the analysis of the video data is performed after the analysis of the vital data is finished, but it does not matter which one comes first. The video analysis unit 102 can also extract audio from the work video data DM and use it as a basis for judging whether or not the maintenance equipment and work equipment are handled carefully. The result of determination by voice may be included in the first video analysis data DM1, as well as the result of confirmation as to whether inappropriate behavior is included.

According to the first embodiment of the present invention, it is possible to accurately determine whether the worker is good or bad at each work item among the work performed by the worker, based on the work image data and the vital data. In addition, when the worker is determined to be unskilled, the work video (reference video) of the worker determined to be good can be provided to improve the worker's work skill.
Furthermore, according to the present invention, when work skills consisting of a plurality of levels can be determined, it is also possible to provide work images (reference images) according to the level of the work skill of the worker.

[Second embodiment]
Next, the vital data analysis unit 101 of the work skill determination system according to the second embodiment of the present invention will be described with reference to the drawings. FIG. 5 is a diagram showing an example configuration of the vital data analysis unit 101 of the work skill determination system 1 according to the second embodiment of the present invention. In FIG. 5, constituent elements having the same reference numerals as in FIGS. 1 and 2 denote the same constituent elements as in FIGS.

According to FIG. 5, the vital data analysis unit 101 of the work skill determination system 1 of the second embodiment of the present invention includes a vital data reception unit 501, an emotion data extraction unit 502, and an emotion data output unit 503.

Vital data receiving section 501 receives vital data collected by wearable device 202 shown in FIG. 2 and outputs it to emotion data extracting section 502 . Emotion data extraction unit 502 analyzes the vital data and outputs the analysis result to emotion data output unit 503 as emotion data DE. Specifically, the emotion data extracting unit 502, for example, analyzes the fluctuation of the pulse included in the vital data over a certain period of time to determine emotions such as irritability and impatience, and outputs the determination result as emotion data DE. . The emotion data output unit 503 outputs the received emotion data DE to the data matching unit 103 shown in FIG.

The vital data analysis unit 101 of the work skill determination system 1 can be configured according to the second embodiment of the present invention.

[Third Embodiment]
Next, the video analysis unit 102 of the work skill determination system 1 according to the third embodiment of the present invention will be described with reference to the drawings. FIG. 6 is a diagram showing an example of the configuration of the video analysis unit 102 of the work skill determination system 1 according to the third embodiment of the invention. In FIG. 6, constituent elements having the same reference numerals as in FIGS. 1 and 2 denote the same constituent elements as in FIGS.

6, the video analysis unit 102 of the work skill determination system 1 of the third embodiment of the present invention includes a work video data receiving unit 601, a behavior extraction unit 602, a behavior data storage unit 603, a video partition A portion 604 is included.

The work video data receiving unit 601 receives work video data from the imaging equipment 203 shown in FIG. The behavior extraction unit 602 compares the data on the behavior of the worker for each work item (hereinafter referred to as behavior data) stored in advance in the behavior data storage unit 603 with the work image data DM, thereby allowing the worker to perform It is possible to identify the work items that are being performed. The video delimiter 604 generates first video analysis data DM1 by adding a chapter to the work video data DM for each identified work item, and outputs the first video analysis data DM1 to the data matching unit 103 shown in FIG.

The video analysis unit 102 of the work skill determination system 1 can be configured according to the third embodiment of the present invention.

[Fourth embodiment]
Next, the data matching unit 103 of the work skill determination system 1 according to the fourth embodiment of the present invention will be described with reference to the drawings. FIG. 7 is a diagram showing an example of the configuration of the data matching unit 103 of the work skill determination system 1 according to the fourth embodiment of the invention. In FIG. 7, constituent elements having the same reference numerals as in FIGS. 1 and 2 denote the same constituent elements as in FIGS.

According to FIG. 7, the data matching unit 103 of the work skill determination system 1 of the fourth embodiment of the present invention includes an emotion data receiving unit 701, a first video analysis data receiving unit 702, and a matching unit 703. A portion 704 is included.

Emotion data reception section 701 receives emotion data DE from vital data analysis section 101 , and first video analysis data reception section 702 receives first video analysis data DM 1 from video analysis section 102 . The matching unit 703 receives the emotion data DE from the emotion data receiving unit 701, receives the first video analysis data DM1 from the first video analysis data receiving unit 702, and compares the two data as described with reference to FIG. Each work item is collated and the result is sent to the combiner 704 . As described with reference to FIG. 3, the combining unit 704 combines the collated data received from the collating unit 703 and outputs combined data DC (combining emotion data with the first video analysis data).

The data matching unit 103 of the work skill determination system 1 can be configured according to the fourth embodiment of the present invention.

[Fifth embodiment]
Next, the determination unit 104 of the work skill determination system 1 according to the fifth embodiment of the present invention will be described with reference to the drawings. FIG. 8 is a diagram showing an example of the configuration of the determination unit 104 of the work skill determination system 1 according to the fifth embodiment of the present invention. In FIG. 8, constituent elements having the same reference numerals as in FIGS. 1 and 2 denote the same constituent elements as in FIGS.

According to FIG. 8, the determination unit 104 of the work skill determination system 1 of the fifth embodiment of the present invention includes a combined data reception unit 801, a determination unit 802 for each work item, and a determination result output unit 803. .

Combined data receiving unit 801 receives combined data DC in which first video analysis data (DM1) and emotion data are combined from data matching unit 103 . The determination unit 802 for each work item determines whether or not each work item is a good work based on the combined data DC, and outputs the determination result and the first video analysis data (DM1) to the determination result output unit 803. do. The determination result output unit 803 outputs the received determination result and the first video analysis data (DM1).

The determination unit 104 of the work skill determination system 1 can be configured according to the fifth embodiment of the present invention.

[Sixth Embodiment]
Next, the notification unit 105 of the work skill determination system 1 according to the sixth embodiment of the present invention will be described with reference to the drawings. FIG. 9 is a diagram showing an example configuration of the notification unit 105 of the work skill determination system 1 according to the sixth embodiment of the present invention. In FIG. 9, constituent elements having the same reference numerals as in FIGS. 1 and 2 indicate the same constituent elements as in FIGS.

According to FIG. 9, the notification section 105 of the work skill determination system 1 of the sixth embodiment of the present invention includes a determination result reception section 901 and a determination result notification section 902 .

The determination result reception unit 901 receives the determination result from the determination unit 104 and outputs it to the determination result notification unit 902 . The determination result notification unit 902 notifies the determination target worker and his superior of the determination result.

The notification unit 105 of the work skill determination system 1 can be configured according to the sixth embodiment of the present invention.

[Seventh embodiment]
Next, the video management unit 106 of the work skill determination system 1 according to the seventh embodiment of the present invention will be described with reference to the drawings. FIG. 10 is a diagram showing an example of the configuration of the video management unit 106 of the work skill determination system 1 according to the seventh embodiment of the present invention. In FIG. 10, constituent elements having the same reference numerals as in FIGS. 1 and 2 denote the same constituent elements as in FIGS.

According to FIG. 10, the image management unit 106 of the work skill determination system 1 of the seventh embodiment of the present invention includes a determination result reception unit 1001, a first image analysis data reception unit 1002, and a second image analysis data determination unit. 1003 , a second video analysis data storage unit 1004 , and a reference video data output unit 1005 .

The image management unit 106 receives the first image analysis data DM1 and the determination result from the determination unit 104 . The determination result receiving unit 1001 receives the determination result out of the first video analysis data DM1 and the determination result received from the determination unit 104 . The first video analysis data receiving unit 1002 receives the first video analysis data out of the first video analysis data DM1 and the determination result received from the determination unit 104 . If the determination result received by the determination result receiving unit 1001 is good, the second video analysis data determining unit 1003 determines whether the first video analysis data received by the first video analysis data receiving unit 1002 is good. The determined data is stored in the second video analysis data storage unit 1004 as the second video analysis data DM2. The data stored in the second video analysis data storage unit 1004 is used as reference video data. Further, when the determination result received by the determination result receiving unit 1001 is unskilled, the reference image data output unit 1005 outputs the reference image data corresponding to the work item determined to be unskillful as the second image analysis data. It is taken out from the storage unit 1004 and transferred to the operator.

The image management unit 106 of the work skill determination system 1 can be configured according to the seventh embodiment of the present invention.

Although each embodiment of the present invention has been described above, the present invention is not limited to the above-described embodiments, and further modifications, replacements, and adjustments can be made without departing from the basic technical idea of the present invention. can be added. For example, the network configuration, the configuration of each element, and the form of expression of messages shown in each drawing are examples for helping understanding of the present invention, and are not limited to the configurations shown in these drawings. Also, in the following description, "A and/or B" is used to mean at least either A or B.

Further, the procedures shown in the above-described first to seventh embodiments can be realized by a program that causes a computer (9000 in FIG. 11) functioning as the work skill determination system 1 to realize the function as the work skill determination system 1. be. Such a computer is exemplified by a configuration including a CPU (Central Processing Unit) 9010, a communication interface 9020, a memory 9030, and an auxiliary storage device 9040 in FIG. That is, the CPU 9010 in FIG. 11 may execute the work skill determination program to update each calculation parameter held in the auxiliary storage device 9040 or the like.

The memory 9030 is RAM (Random Access Memory), ROM (Read Only Memory), or the like.

That is, each part (processing means, function) of the work skill determination system shown in the first to seventh embodiments described above is a computer that causes the processor of the computer to execute each process described above using its hardware. It can be implemented by a program.

Finally, preferred forms of the invention are summarized.
[First form]
(Refer to the work skill determination system from the first viewpoint above)
[Second form]
The video analysis unit of the work skill determination system according to the first aspect stores information about the inappropriate work in the acquired work video data based on information about the inappropriate work for each work item stored in advance. It is preferable to check whether it is included.
[Third form]
The determination unit of the work skill determination system according to the first or second aspect confirms the worker's emotion from the emotion data portion of the combined data, and confirms the worker's emotion from the first video analysis data portion of the combined data. It is preferable to determine the work skill by confirming work time and behavior during work.
[Fourth mode]
of the work skill determination system according to any one of the first to third modes,
The determination unit can determine the work skill by dividing it into a plurality of levels,
It is preferable that the image management unit stores the second image analysis data for each level and transmits the second image analysis data corresponding to each level to the operator.
[Fifth form]
(See the work skill determination method from the second viewpoint above.)
[Sixth form]
In the video analysis step of the work skill determination method according to the fifth aspect, based on pre-stored information on unsuitable work for each work item, the acquired work video data contains information on the unsuitable work. Preferably, it includes the step of checking whether it is included.
[Seventh form]
The determination step of the work skill determination method according to the fifth or sixth aspect includes confirming the worker's emotion from the emotion data portion of the combined data, and confirming the worker's emotion from the first video analysis data portion of the combined data. It is preferable to include the step of determining the work skill by checking work time and work behavior.
[Eighth mode]
(Refer to the program from the third viewpoint above)
[Ninth form]
In the video analysis processing of the program according to the eighth mode, the acquired work video data contains information about the inappropriate work based on pre-stored information about the inappropriate work for each work item. It is preferable to include processing for confirming whether or not there is.
[Tenth mode]
In the determination process of the program according to the eighth or ninth mode, the operator's emotion is confirmed from the emotion data part of the combined data, and the work time is determined from the first video analysis data part of the combined data. It is preferable to include a process of determining the work skill by checking the behavior during work.

It should be noted that each disclosure of the above patent documents is incorporated herein by reference. Within the framework of the full disclosure of the present invention (including the scope of claims), modifications and adjustments of the embodiments and examples are possible based on the basic technical concept thereof. Various combinations or selections of various disclosure elements (including each element of each claim, each element of each embodiment or example, each element of each drawing, etc.) are possible within the framework of the disclosure of the present invention. is. That is, the present invention naturally includes various variations and modifications that can be made by those skilled in the art according to the entire disclosure including claims and technical ideas. In particular, any numerical range recited herein should be construed as specifically recited for any numerical value or subrange within that range, even if not otherwise stated.

1 work skill determination system 101 vital data analysis unit 102 image analysis unit 103 data collation unit 104 determination unit 105 notification unit 106 image management unit 201 worker 202 wearable device 203 photographing equipment 211 boss 501 vital data reception unit 502 emotion data extraction unit 503 Emotion data output unit 601 Work video data reception unit 602 Behavior extraction unit 603 Behavior data storage unit 604 Video division unit 701 Emotion data reception unit 702 First video analysis data reception unit 703 Verification unit 704 Combination unit 801 Combined data reception unit 802 Work items Determination unit 803 for each determination result output unit 901 Determination result reception unit 902 Determination result notification unit 1001 Determination result reception unit 1002 First video analysis data reception unit 1003 Second video analysis data determination unit 1004 Second video analysis data storage unit 1005 See Video data output unit 9000 Computer 9010 CPU
9020 Communication interface 9030 Memory 9040 Auxiliary storage device

Claims (10)

A work skill determination system that determines the work skill of a worker performing a series of tasks including a plurality of work items and provides a reference video based on the determination result,
a vital data analysis unit that acquires vital data from the outside and outputs emotion data that can determine a specific emotion;
A first video analysis that obtains work video data obtained by photographing a work situation, divides the work video data for each work item based on the behavior included in the work video data, and has the divided work video data. a video analysis unit that outputs data;
Acquiring emotion data output from the vital data analysis unit, acquiring the first video analysis data output from the video analysis unit, and combining data obtained by combining the emotion data and the first video analysis data a data matching unit to be output;
a determination unit that determines the work skill of the worker for each work item based on the combined data output from the data collation unit;
a notification unit that notifies the determination result determined by the determination unit;
The first video analysis data corresponding to the work item determined to be good in the determination result output from the determination unit is stored as second video analysis data, and the work determined to be unskillful for the work item a video management unit that transmits the stored second video analysis data to a person;
A work skill determination system, comprising: The video analysis unit checks whether or not the acquired work video data includes information about the inappropriate work based on previously stored information about the inappropriate work for each work item. The work skill determination system according to claim 1, wherein: The determination unit confirms the worker's emotion from the emotion data part of the combined data, and confirms the work time and the behavior during the work from the first image analysis data part of the combined data. 3. The work skill determination system according to claim 1, wherein the work skill is determined. The determination unit can determine the work skill by dividing it into a plurality of levels,
4. The method according to any one of claims 1 to 3, wherein the image management unit stores the second image analysis data for each level and transmits the second image analysis data according to each level to the operator. The work skill determination system according to any one of the above. A work skill determination method for determining the work skill of a worker performing a series of tasks including a plurality of work items and providing a reference video based on the determination result,
a vital data analysis step of acquiring vital data from the outside and outputting emotion data from which a specific emotion can be determined;
A first video analysis that obtains work video data obtained by photographing a work situation, divides the work video data for each work item based on the behavior included in the work video data, and has the divided work video data. a video analysis step for outputting data;
Acquiring emotion data output in the vital data analysis step, acquiring first video analysis data output in the video analysis step, and outputting combined data combining the emotion data and the first video analysis data. a data matching step to
a determination step of determining the work skill of the worker for each work item based on the combined data output in the data collation step;
a notification step of notifying the determination result determined in the determination step;
The first video analysis data corresponding to the work item determined to be good in the determination result output in the determination step is stored as second video analysis data, and the work determined to be unskillful for the work item a video management step of transmitting the stored second video analysis data to a person;
A work skill determination method, comprising: The video analysis step includes a step of confirming whether or not the acquired work video data includes information about the inappropriate work based on previously stored information about the inappropriate work for each work item. 6. The work skill determination method according to claim 5, characterized by: The determination step confirms the worker's emotion from the emotion data portion of the combined data, and confirms the working time and behavior during the work from the first video analysis data portion of the combined data. 7. A work skill determination method according to claim 5 or 6, comprising a step of determining work skill. A program for causing a computer to determine the work skill of a worker performing a series of tasks including a plurality of work items, and to execute a work skill determination process for providing a reference image based on the determination result, wherein the work skill determination process teeth,
Vital data analysis processing that acquires vital data from the outside and outputs emotional data that can determine specific emotions,
A first video analysis that obtains work video data obtained by photographing a work situation, divides the work video data for each work item based on the behavior included in the work video data, and has the divided work video data. video analysis processing for outputting data;
acquire emotion data output in the vital data analysis process, acquire first video analysis data output in the video analysis process, and output combined data combining the emotion data and the first video analysis data; a data matching process to
a determination process for determining the work skill of the worker for each work item based on the combined data output in the data collation process;
A notification process for notifying a determination result determined in the determination process;
The first video analysis data corresponding to the work item determined to be good in the determination result output in the determination process is stored as second video analysis data, and the work determined to be unskillful for the work item a video management process for transmitting the stored second video analysis data to a person;
A program characterized by comprising: The image analysis processing includes processing for confirming whether or not the acquired work video data includes information regarding the inappropriate work based on information regarding the inappropriate work for each work item stored in advance. 9. The program according to claim 8, characterized by: The determination process confirms the worker's emotion from the emotion data portion of the combined data, and confirms the working time and behavior during the work from the first video analysis data portion of the combined data. 10. The program according to claim 8 or 9, comprising a process of determining work skill.

Images