WO2023176030A1 - Error reporting system and control device - Google Patents

Abstract

An error reporting system (1) comprises a wearable device (10) and a control device (20) that controls the wearable device (10). The control device (20) compares, process by process, details of work including at least one process and indicated by a work procedure document and details of work indicated by a video recording the appearance of a worker performing work to identify a difference. The wearable device (10) includes a reporting device (18) that reports an error when a difference is identified.

Description

Error notification system and control device

The present disclosure relates to an error notification system and a control device.

In recent years, there have been an increasing number of cases in which workers wear wearable devices and engage in work while viewing work procedure manuals displayed on the wearable device.

Japanese Unexamined Patent Publication No. 2021-82314 (Patent Document 1) discloses that when the contents of the maintenance work input by the operator and the contents of the work indicated in the procedure manual are different, the maintenance work input by the operator is Discloses a technology for updating procedure manuals based on the content of work. JP 2017-169543 A (Patent Document 2) discloses that factors that require attention (reagents, consumables, equipment, workers, work environment, etc.) may be used, which are registered in advance by the administrator. Discloses a technology for notifying an alert at certain times.

JP 2021-82314 Publication Japanese Patent Application Publication No. 2017-169543

With both the technology disclosed in Japanese Patent Application Publication No. 2021-82314 and the technology disclosed in Japanese Patent Application Publication No. 2017-169543, there is a risk that the worker may proceed with the work without realizing that he or she has made a work error.

The present disclosure has been made in view of the above circumstances, and aims to provide an error notification system that allows a worker to notice at an early stage that a worker has made a work error while wearing a wearable device. One purpose.

A first aspect of the present disclosure relates to an error notification system. The error notification system includes a wearable device and a control device that controls the wearable device. The control device compares the content of the work including at least one process shown in the work procedure manual with the content of the work shown in the video recording of the worker during the work for each process to identify differences. do. The wearable device includes a notification device that notifies an error when a difference is identified.

A second aspect of the present disclosure relates to a control device that controls a wearable device. The control device compares the content of the work including at least one process shown in the work procedure manual with the content of the work shown in the video recording of the worker during the work for each process to identify differences. do. The wearable device includes a notification device that notifies an error when a difference is identified.

According to the error notification system according to the present disclosure, while the worker is wearing a wearable device and performing the work, the content of the worker's work is determined from the video recorded of the worker's situation as shown in the work procedure manual. The control device specifies whether or not they match, and if the worker takes an action that differs from the content of the work indicated in the work procedure manual, an error is notified to the worker's wearable device. Therefore, the worker can notice at an early stage that he or she has made a work error.

1 is a diagram showing an overview of an error notification system in Embodiment 1. FIG. 1 is a diagram showing an example of the configuration of a control device in Embodiment 1. FIG. FIG. 3 is a diagram showing an example of a work procedure manual in the first embodiment. FIG. 3 is a diagram for explaining an overview of error notification processing performed by the error notification system in the first embodiment. FIG. 3 is a diagram showing an example of an error notification in the first embodiment. 7 is a flowchart showing processing performed by a processor of the control device in the first embodiment. FIG. 7 is a diagram for explaining an overview of processing performed by the error notification system in Embodiment 2. FIG. 7 is a diagram showing an example of a history table in Embodiment 2. FIG. 7 is a diagram showing an example of a warning notification in Embodiment 2. FIG. 7 is a flowchart showing processing performed by a processor of a control device in Embodiment 2. FIG. 7 is a diagram showing another example of the history table in the second embodiment. FIG. FIG. 7 is a diagram showing an overview of an error notification system in Embodiment 3. FIG. 7 is a diagram showing an example of the configuration of a control device in Embodiment 3; FIG. 7 is a diagram illustrating an example of the configuration of an external output device in Embodiment 3. FIG. 7 is a diagram for explaining an overview of processing performed by the error notification system in Embodiment 3; 12 is a flowchart showing processing performed by a processor of a control device in Embodiment 3. 9 is a diagram illustrating an example of error information displayed on a display of an external output device in Embodiment 3. FIG.

Hereinafter, embodiments and modifications will be described in detail with reference to the drawings. Note that the same or corresponding parts in the figures are designated by the same reference numerals, and the description thereof will not be repeated. The embodiments and modifications described below may be selectively combined as appropriate.

In the following explanation, "work" refers to an action performed by a worker, and refers to an action whose procedure is determined in advance by a work procedure manual. For example, "work" includes sample analysis, equipment and equipment maintenance, assembly at a manufacturing site, construction at a construction site, medical treatment at a medical site, and the like. Note that "work" is not limited to any action as long as the procedure is predetermined by a work procedure manual. In the following description, "work" includes at least one process, and a work procedure is defined for each process. As an example, if the "work" is the analysis of a specimen, the process of taking out the specimen from storage, taking out the reagent from storage, weighing the specimen, weighing the reagent, and mixing the specimen and reagent. The process includes a process, a process of analyzing a mixture of a sample and a reagent with an apparatus, and a process of evaluating the analysis results.

[Embodiment 1]
FIG. 1 is a diagram showing an overview of an error notification system according to the first embodiment. The error notification system 1 includes smart glasses 10, a control device 20, and an input device 30. The smart glasses 10 are an example of a "wearable device." The worker wears the smart glasses 10 and performs the work while viewing the work procedure displayed on the smart glasses 10. The work procedure is the content of the work included in the work procedure manual 224, which will be described later. The control device 20 can communicate with the smart glasses 10 and the input device 30 via wired or wireless communication.

The smart glasses 10 include transparent protective glasses 11 for protecting the eyes, an imaging device 14, and a notification device 18. Notification device 18 includes a transparent display 13 and a speaker 16. Since the protective glasses 11 and the display 13 are transparent, the worker can visually check the front while wearing the smart glasses 10.

The imaging device 14 captures an image of the worker while the worker is performing the task. Specifically, the imaging device 14 captures an image of the worker's hand located beyond the worker's line of sight, thereby acquiring a video recording of the worker's appearance during work.

The display 13 is an example of a "display device." Display 13 displays images. As an example, the display 13 displays an image showing a work procedure while the worker is performing the work. As another example, the display 13 displays an image indicating an error in the work. The image displayed on the display 13 may be a still image or a moving image. The display 13 includes a right-eye display 13a and a left-eye display 13b. The right eye side display 13a is attached to the protective glasses 11 via the right eye side attachment part 15a, and the left eye side display 13b is attached to the protective glasses 11 via the left eye side attachment part 15b. There is. The worker can visually check the front through the display 13 and can also view the image displayed on the display 13.

The speaker 16 outputs sound. As an example, the speaker 16 outputs a sound indicating an error in the work. The sound output from the speaker 16 may be a voice or a notification sound. The notification sound includes at least one of a buzzer sound, a chime, a melody, and music.

The control device 20 comprehensively controls the entire smart glasses 10. In detail, the control device 20 controls the display on the display 13, the imaging by the imaging device 14, and the output of sound by the speaker 16.

The input device 30 includes at least one of a button, a touch pad, and a microphone. Various instructions for the control device 20 are input into the input device 30 by an operator.

The control device 20 compares the content of the work including at least one process shown in the work procedure manual and the content of the work shown in the video recording of the worker during the work, for each process, to identify differences. Identify. When the control device 20 identifies a difference, it instructs the notification device 18 to notify the error. As a result, an image indicating an error in the work is displayed on the display 13. In addition, the speaker 16 may output a sound indicating an error in the work. Therefore, according to the error notification system 1, the worker can notice that he or she has made a work error.

FIG. 2 is a diagram showing an example of the configuration of the control device in the first embodiment. Control device 20 includes a processor 201 , a main memory 202 , a camera interface 203 , a display interface 204 , a speaker interface 205 , an input interface 206 , a memory card interface 207 , and a storage device 220 . Processor 201, main memory 202, camera interface 203, display interface 204, speaker interface 205, input interface 206, memory card interface 207, and storage device 220 can communicate with each other via internal bus 299. It is connected to the.

The processor 201 is configured by, for example, at least one integrated circuit. The integrated circuit includes, for example, at least one CPU (Central Processing Unit), at least one ASIC (Application Specific Integrated Circuit), at least one FPGA (Field Programmable Gate Array), or a combination thereof.

The processor 201 implements various processes by loading the program 222 stored in the storage device 220 into the main memory 202 and executing it. The main memory 202 is made up of volatile memory and functions as a work memory necessary for the processor 201 to execute programs.

The storage device 220 is composed of nonvolatile memory. Alternatively, the storage device 220 may be, for example, a hard disk, an SSD (Solid State Drive), or the like, and may be either a built-in type or an external type. The storage device 220 stores programs 222 and various data (for example, work procedure manuals 224, etc.) for implementing various processes according to the present embodiment.

The camera interface 203 relays data transmission between the processor 201 and the imaging device 14. Specifically, a signal instructing the start of imaging is output from the processor 201 to the imaging device 14 via the camera interface 203. Further, an image obtained by imaging (for example, a video recording of a worker during work, etc.) is output from the imaging device 14 to the processor 201 via the camera interface 203. Further, a signal instructing the end of imaging is output from the processor 201 to the imaging device 14 via the camera interface 203.

The display interface 204 relays data transmission between the processor 201 and the display 13. Specifically, the display interface 204 outputs signals for displaying various information (for example, images showing work procedures, images showing work errors, etc.) to the display 13 in accordance with commands from the processor 201. Further, the display interface 204 outputs a signal instructing the end of display to the display 13 in accordance with a command from the processor 201.

The speaker interface 205 relays data transmission between the processor 201 and the speaker 16. Specifically, the speaker interface 205 outputs a signal for outputting sound to the speaker 16 according to a command from the processor 201.

The input interface 206 relays data transmission between the processor 201 and the input device 30. Specifically, the input interface 206 receives an operation command given by the operator operating the input device 30.

The program 222 is provided stored in a storage medium such as a memory card 207A. The program 222 is read from the memory card 207A by the memory card interface 207 and installed in the control device 20.

The program 222 may be provided not as a standalone program but as a part of any program. In this case, the processing according to this embodiment is realized in cooperation with an arbitrary program. Even a program that does not include such a part of modules does not depart from the spirit of the control device 20 according to the first embodiment. Further, some or all of the functions provided by the program 222 may be realized by dedicated hardware.

Furthermore, instead of installing the program 222 stored in the memory card 207A in the control device 20, a program downloaded from a distribution server or the like may be installed in the control device 20.

FIG. 3 is a diagram showing an example of a work procedure manual in the first embodiment. The work procedure manual 224 associates work names, process names, and text information indicating the contents of the work. That is, the work procedure manual 224 includes text information indicating the content of at least one work for each process. In the example shown in FIG. 3, the work procedure manual 224 includes text information TX1 as text information indicating the content of the work corresponding to work A, and text information TX2 as text information indicating the content of the work corresponding to work B. , includes text information TX3 as text information indicating the content of the work corresponding to work C. The text information TX1 includes the contents of the work corresponding to each of steps 1 to 10. The text information TX2 includes the contents of the work corresponding to each of steps 1 to 8. The text information TX3 includes the content of the work corresponding to each step of steps 1 to 9.

FIG. 4 is a diagram for explaining an overview of error notification processing performed by the error notification system in the first embodiment. The error notification process starts when a worker performs an operation that indicates the start of work (hereinafter also referred to as "start operation"), and an operation that indicates the end of work (hereinafter referred to as "end operation") is performed by the worker. ) is completed.

First, before starting work, the worker puts on the smart glasses 10 and turns on the smart glasses 10. Next, the operator uses the input device 30 to perform a start operation. As an example, when the smart glasses 10 are turned on, a list of work names whose work procedures are stored in the storage device 220 (for example, "Job A", "Job B", "Job C", etc.) and the start button is displayed on the display 13. The worker selects the name of the work to be performed by operating buttons provided on the input device 30, and presses the start button. This completes the start operation by the operator.

The identification unit 250 receives a start operation. The identification unit 250 is realized by the processor 201 executing the program 222. Upon receiving the start operation, the specifying unit 250 instructs the imaging device 14 to start imaging. The imaging device 14 starts imaging upon receiving an instruction from the specifying unit 250, and sequentially transmits the moving images obtained by the imaging to the control device 20.

When the identification unit 250 receives a video recording of the worker during the work from the imaging device 14, the identification unit 250 selects the name of the work selected in the start operation from the work procedure manual 224 stored in the storage device 220. Get the contents of the corresponding work. Next, the specifying unit 250 identifies the obtained work contents (that is, the work contents shown in the work procedure manual 224) and the work contents shown in the video recording of the worker during the work for each process. Compare and identify differences. In the following, the process of comparing the work content shown in the work procedure manual 224 and the work content shown in the video recording of the worker during the work for each process to identify differences will be described as "comparison". Also referred to as "processing".

In the comparison process, the identifying unit 250 identifies the process shown in the video based on the characteristic images included in the video received from the imaging device 14. The characteristic image includes at least one of an image of an apparatus used in each process, an image of an instrument used in each process, and an image of an identifier associated with each process. The identifiers associated with each process are, for example, barcodes, QR codes (registered trademarks), DataMatrix codes (registered trademarks), and the like. The identifier related to each step may be affixed to the device used in each step, or may be affixed to the instrument used in each step. Moreover, the identifier related to each process may be affixed to the workbench on which each process is performed.

Note that when the worker operates the input device 30 at the timing to start each process, the identifying unit 250 may identify the process shown in the video received from the imaging device 14 based on the operation. .

The identification unit 250 instructs the notification device 18 to notify an error every time a difference is identified in the comparison process. The notification device 18 receives an instruction from the specifying unit 250 and notifies the error for a predetermined period or a predetermined number of times. As an example, the display 13 displays an image indicating a work error for a predetermined period of time or a predetermined number of times. As another example, the speaker 16 outputs a sound indicating a work error for a predetermined period of time or a predetermined number of times.

Upon receiving the end operation, the specifying unit 250 instructs the imaging device 14 to end imaging. Thereby, the imaging device 14 ends imaging. As a result, the transmission of the moving image from the imaging device 14 to the control device 20 ends, and the error notification process ends.

Here, with reference to FIG. 3 again, details of the comparison process will be described using an example in which the name of the task selected in the start operation is "work A" shown in FIG. 3. First, upon receiving a video recording of a worker during work from the imaging device 14, the specifying unit 250 selects the contents of “work A” from the work procedure manual 224 stored in the storage device 220. The text information TX1 shown is acquired. Then, the identifying unit 250 sequentially compares the work content shown in the work procedure manual 224 with the work content shown in the video recording of the worker during the work, starting from step 1, and identifies differences. do.

Specifically, the identifying unit 250 reads numbers and characters included in the video corresponding to "Step 1" (hereinafter also referred to as "first video") among the videos received from the imaging device 14, and converts it into text. The identification unit 250 identifies the first video based on the characteristic images included in the video received from the imaging device 14 . For example, the first video includes an image of a container containing a sample. The identification unit 250 reads the numbers and characters (for example, the numbers of "identification number X1" and the characters "sample Y1") written on the label affixed to the container, and converts the read numbers and characters into text. .

The specifying unit 250 compares the numbers and characters converted into text with the numbers and characters included in the text information TX11, and determines whether they match. Text information TX11 indicates the content of the work corresponding to "Process 1" of "Work A" shown in FIG. 3. If the numbers and characters converted into text match the numbers and characters included in the text information TX11, the identification unit 250 determines, in step 1, the content of the work indicated in the work procedure manual 224 and the information currently being worked on. It is determined that the contents of the work shown in the recorded video of the worker match. On the other hand, if the numbers and characters converted into text do not match the numbers and characters included in the text information TX11, the identification unit 250 determines, in step 1, the content of the work indicated in the work procedure manual 224, It is determined that the content of the work shown in the recorded video of the worker during the work is different, and "Process 1" is identified as the different part.

The specifying unit 250 similarly performs the comparison process from "Step 2" to "Step 10". In addition, in a weighing process such as "Step 4" of "Work A" shown in FIG. 3, in the video corresponding to "Step 4" received from the imaging device 14, the LCD panel of the electronic balance used for weighing is Contains footage of. In such a case, the identifying unit 250 reads the number displayed on the liquid crystal panel (for example, the number of grams of sample Y1), converts it into text, and compares the converted number with the number included in the text information TX14. Compare and determine whether they match. The text information TX14 indicates the content of the work corresponding to "Step 4" of "Work A" shown in FIG. 3.

FIG. 5 is a diagram showing an example of an error notification in the first embodiment. Screen G1 is displayed on display 13. Screen G1 shows that when a worker is wearing smart glasses 10 and performing work according to the work procedure shown in image M, the identification unit 250 displays the content of the work shown in the work procedure manual 224 and the work in progress. Displayed when it is determined that the content of the work is different from the content of the work shown in the recorded video of the worker.

Screen G1 includes image M, image T, image E1, and image E2. Image M shows the work procedure. Image T shows the current time. Image E1 is an example of an error notification. Image E1 shows an error in the work. Image E2 shows the actual work content of the worker and the actions that the worker should do.

By displaying the image E1, the worker can notice at an early stage that he or she has made a work error. Further, by displaying the image E2, the worker can know the details of the work error and what actions to take from now on. Note that the screen G1 only needs to include at least the image E1. Further, when the identification unit 250 determines that the content of the work shown in the work procedure manual 224 is different from the content of the work shown in the video recording of the worker during the work, an error notification on the display 13 is sent. Alternatively, the speaker 16 may be used to notify the error. In addition, when the identification unit 250 determines that the content of the work shown in the work procedure manual 224 is different from the content of the work shown in the video recording of the worker during the work, the display 13 notifies the user of the error. , an error notification may be given by the speaker 16.

Note that the error notification by the display 13 may be in any manner as long as it visually notifies an error in the work, and is not limited to the manner shown in FIG. 5. Furthermore, the error notification by the speaker 16 may be in any form as long as it is an auditory notification of a work error. The speaker 16 may notify the work error by voice, or may notify the work error by a notification sound.

FIG. 6 is a flowchart showing the processing performed by the processor of the control device in the first embodiment. In step S1, the processor 201 receives a start operation from the input device 30.

In step S2, the processor 201 instructs the imaging device 14 to start imaging. Thereby, the imaging device 14 starts imaging and sequentially transmits the moving images obtained by imaging to the control device 20.

Step S3 is the above-mentioned comparison process. In step S3, the processor 201 determines the content of the work corresponding to the name of the work selected by the worker in the start operation (that is, the content of the work indicated in the work procedure manual 224) and the state of the worker during the work. Compare the details of the work shown in the recorded video for each process.

In step S4, the processor 201 determines whether there is any difference between the content of the work shown in the work procedure manual 224 and the content of the work shown in the video recording of the worker during the work. If the processor 201 determines that there is a difference between the content of the work shown in the work procedure manual 224 and the content of the work shown in the video recording of the worker during the work (YES in step S4), ), the process advances to step S5. On the other hand, if the processor 201 determines that there is no difference between the content of the work shown in the work procedure manual 224 and the content of the work shown in the video recording of the worker during the work (step S4 (NO), the process advances to step S6.

In step S5, the processor 201 instructs the notification device 18 to notify the error.

In step S6, the processor 201 determines whether an end operation has been received. If the processor 201 determines that the end operation has been accepted (YES in step S6), the process proceeds to step S7. On the other hand, if the processor 201 determines that the termination operation has not been accepted (NO in step S6), the process returns to step S3.

In step S7, the processor 201 instructs the imaging device 14 to end imaging. After step S7, the processor 201 ends the series of processes shown in FIG.

As described above, the error notification system 1 in the first embodiment includes the smart glasses 10 and the control device 20 that controls the smart glasses 10. The control device 20 compares the content of the work including at least one process shown in the work procedure manual 224 and the content of the work shown in the video recording of the worker during the work for each process, and identifies differences. Identify. The smart glasses 10 include a notification device 18 that notifies an error when a difference is identified. As a result, if the worker takes an action that differs from the content of the work indicated in the work procedure manual 224, an error will be notified. Therefore, the worker can notice at an early stage that he or she has made a work error. Furthermore, the fact that a worker can notice a work error at an early stage means that there is almost no need to spend time investigating where the mistake occurred, leading to a reduction in investigation time.

Furthermore, there is no need to predetermine error judgment conditions for detecting work errors. Therefore, time spent studying error determination conditions can be reduced.

Furthermore, since error judgment conditions are constructed based on personal experience and judgment, when detecting work errors based on error judgment conditions, only work mistakes that depend on personal experience and judgment can be detected. However, according to the error notification system 1 in the first embodiment, an error is notified when the worker takes an action that differs from the content of the work indicated in the work procedure manual 224. It is also possible to detect errors in work that cannot be done.

Note that if an imaging device capable of capturing an image of the worker's hand that is in front of the worker's line of sight is installed in the room where the work is performed, the control device 20 records the state of the worker during the work. A moving image may be acquired from the imaging device. Further, when the control device 20 acquires a video recording of the worker's state while working from an imaging device installed in the room where the work is performed, the smart glasses 10 do not include the imaging device 14. Good too.

Furthermore, based on the video received from the imaging device 14, the identifying unit 250 may identify the name of the work shown in the video. Specifically, the identifying unit 250 reads work identification information (for example, work name, work identification number, etc.) included in the video received from the imaging device 14, and identifies the name of the work shown in the video. You may.

In addition, after a difference is identified in the comparison process, the notification device 18 sends information about the difference between the content of the work shown in the work procedure manual 224 and the work shown in the recorded video of the worker during the work. The warning may continue to be issued until the contents match. In such a case, the identification unit 250 determines whether the content of the work shown in the work procedure manual 224 and the content of the work shown in the video recording of the worker during the work match with respect to the different parts. Whether this is the case is determined based on the moving image received from the imaging device 14. If the identification unit 250 determines that the content of the work shown in the work procedure manual 224 and the content of the work shown in the video recording of the worker during the work match regarding the difference part, the notification device 18 to end the error notification.

Furthermore, the error notification system 1 may be configured so that error notification can be stopped by the operator's operation of the input device 30.

Furthermore, the smart glasses 10 do not need to include the speaker 16. If the smart glasses 10 do not include a speaker 16, the display 13 will notify you of the error.

[Embodiment 2]
The configuration of the error notification system in Embodiment 2 is similar to the configuration of error notification system 1 in Embodiment 1, so the same configurations are denoted by the same reference numerals and the description thereof will not be repeated. In the error notification system 1 in the first embodiment, error notification processing is performed. On the other hand, in the error notification system 1 according to the second embodiment, in addition to the error notification process, there is also an update process that updates the number of error occurrences, and a preliminary warning process that issues a warning when a process in which many errors occur is started. and is further carried out.

FIG. 7 is a diagram for explaining an overview of the processing performed by the error notification system in the second embodiment. The process shown in FIG. 7 includes an update process and a advance warning process in addition to the error notification process described in the first embodiment. Here, only the update process and advance warning process will be explained, and the error notification process explained in FIG. 4 will not be repeated.

First, update processing will be explained. The update process is to update the number of error occurrences stored in the storage device 220. The storage device 220 stores the number of error occurrences for each process. The number of error occurrences is included in a history table 226 stored in the storage device 220. Here, the history table 226 will be explained with reference to FIG. FIG. 8 is a diagram showing an example of a history table in the second embodiment. The history table 226 associates work names, process names, and the number of error occurrences.

Referring again to FIG. 7, in the above-described comparison process, each time a process is identified as a difference, the identifying unit 250 performs an update process to update the error information corresponding to the process included in the history table 226. Add 1 to the number of occurrences. Through such update processing, the number of error occurrences is accumulated in the history table 226.

Next, advance warning processing will be explained. The advance warning process is to notify a warning when a process is started in which the number of errors has occurred a predetermined number of times or more. The advance warning process is repeatedly performed from when a start operation is input to when an end operation is input by the operator.

In detail, first, when detecting a change in the work process, the identifying unit 250 acquires the number of error occurrences of the process to be started from the history table 226.

The identification unit 250 identifies a change in the work process based on the characteristic images included in the video received from the imaging device 14. The characteristic image includes at least one of an image of an apparatus used in each process, an image of an instrument used in each process, and an image of an identifier associated with each process. The identifiers associated with each process are, for example, barcodes, QR codes, DataMatrix codes, and the like. The identifier related to each step may be affixed to the device used in each step, or may be affixed to the instrument used in each step. Moreover, the identifier related to each process may be affixed to the workbench on which each process is performed. Note that when the worker operates the input device 30 at the timing to start each process, the identification unit 250 may identify the switching of the work process based on the operation.

Next, the identifying unit 250 determines whether the obtained number of error occurrences is equal to or greater than a predetermined number. The specifying unit 250 instructs the notification device 18 to notify a warning when the obtained number of error occurrences is equal to or greater than a predetermined number. The notification device 18 receives an instruction from the specifying unit 250 and notifies the warning for a predetermined period or a predetermined number of times. As an example, the display 13 displays an image indicating a warning for a predetermined period of time or a predetermined number of times. As another example, the speaker 16 outputs a sound indicating a warning for a predetermined period of time or a predetermined number of times.

Note that the notification device 18 may continue to notify the warning while the worker is performing a process in which the number of errors has occurred a predetermined number of times or more. Furthermore, the error notification system 1 may be configured to be able to stop notification of warnings by operating the input device 30 by the operator.

FIG. 9 is a diagram showing an example of a warning notification in the second embodiment. Screen G2 is displayed on display 13. Screen G2 is displayed when the identification unit 250 determines that the number of errors in the process to be started is greater than or equal to a predetermined number when the worker is wearing the smart glasses 10 and is performing or about to start the work. Displayed when

Screen G2 includes image M, image T, and image E21. Image M shows the work procedure of the process to be started. Image T shows the current time. Image E21 is an example of a warning notification. Image E21 indicates that this is a process that requires caution.

By displaying the image E21, it is possible to alert the operator. Note that the screen G2 only needs to include at least the image E21. Furthermore, when the specifying unit 250 determines that the number of error occurrences in the process to be started is equal to or greater than a predetermined number, a warning notification may be provided by the speaker 16 instead of the warning notification by the display 13. Furthermore, when the specifying unit 250 determines that the number of error occurrences in the process to be started is equal to or greater than a predetermined number, a warning notification may be provided by the speaker 16 in addition to the warning notification by the display 13.

It should be noted that the warning notification by the display 13 may be in any form as long as it provides a visual warning that the process requires attention, and is not limited to the form shown in FIG. 9. Further, the warning notification from the speaker 16 may be in any form that provides an auditory warning that the process requires attention, and may output audible information from the speaker 16 that the process requires attention. . Further, a notification sound indicating that a process requires attention may be determined in advance, and the notification sound may be output from the speaker 16.

Further, when the identification unit 250 determines that the number of errors in the process to be started is equal to or greater than a predetermined number, the notification device 18 may further notify the number of errors in the process in addition to the warning. . As an example, the display 13 may display an image indicating a warning and the number of errors in the process to be started. As another example, the speaker 16 may output a warning and the number of errors in the process to be started in audible form. As another example, a notification sound may be determined in advance according to the number of times an error has occurred, and the notification sound may be outputted from the speaker 16 according to the number of times an error has occurred in the process to be started.

FIG. 10 is a flowchart showing the processing performed by the processor of the control device in the second embodiment. In FIG. 10, steps S2A to S2C and S5A are added to the flowchart shown in FIG. Among the processes shown in FIG. 10, the same steps as those shown in FIG. 6 are given the same step numbers, and the description will not be repeated.

After instructing the imaging device 14 to start imaging, the processor 201 determines in step S2A whether or not a change in work process has been detected. If the processor 201 determines that a change in work process has been detected (YES in step S2A), the process proceeds to step S2B. On the other hand, if the processor 201 determines that no change in work process has been detected (NO in step S2A), the process proceeds to step S3.

In step S2B, the processor 201 determines whether the number of error occurrences in the process to be started is greater than or equal to a predetermined number. If the processor 201 determines that the number of error occurrences in the process to be started is equal to or greater than the predetermined number (YES in step S2B), the processor 201 advances the process to step S2C. On the other hand, if the processor 201 determines that the number of error occurrences in the process to be started is not greater than or equal to the predetermined number (NO in step S2B), the process proceeds to step S3.

In step S2C, the processor 201 instructs the notification device 18 to notify a warning. Step S2A, step S2B, and step S2C correspond to the advance warning process described above.

Thereafter, when an error notification instruction is given to the notification device 18 in step S5, the processor 201 updates the number of error occurrences in step S5A. Step S5A corresponds to the update process described above. The number of error occurrences updated in step S5A is used in step S2B described above.

In this way, the error notification system 1 in the second embodiment executes the error notification process described in the first embodiment. Therefore, the error notification system 1 in the second embodiment also has the effects described in the first embodiment. Furthermore, the error notification system 1 in the second embodiment further executes an update process for updating the number of error occurrences, and a pre-warning process for issuing a warning when a process in which the number of error occurrences is equal to or greater than a predetermined number is started. As a result, in the error notification system 1 according to the second embodiment, a warning is issued when a process in which an error has occurred a predetermined number of times or more is started. Therefore, in a process where errors occur frequently, the worker's attention can be called to attention, leading to a reduction in work errors.

In the above example, the error notification system 1 according to the second embodiment notifies a warning when a process is started in which the number of error occurrences is equal to or more than a predetermined number of times, but the error notification system 1 according to the second embodiment A warning may be notified when a process is started in which the number of occurrences of errors with the same content is equal to or greater than a predetermined number of times. In such a case, as shown in FIG. 11, the storage device 220 stores the number of error occurrences for each error content. FIG. 11 is a diagram showing another example of the history table in the second embodiment. The history table 226A is stored in the storage device 220 instead of the history table 226 described above. The history table 226A associates work names, process names, error details, and the number of error occurrences. The history table 226A forms one record for each type of error, and the record includes the name of the work, the name of the process, the content of the error, and the number of times the error has occurred. Therefore, a plurality of records may exist for one process, such as "Step 2" of "Work A" shown in FIG. 11 and "Step 3" of "Work C" shown in FIG. 11. Furthermore, if no error has occurred in a single process, such as in "Process 1" and "Process 2" of "Work C" shown in FIG. 11, no record exists.

The updating process of the history table 226A is performed by the specifying unit 250 as follows. In the above-described comparison process, the specifying unit 250 further specifies the content of the error every time one process is specified as a different location. The specifying unit 250 specifies the content of the error based on a partial video indicating a different part of the video recorded from the imaging device 14 showing the state of the worker during work. As an example, if the identification unit 250 determines that the reagent taken out from the storage is different from the reagent shown in the work procedure manual 224 from the partial video showing the difference, the identification unit 250 may change the content of the error to "reagent removal". ``Mistaken''. Furthermore, when determining from the partial video showing the difference that the amount of the weighed reagent is different from the amount shown in the work procedure manual 224, the identifying unit 250 identifies a "reagent weighing error." In addition, when the identification unit 250 determines from the partial video showing the difference that a part of the weighed reagent remains on the paper used for weighing and the entire amount of the weighed reagent has not been put into the volumetric flask. This is identified as a "reagent injection error."

The identification unit 250 refers to each record in the history table 226A and identifies the name of the work selected by the operator in the start operation, the process name indicating the one process identified as the difference, and the details of the identified error. Add 1 to the number of errors in the record. Note that if the history table 226A does not include a record including the name of the work selected by the operator in the start operation, the process name indicating the one process identified as the difference, and the details of the identified error, In this case, the specifying unit 250 adds a new record to the history table 226A, and sets the number of error occurrences of the record to 1.

Pre-warning processing when the storage device 220 stores the number of error occurrences for each error content is performed by the specifying unit 250 as follows. When the identification unit 250 detects a change in the work process, it refers to the history table 226A and identifies all records corresponding to the process to be started. As an example, if the process to be started is "Process 2" of "Work A" shown in FIG. Identify. Next, the identifying unit 250 determines whether at least one of the identified records includes a predetermined number of errors or more. The specifying unit 250 instructs the notification device 18 to notify a warning when at least one of the specified records includes a predetermined number of error occurrences or more. On the other hand, if none of the identified records includes a predetermined number of error occurrences or more, the identifying unit 250 ends the preliminary warning process without instructing the notification device 18 to notify the warning. Furthermore, even when the history table 226A does not include a record corresponding to the process to be started, the specifying unit 250 ends the advance warning process without instructing the notification device 18 to notify the warning.

As a result, a warning is issued when a process is started in which an error with the same content has occurred a predetermined number of times or more. Therefore, in a process where errors with the same content occur frequently, the operator's attention can be called to attention, leading to a reduction in work errors. Note that when a process is started in which the number of occurrences of errors with the same content is equal to or greater than a predetermined number of times, the notification device 18 may further notify the number of occurrences of errors with the content in addition to the warning.

[Embodiment 3]
The error notification system in Embodiment 3 further includes an external output device. Among the configurations of the error notification system in Embodiment 3, the same components as in the configuration of error notification system 1 in Embodiment 1 are given the same reference numerals, and the description thereof will not be repeated.

FIG. 12 is a diagram showing an overview of the error notification system in the third embodiment. The error notification system 1A includes smart glasses 10, a control device 20A, an input device 30, and an external output device 500. The control device 20A can communicate with the smart glasses 10, the input device 30, and the external output device 500 through wired or wireless communication. The external output device 500 outputs error information regarding a work mistake made by a worker.

FIG. 13 is a diagram showing an example of the configuration of a control device in Embodiment 3. The control device 20A includes the components included in the control device 20 described above, and further includes a communication interface 208. Communication interface 208 communicates with external output device 500 via the network. As an example, communication interface 208 transmits error information to external output device 500.

FIG. 14 is a diagram showing an example of the configuration of an external output device in Embodiment 3. External output device 500 includes a processor 501 , a main memory 502 , a communication interface 503 , a display interface 504 , a display 505 , an input interface 506 , an input device 507 , and a storage device 520 . Processor 501, main memory 502, communication interface 503, display interface 504, input interface 506, and storage device 520 are communicably connected to each other via internal bus 599.

The processor 501 is configured by, for example, at least one integrated circuit. The integrated circuit is configured, for example, by at least one CPU, at least one ASIC, at least one FPGA, or a combination thereof.

The processor 501 implements various processes by loading the program 522 stored in the storage device 520 into the main memory 502 and executing it. The main memory 502 is made up of volatile memory and functions as a work memory necessary for the processor 501 to execute programs.

The storage device 520 is composed of nonvolatile memory. Alternatively, the storage device 520 may be, for example, a hard disk, an SSD, or the like, and may be either a built-in type or an external type. The storage device 520 stores a program 522 and various data (for example, error information 228 received from the control device 20A, etc.) for implementing various processes according to the present embodiment.

The communication interface 503 communicates with the control device 20A via the network. As an example, the communication interface 503 receives error information 228 from the control device 20A.

Display interface 504 relays data transmission between processor 501 and display 505. Specifically, display interface 504 outputs signals for displaying various information (for example, error information 228, etc.) to display 505 in accordance with commands from processor 501. Further, the display interface 504 outputs a signal instructing the end of the display to the display 505 in accordance with a command from the processor 501. Display 505 displays various types of information (eg, error information 228, etc.) according to signals received from display interface 504.

The input interface 506 relays data transmission between the processor 501 and the input device 507. Specifically, the input interface 506 receives an operation command given by the operator operating the input device 507. The input device 507 is an example of a "reception device." The input device 507 accepts editing of error information by the user. The user includes at least one of a worker and a manager. Input device 507 includes, for example, a keyboard and a mouse.

The program 522 may be provided not as a standalone program but as a part of any program. In this case, the processing according to this embodiment is realized in cooperation with an arbitrary program. Even a program that does not include such a part of the module does not deviate from the spirit of external output device 500 according to the third embodiment. Further, some or all of the functions provided by the program 522 may be realized by dedicated hardware.

FIG. 15 is a diagram for explaining an overview of the processing performed by the error notification system in the third embodiment. The processing shown in FIG. 15 includes error information output processing in addition to the error notification processing described in the first embodiment. Here, only the error information output process will be explained, and the explanation of the error notification process explained with reference to FIG. 4 will not be repeated.

The identification unit 250A is realized by the processor 201 executing the program 222. The identifying unit 250A executes the processing performed by the identifying unit 250 described above. Further, the identifying unit 250A stores the error information 228 in the storage device 220, and transmits the error information 228 to the external output device 500 after completing the work.

Specifically, the specifying unit 250A stores error information 228 in the storage device 220 every time a difference is specified in the above-described comparison process. Storage device 220 stores error information 228. The error information 228 includes information regarding a work mistake made by the worker. The error information 228 includes at least the name of the work for which the error was notified. As an example, if the name of the work selected by the worker in the start operation is "Work A" shown in FIG. 3, and an error is notified, the name of the work for which the error was notified is "Work A". ”.

The error information 228 includes the execution date of the work for which the error was notified, the start time of the work, the process name indicating the process identified as the difference, the content of the error, and the worker who is performing the work received from the imaging device 14. It may further include at least one of a partial video showing a different part of the recorded video of the situation, and a time at which the partial video was shot. When the process identified as a different location in the comparison process is "Process 3", the process name indicating the process identified as a different location is "Process 3".

Note that the error information 228 only needs to include information regarding a work error by the worker, and is not limited to the information listed above. Further, the content of the error is specified by the specifying unit 250A using the method described in the second embodiment.

When the specifying unit 250A receives an end operation indicating the end of the work, it transmits the error information 228 stored in the storage device 220 regarding the work to the external output device 500. External output device 500 outputs error information 228 according to the user's operation. As an example, the display 505 of the external output device 500 displays error information 228.

After transmitting the error information 228 to the external output device 500, the identifying unit 250A may or may not erase the error information 228 from the storage device 220. If the error information 228 is deleted from the storage device 220 after being transmitted to the external output device 500, the limited storage capacity of the storage device 220 can be effectively utilized.

FIG. 16 is a flowchart showing the processing performed by the processor of the control device in the third embodiment. In the flowchart of FIG. 16, steps S5B and S8 are added to the flowchart of FIG. Among the processes shown in FIG. 16, the same steps as those shown in FIG. 6 are given the same step numbers, and the description will not be repeated.

When the error notification instruction is given to the notification device 18 in step S5, the processor 201 stores the error information 228 in the storage device 220 in step S5B.

Then, when the imaging device 14 is instructed to end imaging in step S7, the processor 201 instructs the communication interface 208 to transmit the error information 228 to the external output device 500 in step S8.

After step S8, the communication interface 208 transmits the error information 228 to the external output device 500. Error information 228 is received by communication interface 503 of external output device 500. Processor 501 stores error information 228 received from control device 20A in storage device 520. When the user performs an operation using the input device 507 to instruct the display 505 to display the error information 228, the processor 501 instructs the display 505 to display the error information 228. As a result, error information 228 is displayed on display 505.

FIG. 17 is a diagram showing an example of error information displayed on the display of the external output device in the third embodiment. Screen G3 is displayed on display 505. Screen G3 is displayed when the user performs an operation using input device 507 to instruct display of error information 228 on display 505.

Screen G3 includes image K1, image K2, image K3, image K4, and image K5. Image K1, image K2, image K3, image K4, and image K5 are examples of error information. Image K1 shows the name of the work for which the error was notified. Image K2 shows the start date and time of the work for which the error was notified. Image K3 shows the content of the error identified by the identifying unit 250A. Image K4 shows the time when the error occurred. The error occurrence time may be the time at which a partial video showing the difference in the video received from the imaging device 14 and showing the state of the worker during work was taken, or the time when the partial video is recorded by the control device. The time that 20A receives from the imaging device 14 may be used. The image K5 is a partial video showing a different part of the video recorded from the imaging device 14 showing the state of the worker during work. By clicking on image K5, the partial video is played back.

Since the error information 228 includes information regarding mistakes in work by the worker, it can be said that the error information 228 is information necessary for investigating the cause when an error occurs in work. Therefore, the user can obtain information necessary for investigating the cause of an error occurring in the work simply by checking the screen G3.

Note that the screen G3 may be output on paper from a printer that can communicate with the external output device 500. Further, the external output device 500 may be configured so that the error information 228 can be edited by the user. As an example, when the user performs an operation using the input device 507 to instruct the editing of the error information 228, the processor 501 edits the error information 228 according to the operation. Editing the error information 228 includes at least one of deleting, adding, and modifying the error information 228.

In this way, the error notification system 1A in the third embodiment executes the error notification process described in the first embodiment. Therefore, the error notification system 1A in the third embodiment also has the effects described in the first embodiment. Furthermore, the error notification system 1A in the third embodiment further executes error information output processing. Thereby, in the error notification system 1A according to the third embodiment, the user can confirm the error information 228. Since the error information 228 includes information regarding mistakes made by the worker in the work, the user can obtain the information necessary to investigate the cause when an error occurs in the work simply by checking the error information 228. I can do it. Therefore, the time required to investigate the cause of an error can be reduced.

Note that the timing at which the error information 228 is transmitted to the external output device 500 is not limited to after the work is completed. Error information 228 may be sent to external output device 500 during work. Further, the error information 228 may be transmitted to the external output device 500 while the smart glasses 10 are being charged. Further, the error information 228 may be transmitted to the external output device 500 when the operator uses the input device 30 to instruct transmission.

Furthermore, the error notification system 1A may further execute the update process and advance warning process described in the second embodiment.

In addition, if the error information includes a partial video indicating a different part of the video recorded from the image capturing device 14 of the worker during work, the error notification system 1A allows the worker to It may be configured to issue a warning when the user takes an action similar to the action shown in .

[Other variations]
In the above embodiment, the smart glasses 10 employ a binocular display, but a monocular display may be employed. When a binocular display is employed in the smart glasses 10, it is possible to reduce eye strain on the user's eyes even when viewing high-resolution images. On the other hand, when the smart glasses 10 employ a single-eye display, the weight of the smart glasses 10 can be reduced. Furthermore, the display 13 may or may not be removable from the protective glasses 11. Further, the smart glasses 10 may include a screen instead of the display 13. When a screen is employed in the smart glasses 10, the smart glasses 10 are further provided with a projection device that projects a moving image onto the screen. The processor 201 controls the display on the screen by controlling the projection by the projection device.

In the above embodiment, the control devices 20 and 20A were provided in a separate housing from the smart glasses 10, but they may be provided in the same housing as the smart glasses 10. Further, in the above embodiment, the input device 30 is provided in a separate housing from the smart glasses 10, but it may be provided in the same housing as the smart glasses 10.

In the above embodiment, the wearable device is a glasses-type (including goggle-type) wearable device (smart glasses), but it may also be a helmet-type wearable device. Further, the wearable device is not limited to a head-mounted type such as a glasses type or a helmet type, but may be a wristband type or a pendant type wearable device.

[Mode]
It will be appreciated by those skilled in the art that the exemplary embodiments described above are specific examples of the following aspects.

(Section 1) An error notification system according to one aspect includes a wearable device and a control device that controls the wearable device. The control device compares the content of the work including at least one process shown in the work procedure manual with the content of the work shown in the video recording of the worker during the work for each process to identify differences. do. The wearable device includes a notification device that notifies an error when a difference is identified.

According to the error notification system described in Section 1, the content of the worker's work is shown in the work procedure manual from a video recorded while the worker wears a wearable device and performs the work. The control device specifies whether the work content matches the work content, and if the worker takes an action that differs from the work content shown in the work procedure manual, an error is notified to the worker's wearable device. Therefore, the worker can notice at an early stage that he or she has made a work error. Furthermore, the fact that a worker can notice a work error at an early stage means that there is almost no need to spend time investigating where the mistake occurred, leading to a reduction in investigation time.

Furthermore, there is no need to predetermine error judgment conditions for detecting work errors. Therefore, time spent studying error determination conditions can be reduced.

Furthermore, since error judgment conditions are constructed based on personal experience and judgment, when detecting work errors based on error judgment conditions, only work mistakes that depend on personal experience and judgment can be detected. However, according to the error notification system described in Section 1, if a worker takes an action that differs from the content of the work indicated in the work procedure manual, an error will be notified. It is also possible to detect errors in work that cannot be done.

(Section 2) In the error notification system described in Section 1, the control device further includes a storage device that stores the number of times errors occur for each process. The notification device notifies a warning when a process is started in which the number of errors has occurred a predetermined number of times or more.

According to the error notification system described in item 2, a warning is notified when a process in which an error has occurred a predetermined number of times or more is started. Therefore, in a process where errors occur frequently, the worker's attention can be called to attention, leading to a reduction in work errors.

(Section 3) In the error notification system described in Section 1, the control device further includes a storage device that stores the number of times the same error has occurred. The notification device notifies a warning when a process is started in which the number of errors has occurred a predetermined number of times or more.

According to the error notification system described in Section 3, a warning is notified when a process is started in which an error with the same content has occurred a predetermined number of times or more. Therefore, in a process where errors with the same content occur frequently, the operator's attention can be called to attention, leading to a reduction in work errors.

(Section 4) In the error notification system described in Section 2 or 3, the notification device includes a display device that visually notifies errors and warnings.

According to the error notification system described in Section 4, a worker can easily recognize errors and warnings.

(Section 5) In the error notification system described in Section 2 or 3, the notification device includes a speaker that audibly notifies errors and warnings.

According to the error notification system described in Section 5, a worker can easily recognize errors and warnings.

(Section 6) In the error notification system described in Section 5, the speaker notifies errors and warnings by voice.

According to the error notification system described in Section 6, a worker can easily recognize errors and warnings.

(Section 7) In the error notification system described in Section 5, the speaker notifies errors and warnings with notification sounds.

According to the error notification system described in Section 7, a worker can easily recognize errors and warnings.

(Paragraph 8) In the error notification system according to any one of Paragraphs 2 to 7, when a process is started in which the number of error occurrences is equal to or greater than a predetermined number, the notification device is configured to notify the number of error occurrences. Further notice.

According to the error notification system described in Section 8, it is possible to further arouse the worker's attention.

(Section 9) In the error notification system according to any one of Items 1 to 8, the error notification system is configured to be able to communicate with a control device, and further includes an external output device that outputs error information. . The error information includes information regarding a work mistake made by a worker.

According to the error notification system described in Section 9, the user can check error information. Since the error information includes information about mistakes made by the worker, the user can obtain the information necessary to investigate the cause of an error in the work simply by checking the error information. . Therefore, the time required to investigate the cause of an error can be reduced.

(Section 10) In the error notification system described in Section 9, the control device identifies the content of the error based on a partial video showing a different part of the video. The error information further includes error details specified by the control device.

According to the error notification system described in Section 10, the user can easily know the details of the error.

(Section 11) In the error notification system described in Section 10, the error information further includes the time at which the partial video was shot.

The time when the partial video was shot and the time when the error occurred are almost the same. According to the error notification system described in Section 11, a user can easily know the time when an error occurs.

(Section 12) In the error notification system described in Section 10 or 11, the error information further includes a partial video.

According to the error notification system described in Section 12, the user can easily view the partial video showing the difference.

(Section 13) In the error notification system according to any one of Items 9 to 12, the external output device further includes a reception device that accepts editing of error information by a user.

According to the error notification system described in Section 13, the user can edit error information.

(Section 14) In the error notification system according to any one of Items 1 to 13, the control device identifies a process shown in the video based on a characteristic image included in the video. The characteristic image includes at least one of an image of an apparatus used in each process, an image of an instrument used in each process, and an image of an identifier associated with each process.

According to the error notification system described in Section 14, the worker does not need to perform an operation to notify a process change at the timing of starting each process, so the worker's effort can be saved.

(Section 15) In the error notification system according to any one of Items 1 to 14, the wearable device further includes an imaging device that photographs the worker's work.

According to the error notification system described in item 15, it becomes easier to photograph the situation at the worker's hand.

(Section 16) In the error notification system according to any one of Items 1 to 15, the wearable device is smart glasses.

According to the error notification system described in Section 16, convenience for workers is improved.

(Section 17) A control device according to one embodiment controls a wearable device. The control device compares the content of the work including at least one process shown in the work procedure manual with the content of the work shown in the video recording of the worker during the work for each process to identify differences. do. The wearable device includes a notification device that notifies an error when a difference is identified.

According to the control device described in item 17, the work is performed in which the work details of the worker are shown in the work procedure manual from a video recorded while the worker wears a wearable device and performs the work. The control device specifies whether the content matches the content, and if the worker takes an action that differs from the content of the work indicated in the work procedure manual, an error is notified to the worker's wearable device. Therefore, the worker can notice at an early stage that he or she has made a work error. Furthermore, the fact that a worker can notice a work error at an early stage means that there is almost no need to spend time investigating where the mistake occurred, leading to a reduction in investigation time.

Furthermore, there is no need to predetermine error judgment conditions for detecting work errors. Therefore, time spent studying error determination conditions can be reduced.

Furthermore, since error judgment conditions are constructed based on personal experience and judgment, when detecting work errors based on error judgment conditions, only work mistakes that depend on personal experience and judgment can be detected. However, according to the control device described in Section 17, if a worker takes an action that differs from the content of the work indicated in the work procedure manual, an error is notified, so it cannot be detected using the error judgment condition. It is also possible to detect work errors.

The embodiments disclosed this time should be considered to be illustrative in all respects and not restrictive. The scope of the present invention is indicated by the claims rather than the above description, and it is intended that equivalent meanings and all changes within the scope of the claims are included.

1, 1A Error notification system, 10 Smart glasses, 11 Protective glasses, 13, 13a, 13b, 505 Display, 14 Imaging device, 15a, 15b Mounting part, 16 Speaker, 18 Notification device, 20, 20A Control device, 30, 507 Input device, 201,501 Processor, 202,502 Main memory, 203 Camera interface, 204,504 Display interface, 205 Speaker interface, 206,506 Input interface, 207 Memory card interface, 207A Memory card, 208,503 Communication interface, 220 , 520 Storage device, 222, 522 Program, 224 Work procedure manual, 226, 226A History table, 228 Error information, 250, 250A Specification section, 299, 599 Internal bus, 500 External output device, E1, E2, E21, K1, K2, K3, K4, K5, M, T image, G1, G2, G3 screen, TX1, TX2, TX3, TX11, TX14 text information.

Claims (17)

1. wearable devices and
   and a control device that controls the wearable device,
   The control device compares the content of the work including at least one process shown in the work procedure manual and the content of the work shown in the video recording of the state of the worker during the work for each process to identify differences. identify,
   The wearable device is an error notification system including a notification device that notifies an error when the difference is identified.
2. The control device further includes a storage device that stores the number of error occurrences for each process,
   The error notification system according to claim 1, wherein the notification device issues a warning when a process is started in which the number of times the error occurs is equal to or greater than a predetermined number of times.
3. The control device further includes a storage device that stores the number of times an error with the same content has occurred,
   The error notification system according to claim 1, wherein the notification device issues a warning when a process is started in which the number of times the error occurs is equal to or greater than a predetermined number of times.
4. The error notification system according to claim 2 or 3, wherein the notification device includes a display device that visually notifies the error and the warning.
5. The error notification system according to claim 2 or 3, wherein the notification device includes a speaker that audibly notifies the error and the warning.
6. The error notification system according to claim 5, wherein the speaker notifies the error and the warning by voice.
7. The error notification system according to claim 5, wherein the speaker notifies the error and the warning with a notification sound.
8. The error notification system according to claim 2 or 3, wherein the notification device further notifies the number of error occurrences when a process is started in which the number of error occurrences is equal to or greater than the predetermined number of times.
9. The error notification system further includes an external output device that is configured to be able to communicate with the control device and outputs error information,
   The error notification system according to any one of claims 1 to 3, wherein the error information includes information regarding a work mistake made by the worker.
10. The control device identifies the content of the error based on a partial video showing the different part of the video,
    The error notification system according to claim 9, wherein the error information further includes the error content specified by the control device.
11. The error notification system according to claim 10, wherein the error information further includes a time when the partial video was shot.
12. The error notification system according to claim 10, wherein the error information further includes the partial video.
13. The error notification system according to claim 9, wherein the external output device further includes a reception device that accepts editing of the error information by a user.
14. The control device specifies a process shown in the video based on a characteristic image included in the video,
    Any one of claims 1 to 3, wherein the characteristic image includes at least one of an image of an apparatus used in each process, an image of an instrument used in each process, and an image of an identifier related to each process. The error notification system described in Section 1.
15. The error notification system according to any one of claims 1 to 3, wherein the wearable device further includes an imaging device that photographs the worker's work.
16. The error notification system according to any one of claims 1 to 3, wherein the wearable device is smart glasses.
17. A control device that controls a wearable device,
    Compare the content of the work including at least one process shown in the work procedure manual and the content of the work shown in the video recording of the worker during the work for each process to identify differences,
    The wearable device is a control device including a notification device that notifies an error when the difference is identified.

Images