JP2018073155A - Work support system - Google Patents

Abstract

PROBLEM TO BE SOLVED: To provide a work support system capable of allowing a worker to engage in work while allowing the worker to understand whether or not work of the operator is appropriate.SOLUTION: Each of the terminal devices 11 a, 11 b, 11c, (a) in the images of the working areas 1a, 1b, 1c imaged by the corresponding imaging devices 12a, 12b, 12c, provides work support information to the corresponding workers 2a, 2b, 2c based on the process data, after detecting a specific before-process marker image corresponding to the work object 3 in the process, and (b) after providing the work support information to the workers 2a, 2b, 2c, in the images of the working areas 1a, 1b, 1c imaged by the imaging devices 12a, 12b, 12c, notifies the completion of the process to the corresponding workers 2a, 2b, 2c when a specific after-process marker image corresponding to the work object 3 in the process is detected.SELECTED DRAWING: Figure 1

Description

  The present invention relates to a work support system.

  An electronic device such as a multi-function machine is composed of a large number of parts, and a plurality of workers work in a production line to assemble such electronic devices.

  Even if a plurality of tasks are divided, each task requires skill and takes time to educate workers. For this reason, there is an attempt to introduce a robot for each operation, but it is practically difficult to perform a complicated process with the robot. In addition, there is a method of simplifying each work and dividing it into more processes, but in this method, it is necessary to arrange many workers on the production line, securing workers, securing the area of the production line, There are problems such as labor costs for workers. Therefore, skilled workers are preferable in order to produce electronic devices efficiently and at low cost.

  On the other hand, in recent years, high-mix, low-volume production that produces small quantities of various products in accordance with customer needs has been emphasized. In such multi-product small-volume production, the work contents change as the product type changes, making it difficult to achieve division of labor by skilled workers. Therefore, it is preferable that workers other than skilled workers can perform relatively complicated work.

  In a work support system, a worker's terminal displays a work procedure and a work instruction on a worker's head-mounted display (see, for example, Patent Document 1).

JP 2004-102727 A

  However, although the work support system described above can provide work procedures and work instructions to workers, each worker cannot know whether the work he / she actually performs is appropriate or not. There is a possibility that a work error is included in the work of each worker. Such work errors may cause work delays in subsequent processes, product defects, and the like.

  The present invention has been made in view of the above problems, and an object of the present invention is to obtain a work support system capable of engaging in a work while allowing the worker to understand whether or not the work of the worker is appropriate. And

  The work support system according to the present invention is arranged with respect to a work area in a production line, and based on the process data, the work support information for supporting the work of a worker for the process to be executed in the work area. And a management server that provides the process data to the terminal device, and further includes an imaging device that repeatedly images the work area from a predetermined fixed position. The terminal device (a) detects a specific pre-process marker image corresponding to the work object of the process in the image of the work area imaged by the imaging device, and then, based on the process data, Providing the work support information to the worker; and (b) providing the work support information to the worker, and then corresponding to the work target of the process in the image of the work area imaged by the imaging device. When a specific post-process marker image is detected, the operator is notified of completion of the process.

  According to the present invention, it is possible to engage a worker while allowing the worker to understand whether or not the worker's work is appropriate.

  These and other objects, features and advantages of the present invention will become more apparent from the following detailed description when taken in conjunction with the accompanying drawings.

FIG. 1 is a block diagram showing a configuration of a work support system according to an embodiment of the present invention. FIG. 2 is a block diagram showing the configuration of the terminal device 11a in FIG. FIG. 3 is a diagram illustrating an example of the pre-process marker image. FIG. 4 is a diagram illustrating an example of a post-process marker image. FIG. 5 is a block diagram showing the configuration of the management server 15 in FIG. FIG. 6 is a flowchart for explaining the operation of each terminal device 11a, 11b, 11c in the work support system shown in FIG.

  Hereinafter, embodiments of the present invention will be described with reference to the drawings.

  FIG. 1 is a block diagram showing a configuration of a work support system according to an embodiment of the present invention. In the work support system shown in FIG. 1, a plurality of work areas 1 a, 1 b, and 1 c (here, three places as an example) are set in the production line 1. Workers 2a, 2b, and 2c are arranged in the work areas 1a, 1b, and 1c, respectively. On the production line 1, a work object 3 (unfinished electronic equipment, its parts, etc.) moves between work areas 1a, 1b, 1c. The workers 2a, 2b, and 2c perform the assigned process work on the work object 3 that has moved to the corresponding work areas 1a, 1b, and 1c. Here, after the process A is performed in the work area 1a, the process B is performed in the work area 1b, and after the process B is performed in the work area 1b, the process C is performed in the work area 1c.

  Furthermore, terminal devices 11a, 11b, and 11c are arranged corresponding to the work areas 1a, 1b, and 1c. Each terminal device 11a, 11b, and 11c incorporates a computer, a network interface, a peripheral device interface, and the like, and individually provides work support information to workers according to a control program or the like.

  Imaging devices 12a, 12b, and 12c, head mounted displays 13a, 13b, and 13c, and readers 14a, 14b, and 14c are connected to terminal devices 11a, 11b, and 11c, respectively, by wired communication or wireless communication.

  The imaging devices 12a, 12b, and 12c are installed at predetermined fixed positions, and the corresponding work areas 1a, 1b, and 1c are repeatedly imaged from the fixed positions.

  Head mounted displays (hereinafter referred to as HMDs) 13a, 13b, 13c are attached to corresponding workers 2a, 2b, 2c.

  The readers 14a, 14b, and 14c acquire the identification information of the work object 3 from identifiers such as a barcode and an IC tag attached to the work object 3. For example, when acquiring the identification information of the work object 3 from the barcode attached to the work object 3, a barcode reader is used as the readers 14a, 14b, and 14c.

  When the work object 3 includes an interface capable of data communication, a connection cable capable of data communication with the interface of the work object 3 is used instead of the readers 14a, 14b, and 14c, and the terminal device 11a, 11b, and 11c may acquire identification information from the work target 3 through the connection cable.

  Then, the terminal devices 11a, 11b, and 11c provide work support information that supports the work of the workers 2a, 2b, and 2c for the processes executed in the corresponding work areas 1a, 1b, and 1c based on the process data. 2a, 2b, 2c, respectively. Note that the work support information includes an image (a still image or a moving image) showing a work procedure, a description of the work, an accompanying material, and the like.

  The terminal devices 11a, 11b, and 11c display work support information for the workers 2a, 2b, and 2c on the HMDs 13a, 13b, and 13c, respectively. In addition, since the process A, the process B, and the process C are usually different from each other, the work support information for the workers 2a, 2b, and 2c is also different.

  FIG. 2 is a block diagram showing the configuration of the terminal device 11a in FIG. The other terminal devices 11b and 11c in the system have the same configuration.

  The terminal device 11a is, for example, a personal computer having a network communication function in which an operating system, an application program, and the like are installed. The terminal device 11a includes a communication device 21, a storage device 22, and an arithmetic processing device 23.

  The communication device 21 is a device that is connected to a network and performs data communication with other devices (such as the management server 15) via the network using a predetermined communication protocol. As the communication device 21, a network interface, a modem, or the like is used.

  The storage device 22 is a device capable of storing various data and programs. As the storage device 22, a nonvolatile large-capacity storage medium such as a nonvolatile memory or a hard disk drive is used. A control program 41 is stored in the storage device 22.

  The arithmetic processing unit 23 is a computer having a CPU (Central Processing Unit), a ROM (Read Only Memory), a RAM (Random Access Memory), and the like. When the program is executed by the CPU, it operates as various processing units.

  Here, the arithmetic processing unit 23 operates as a processing unit such as an operating system (not shown), a process data acquisition unit 41, and a work support unit 42.

  The process data acquisition unit 41 acquires process data corresponding to the corresponding work area 1 a and the worker 2 a from the management server 15. The process data includes a process ID, a pre-process marker image, a post-process marker image, work support information, and the like.

  The work support unit 42 (a) detects a specific pre-process marker image corresponding to the work target 3 in the process in the image of the work area 1a captured by the corresponding imaging device 12a, and then supports the work based on the process data. The information is provided to the worker 2a, and (b) after the work support information is provided to the worker 2a, the specific image corresponding to the work target 3 in the process in the image of the work area 1a imaged by the imaging device 12a. When the post-process marker image is detected, the completion of the process is notified to the worker 2a.

  At this time, for example, the work support unit 42 displays a message indicating the completion of the process on the HMD 13a of the worker 2a.

  The pre-process marker image is an image of a specific part of the work target 3 before the process. The post-process marker image is an image of a specific part of the work target 3 after the process and is not included in the image of the work target 3 before the process.

  FIG. 3 is a diagram illustrating an example of the pre-process marker image. FIG. 4 is a diagram illustrating an example of a post-process marker image.

  When the process is a process of assembling four color developing devices (including a toner cartridge) to the support structure, for example, a pre-process reference image shown in FIG. 3 (with an appropriate posture imaged by the corresponding imaging device 12a). The images of the specific parts of the support structure and the four developing devices, which are extracted from the image of the work object 3 before the process work), are the pre-process marker images 101a to 101e and 102 to 105.

  Then, for example, a post-process reference image shown in FIG. 4 in a state in which the four color developing devices are properly assembled to the support structure (after the proper process work in the proper posture imaged by the corresponding image pickup device 12a) The post-assembly marker images 121a to 121e are the support structure after assembly extracted from the image of the work object 3) and the images of specific portions in the four developing devices.

  For example, in the detection of the pre-process marker image, the edge pattern extracted in the pre-process marker image (that is, the edge pattern in the image of the specific part) is extracted in the image of the work area 1a captured by the imaging device 12a. This is done based on whether or not it is done. In the process data, a plurality of pre-process marker images are set for one process, a positional relationship (arrangement pattern of a plurality of pre-process marker images) between the plurality of pre-process marker images is set, and imaging is performed. You may make it determine with the pre-process marker image having been detected, when the some pre-process marker image is detected with the arrangement pattern in the image of the work area 1a imaged with the apparatus 12a.

  Further, as in the above-described four-color developing devices, when the shapes thereof are the same and the arrangement order when assembling is specified, the color of a specific portion (for example, the toner color attached to the developing device) Or the like), it may be determined that the pre-process marker image is detected in the image of the work area 1a imaged by the imaging device 12a.

  The post-process marker image can be detected in the same manner.

  In this embodiment, the work support unit 42, when the pre-process marker image is not detected even though the work object 3 is arranged in the work area 1a imaged by the corresponding imaging device 12a, A warning prompting the change of the posture of the work object 3 on the corresponding work area 1a is output to the corresponding worker 2a.

  That is, when the work object 3 is not arranged in an appropriate posture on the production line 1, the specific part is not photographed in the correct direction even though the work object 3 is located in the work area 1a. The pre-process marker image is not detected. Therefore, for example, a warning that prompts the work object 3 to rotate so that the direction of the work object 3 becomes an appropriate direction (for example, specified by the work support information) is displayed on the HMD 13a, for example.

  In this embodiment, the work support unit 42 provides the above-described work support information to the corresponding worker 2a, and then detects the completion of the work of the worker 2a by the corresponding imaging device 12a. When a specific post-process marker image corresponding to the work target 3 in the process is not detected in the imaged work area 1a, the operator 2a is notified of the incomplete process.

  For example, the work support unit 42 tracks the pre-process marker image in the image of the work area 1a repeatedly captured by the imaging device 12a, and confirms that the position of the pre-process marker image has not changed (for example, a predetermined time). It is detected that the work of the worker 2a is completed.

  In this embodiment, the work support unit 42 determines that a work error has occurred when notifying the worker 2a that the process has not been completed, and determines that the work error has occurred in the terminal device 11a or the management server. 15 may be recorded. In that case, based on this record, for example, the management server 15 may specify a process, a work area, a worker, or the like in which a work error occurs at a frequency equal to or higher than a predetermined threshold. Thereby, the production efficiency in the production line 1 can be improved.

  Furthermore, a management server 15 capable of data communication with the terminal devices 11a, 11b, and 11c arranged around the work areas 1a, 1b, and 1c via a network or the like is provided. The management server 15 may be remotely located. The management server 15 provides process data to the terminal devices 11a, 11b, and 11c.

  FIG. 5 is a block diagram showing the configuration of the management server 15 in FIG.

  The management server 15 is a server computer having a network communication function in which an operating system, a server program, and the like are installed, for example.

  The management server 15 includes a communication device 51, a storage device 52, and an arithmetic processing device 53.

  The communication device 51 is a device that is connected to a network and performs data communication with other devices (terminal devices 11a, 11b, 11c, etc.) via the network using a predetermined communication protocol. As the communication device 51, a network interface, a modem, or the like is used.

  The storage device 52 is a device capable of storing various data and programs. As the storage device 52, a nonvolatile mass storage medium such as a nonvolatile memory or a hard disk drive is used. The storage device 52 stores process data 61, machine data 62, and worker data 63.

  The process data 61 includes a process ID of a process executed in each of the work areas 1a, 1b, and 1c of the production line 1, and a process ID and a work object identification for each process in the work areas 1a, 1b, and 1c of the production line 1. Information (information indicating the type of work object), pre-process marker image, post-process marker image, work support information, and the like.

  The machine data 62 includes, for each terminal device 11a, 11b, 11c, a terminal ID, network identification information (such as an IP address), a unique identifier of the corresponding work area 1a, 1b, 1c, and the like.

  The worker data 63 includes worker IDs, names, and the like for the workers 2a, 2b, and 2c.

  The arithmetic processing unit 53 is a computer having a CPU, a ROM, a RAM, and the like, and operates as various processing units by loading a program from the storage device 52, the ROM, etc. to the RAM and executing the program by the CPU. .

  Here, the arithmetic processing unit 53 operates as an operating system (not shown), a data management unit 71, and the like.

  The data management unit 71 has a database server, manages the process data 61, the machine data 62, and the worker data 63 in the database, and registers, searches, and browses the data from the terminal devices 11a, 11b, and 11c. It will be done on request.

  Next, the operation of the work support system will be described.

(A) Registration of process data 61 and the like

  First, the administrator registers the machine data 62 and the worker data 63 in the management server 15 based on the configuration of the production line 1, the list of workers belonging to the manager, and the like.

  First, the work object 3 is arranged in the work areas 1a, 1b, and 1c of the production line 1, and the pre-process reference images are picked up by the image pickup devices 12a, 12b, and 12c. Then, the work of the designated process is performed according to the work procedure manual, the work is imaged by the imaging devices 12a, 12b, and 12c, and the captured image is used as work support information. After the operation is completed, the post-process reference image is captured by the imaging devices 12a, 12b, and 12c.

  The pre-process reference image, work support information (work in progress image), and post-process reference image are temporarily stored in the terminal devices 11a, 11b, and 11c, and then the management server 15 together with the process ID and work object identification information. And registered as process data 61 in the management server 15.

  In this way, the process data 61 and the like are prepared before the production line 1 is operated.

(B) Work support

  FIG. 6 is a flowchart for explaining the operation of each terminal device 11a, 11b, 11c in the work support system shown in FIG.

  First, the workers 2a, 2b, and 2c go to the work areas 1a, 1b, and 1c assigned to themselves, and input their own worker IDs to the terminal devices 11a, 11b, and 11c. When the work object 3 is arranged in the work areas 1a, 1b, 1c, the workers 2a, 2b, 2c use the leaders 14a, 14b, 14c to move the work object 3 from the work object 3. Get identification information for.

  The process data acquisition unit 41 of the terminal devices 11a, 11b, and 11c specifies the worker ID input as described above (step S1) and specifies the identification information of the work object 3 (step S2).

  And the process data acquisition part 41 uses the communication apparatus 21 for the terminal ID of corresponding terminal device 11a, 11b, 11c, the identified worker ID, and the identification information of the work target object 3 with the transmission request | requirement of process data. Then, the data is transmitted to the management server 15.

  The data management unit 71 of the management server 15 uses (a) the communication device 51 to receive the transmission request, the terminal ID, the worker ID, and the identification information of the work object 3 (b) ) The process data 61 is searched using the terminal ID, the worker ID, and the identification information of the work object 3 as a search key, the hit process data 61 is read, and (c) the process is performed using the communication device 51. The data 61 is transmitted as a response to the terminal devices 11a, 11b, and 11c that transmitted the transmission request.

  The process data acquisition unit 41 of the terminal devices 11a, 11b, and 11c uses the communication device 21 to receive the process data 61 as a response, and the work support unit 42 provides the process ID and the like to the corresponding HMD 13a, 13b, 13c, and notifies the worker 2a, 2b, 2c of the process (step S4).

  Then, the work support unit 42 in the images of the work areas 1a, 1b, and 1c (including the work object 3 on the work areas 1a, 1b, and 1c) captured by the corresponding imaging devices 12a, 12b, and 12c, It is determined whether or not a pre-process marker image is detected in the acquired process data 61 (step S5).

  When the pre-process marker image is not detected, the work support unit 42 issues a warning prompting the change of the posture of the work object 3 on the work areas 1a, 1b, 1c to the corresponding workers 2a, 2b, 2c. It outputs to HMD13a, 13b, 13c (step S6). Upon receiving the warning, the workers 2a, 2b, 2c rotate the work object 3 to place the work object 3 in an appropriate posture. Along with this warning, the work support unit 42 displays the image at the start of the process in the work support information on the HMDs 13a, 13b, 13c of the corresponding workers 2a, 2b, 2c, and is included in the image of the process start You may make it show to worker 2a, 2b, 2c the appropriate attitude | position of the work target object 3 at the time.

  Thereafter, returning to step S5, the work support unit 42 detects whether the pre-process marker image is detected in the images of the work areas 1a, 1b, 1c newly captured by the corresponding imaging devices 12a, 12b, 12c. It is repeatedly determined whether or not.

  Then, when the pre-process marker image is detected, the work support unit 42 outputs work support information to the corresponding workers 2a, 2b, 2c based on the acquired process data (step S7).

  The workers 2a, 2b, 2c refer to the work support information and perform the work of the designated process on the work object 3 on the work areas 1a, 1b, 1c.

  Thereafter, when work completion is detected, the work support unit 42 performs post-process in the acquired process data 61 in the images of the work areas 1a, 1b, and 1c repeatedly captured by the corresponding imaging devices 12a, 12b, and 12c. It is determined whether or not a marker image is detected (step S8).

  When the post-process marker image is not detected, the work support unit 42 outputs a warning indicating that the process is not completed to the corresponding workers 2a, 2b, and 2c (step S9), and an operation error occurs. Record.

  The workers 2a, 2b, 2c that have received this warning confirm the work object 3, identify a work error, and perform the work again.

  Thereafter, the process returns to step S8, and the work support unit 42 detects the post-process marker image in the images of the work areas 1a, 1b, 1c newly imaged by the corresponding imaging devices 12a, 12b, 12c. It is repeatedly determined whether or not.

  When the post-process marker image is detected, the work support unit 42 outputs a completion notification indicating that the process is completed to the corresponding workers 2a, 2b, 2c (step 10).

  Thereafter, the work support unit 42 determines whether or not there is a subsequent process based on the acquired process data (step S11). If there is a subsequent process, the process returns to step S4. The process after step S4 is performed similarly.

  On the other hand, if there is no subsequent process, the work support unit 42 completes the work support.

  As described above, according to the above-described embodiment, each terminal device 11a, 11b, 11c performs (a) a process in the images of the work areas 1a, 1b, 1c imaged by the corresponding imaging devices 12a, 12b, 12c. After detecting a specific pre-process marker image corresponding to the work object 3, the work support information is provided to the corresponding workers 2a, 2b, 2c based on the process data, and (b) the work support information. Is provided to the workers 2a, 2b, 2c, and then a specific post-process marker image corresponding to the work target 3 in the process in the images of the work areas 1a, 1b, 1c imaged by the imaging devices 12a, 12b, 12c. Is detected, the completion of the process is notified to the corresponding workers 2a, 2b, 2c.

  Thereby, it can be engaged in work, making the workers 2a, 2b, 2c understand whether the work of the workers 2a, 2b, 2c is appropriate.

  Various changes and modifications to the above-described embodiment will be apparent to those skilled in the art. Such changes and modifications may be made without departing from the spirit and scope of the subject matter and without diminishing its intended advantages. That is, such changes and modifications are intended to be included within the scope of the claims.

  The present invention is applicable to, for example, a work support system that performs work support individually for each worker on a production line.

DESCRIPTION OF SYMBOLS 1 Production line 1a, 1b, 1c Work area 11a, 11b, 11c Terminal device 12a, 12b, 12c Imaging device

Claims (6)

A terminal device that is arranged with respect to a work area in a production line, and that provides work support information to the worker for supporting the work of a worker on a process executed in the work area based on process data; In a work support system comprising a management server that provides process data to the terminal device,
An imaging device that repeatedly images the work area from a predetermined fixed position;
The terminal device (a) detects a specific pre-process marker image corresponding to the work object in the process in the image of the work area imaged by the imaging device, and then performs the work based on the process data. Providing support information to the worker; and (b) providing the work support information to the worker, and then providing a specific corresponding to the work object of the step in the image of the work area imaged by the imaging device. When detecting a marker image after the process, notifying the worker of the completion of the process,
A work support system characterized by   When the pre-process marker image is not detected even though the work object is arranged in the work area imaged by the imaging device, the terminal device has the work object on the work area. The work support system according to claim 1, wherein a warning prompting a change in posture is output to the worker.   The terminal device, after providing the work support information to the worker, detects the work completion of the worker as a work object in the process in the image of the work area imaged by the imaging device. The work support system according to claim 1, wherein when the corresponding specific post-process marker image is not detected, the worker is notified of the incomplete process.   The said terminal device detects that the position of the said marker image before a process is no longer changing in the image of the said work area imaged with the said imaging device as a work completion of the said worker. The work support system described.   The work support system according to claim 3, wherein the terminal device records occurrence of a work error when notifying the worker that the process has not been completed. The pre-process marker image is an image of a specific part of the work object before the process,
The post-step marker image is an image of a specific part of the work target after the step, and is an image not included in the image of the work target before the step;
The work support system according to claim 1, wherein:

Images