WO2022049843A1

WO2022049843A1 - Remote operation system

Info

Publication number: WO2022049843A1
Application number: PCT/JP2021/020263
Authority: WO
Inventors: 章和田; 英樹角
Original assignee: パナソニックＩｐマネジメント株式会社
Priority date: 2020-09-03
Filing date: 2021-05-27
Publication date: 2022-03-10
Also published as: JPWO2022049843A1

Abstract

Provided is a remote operation system configured to enable remotely resolving an error generated in a work device by: transmitting information of an error generated in any one of a plurality of work devices to any one of a plurality of remote monitoring devices; and transmitting, from the remote monitoring device having received the information of the error transmitted, information of an operation for resolving the error to the work device where the error was generated. Regarding all errors generated in the plurality of work devices in a predetermined period of time, a management device calculates a total of waiting time between generation of each error and a first operation for resolving the error, and a display device displays the total of waiting time calculated by the management device.

Description

Remote operation system

This disclosure relates to a remote operation system that can eliminate an error that has occurred in a work device by remote operation from a remote monitoring device.

Conventionally, there is known a remote operation system that can eliminate an error by remote operation from an operation remote monitoring device when an error occurs in a work device constituting a work line (see, for example, Patent Document 1 below). ). In such a remote operation system, it is possible to install a plurality of remote monitoring devices so that a plurality of errors generated at the same time by a plurality of workers can be resolved at the same time.

Japanese Unexamined Patent Publication No. 2018-200654

However, as described above, even if a plurality of errors generated at the same time by a plurality of workers can be resolved at the same time, an appropriate work efficiency cannot be maintained depending on the skill of the worker who performs the work. There is. In such a case, it is conceivable to replace or increase the number of workers. However, such a judgment has conventionally been subjective based on the intuition and experience of the administrator (the person who manages the staffing system for the remote monitoring device), and there is a problem that an appropriate judgment is not always made. was there.

Therefore, the present disclosure provides a remote operation system capable of accurately allocating or selecting a worker who performs a remote operation for solving an error generated in a work device without relying on the experience or intuition of an administrator. The purpose is to provide.

The remote operation system of the present disclosure transmits information on an error that has occurred in any of a plurality of working devices to one of a plurality of remote monitoring devices, and resolves the error from the remote monitoring device that has received the error information transmitted. A remote operation system configured to remotely resolve an error that has occurred in one of multiple work devices by sending information about the operation to the work device in which the error occurred, within a certain period of time. For all errors that have occurred in multiple work devices, a management device that calculates the total waiting time between the occurrence of each error and the first operation to resolve each error. Prepared.

According to the present disclosure, it is possible to accurately assign or select a worker who performs a remote operation for solving an error generated in a work device without relying on the experience or intuition of the administrator.

FIG. 1 is a schematic configuration diagram of a remote operation system according to an embodiment of the present disclosure. FIG. 2 is a side view of a main part of a working device constituting the remote operation system according to the embodiment of the present disclosure. FIG. 3 is a perspective view showing a parts feeder of a working device constituting the remote operation system according to the embodiment of the present disclosure together with a mounting head and a substrate recognition camera. FIG. 4 is a block diagram showing a control system of a remote operation system according to an embodiment of the present disclosure. FIG. 5 is a diagram showing an example of master data created by a management device included in the remote operation system according to the embodiment of the present disclosure. FIG. 6A is a diagram showing an example of recovery information data displayed by the display device of the remote operation system according to the embodiment of the present disclosure. FIG. 6B is a diagram showing an example of worker-specific recovery information data displayed by the display device of the remote operation system according to the embodiment of the present disclosure. FIG. 6C is a diagram showing an example of recovery information data for each error type of a worker displayed by the display device of the remote operation system according to the embodiment of the present disclosure.

Hereinafter, embodiments of the present disclosure will be described with reference to the drawings. FIG. 1 is a schematic configuration diagram of a remote operation system 1 according to an embodiment of the present disclosure.

The remote operation system 1 is configured to include a plurality of work devices 2, a management device 3, a plurality of remote monitoring devices 4, and a display device 5. In the present embodiment, each work device 2 is a component mounting device for mounting components on the board KB. A plurality of working devices 2 are arranged in series to form a working line 2L.

FIG. 2 is a side view of a main part of a working device constituting a remote operation system according to an embodiment of the present disclosure. In FIG. 2, each working device 2 includes a base 11, a conveyor 12, a parts feeder 13, a head moving mechanism 14, a mounting head 15, a board recognition camera 16, and a parts recognition camera 17. The conveyor 12 extends on the base 11 in the left-right direction (X-axis direction), receives the substrate KB sent from the upstream side, and positions it at a predetermined working position.

In FIG. 2, the parts feeder 13 is a tape feeder. The parts feeder 13 pulls out the carrier tape CT wound around the reel RL by the built-in sprocket 13S (see also FIG. 3) and conveys it in the front-rear direction (Y-axis direction). As a result, the parts feeder 13 supplies the parts BH to the parts supply position 13K provided at the end on the conveyor 12 side. The head moving mechanism 14 is composed of, for example, an XY gantry mechanism, and moves the mounting head 15 in a horizontal plane.

FIG. 3 is a perspective view showing a parts feeder of a working device constituting the remote operation system according to the embodiment of the present disclosure together with a mounting head and a board recognition camera. In FIGS. 2 and 3, the mounting head 15 includes a plurality of nozzles 15N extending downward. The mounting head 15 can raise and lower each nozzle 15N, and can rotate each nozzle 15N in the vertical direction (Z-axis direction). Further, the mounting head 15 can generate a vacuum suction force at the lower end of each nozzle 15N. When the mounting head 15 sucks the component BH from the part feeder 13, the nozzle 15N is lowered above the component supply position 13K, and a vacuum suction force is generated at the lower end of the nozzle 15N.

In FIGS. 2 and 3, the substrate recognition camera 16 is attached to the mounting head 15 in a posture in which the image pickup optical axis is directed downward. The substrate recognition camera 16 moves inward in the horizontal plane integrally with the mounting head 15, and images the substrate KB positioned at the working position by the conveyor 12 from above.

In FIG. 2, the component recognition camera 17 is attached to the base 11 with the image pickup optical axis facing upward. The component recognition camera 17 captures the component BH from below when the mounting head 15 that picks up the component BH passes above the component recognition camera 17 and moves toward the substrate KB.

The work device 2 includes a work device control unit 18 (FIGS. 2 and 4). The work device control unit 18 controls the operation of each unit of the work device 2. Specifically, the work device control unit 18 operates the transfer conveyor 12 to transfer the substrate KB and position it at the work position, and operates each part feeder 13 to supply the component BH to the component supply position 13K. Let me. Further, the working device control unit 18 operates the head moving mechanism 14 to move the mounting head 15 in the horizontal plane direction. Further, the working device control unit 18 raises and lowers and rotates each nozzle 15N included in the mounting head 15, generates an attraction force at the lower end of each nozzle 15N, and attracts the component BH supplied by the component feeder 13. The working device control unit 18 also performs image recognition based on the image data obtained by the image pickup operation of the substrate recognition camera 16, and causes the component recognition camera 17 to image the component BH picked up by the mounting head 15 attracted to the nozzle 15N. Then, the component BH is recognized.

When each work device 2 constituting the work line 2L performs the component mounting work of mounting the component BH on the board KB, the transport conveyor 12 first receives and transports the board KB sent from the upstream side to perform the work. Position the board KB in position. When the board KB is positioned at the working position, the head moving mechanism 14 moves the mounting head 15 above the board KB. As a result, the board recognition camera 16 takes an image of the board KB, and the working device control unit 18 recognizes the board KB.

When the working device control unit 18 recognizes the board KB, the head moving mechanism 14 moves the mounting head 15 above the parts feeder 13. When the mounting head 15 moves above the parts feeder 13, the parts BH supplied by the parts feeder 13 are attracted to each of the plurality of nozzles 15N and picked up.

After the mounting head 15 picks up the component BH, the head moving mechanism 14 moves the mounting head 15 so that the component BH picked up by the mounting head 15 passes above the component recognition camera 17. The component recognition camera 17 captures the component BH as the component BH passes above. The working device control unit 18 recognizes the component BH based on the image obtained by the image captured by the component recognition camera 17.

When the working device control unit 18 recognizes the component BH, the head moving mechanism 14 moves the mounting head 15 above the board KB. The mounting head 15 mounts the picked up component BH at the target mounting coordinates set on the board KB. When the mounting head 15 mounts the component BH at the target mounting coordinates, the position correction based on the recognition result of the component BH performed through the component recognition camera 17 and the recognition result of the board KB performed through the board recognition camera 16 is performed. Will be done.

By repeating such a series of operations of the mounting head 15, the component BH to be mounted on the board KB is mounted on the board KB. After that, the transfer conveyor 12 carries out the substrate KB to the downstream side of the working device 2. This completes the component mounting work for each board KB.

The work device 2 has a self-detection function that self-detects the occurrence of an error when an error occurs in the component mounting work as described above. Then, when the occurrence of an error is detected by the self-detection function, the information on the error (error information) that has occurred is transmitted to the management device 3. Then, the management device 3 transmits (transfers) the information of the error generated in any of the plurality of working devices 2 to any of the plurality of remote monitoring devices 4. The error information transmitted from the working device 2 includes, for example, an image obtained by capturing an error occurrence portion with the board recognition camera 16.

The remote monitoring device 4 functions as a so-called remote terminal. The remote monitoring device 4 is composed of, for example, a personal computer. The remote monitoring device 4 may be connected to the management device 3 by wire or wirelessly.

FIG. 4 is a block diagram showing a control system of a remote operation system according to an embodiment of the present disclosure. In FIG. 4, the remote monitoring device 4 includes a remote operation control unit 21, an input unit 22 connected to the remote operation control unit 21, and an output unit 23. When the remote monitoring device 4 is composed of a personal computer, the keyboard unit corresponds to the input unit 22 and the monitor unit corresponds to the output unit 23 (FIG. 1).

In FIG. 4, the remote operation control unit 21 of the remote monitoring device 4 communicates (exchanges information) with the management device 3. Then, the remote operation control unit 21 displays the error information (error content) transmitted from the management device 3 on the output unit 23. As a result, the worker who works on the remote monitoring device 4 can confirm the content of the error generated in the work device 2, and the operation for resolving the generated error (error resolution operation) can be performed from the input unit 22. You can enter it.

Information on the error resolution operation input by the operator from the input unit 22 is transmitted from the remote operation control unit 21 to the management device 3. When the management device 3 receives the error information transmission from the remote monitoring device 4, the management device 3 transmits (transfers) the error resolution operation information to the work device 2 in which the error has occurred.

The work device 2 that has received the error resolution operation information from the management device 3 operates based on the received error resolution operation. As a result, the working device 2 attempts to eliminate the error that has occurred. As a result, when the error is resolved, the working device 2 transmits information to the effect that the error has been resolved (error resolution information) to the management device 3. The management device 3 transmits (transfers) the error resolution information to the remote monitoring device 4. When the remote operation control unit 21 of the remote monitoring device 4 receives the error resolution information from the management device 3, the output unit 23 displays a notification that the error has been resolved. As a result, the worker can confirm that the error has been resolved by the operation performed, and the error resolution work is completed.

On the other hand, if the error is not resolved as a result of the working device 2 trying to resolve the error based on the information of the error resolution operation received from the management device 3, the information indicating that the error is not resolved (error). Unresolved information) is transmitted to the management device 3. The management device 3 transmits (transfers) the error unresolved information to the remote monitoring device 4. When the remote operation control unit 21 of the remote monitoring device 4 receives the error unresolved information from the management device 3, the output unit 23 displays a notification that the error has not been resolved. As a result, the operator can confirm that the error has not been resolved by the operation performed, and can transmit the information of the new error resolution operation to the management device 3. Further, if the worker determines that the error cannot be resolved by the remote operation and gives up the error resolution by the remote operation, the worker may send a notification to that effect to the management device 3 and end the error resolution operation. can. In this case, measures such as contacting the operator at the work site and manually giving an instruction to eliminate the error will be taken.

FIG. 5 is a diagram showing an example of master data created by the management device included in the remote operation system according to the embodiment of the present disclosure. As shown in FIG. 4, the management device 3 includes a master data creation unit 31, a calculation unit 32, and a display control unit 33. The master data creation unit 31 creates master data as shown in FIG. 5 based on the error information received from the work device 2 and the error resolution operation information received from the remote monitoring device 4. Here, as shown in FIG. 5, the master data items are error number, charge, error type, registration time, start time, end time, and success / failure of recovery. Master data can be created as data within a certain period set by specifying a date and a time zone. FIG. 5 shows an example of master data summarizing error information that occurred from 11:00 to 16:00 on a certain day.

The "number" of the master data item shown in FIG. 5 is an error number. The error numbers are represented by serial numbers that occur in any of the plurality of working devices 2 and are assigned in the order in which they are sent to the management device 3.

The "in charge" of the master data item shown in FIG. 5 is the worker in charge of the error resolution operation, and is represented by the identification number assigned to each worker. In the example shown in FIG. 5, it is an example in which the three workers who work with the three remote monitoring devices 4 are set to "1", "2", and "3". Here, it is premised that each remote monitoring device 4 and a worker who works from each remote monitoring device 4 have a one-to-one relationship. When a plurality of workers also use one remote monitoring device 4, the worker inputs an identifier of the worker himself / herself from the input unit 22 before starting work on the remote monitoring device 4. It is preferable to let the management device 3 grasp the correspondence relationship between the remote monitoring device 4 and the operator.

The "type" of the master data item shown in FIG. 5 is the type of error. Here, the type of error is either a suction error (A), a substrate recognition error (B), or a nozzle tip abnormality (C). The "suction error" is an error including the fact that the component BH to be adsorbed by the nozzle 15N could not be adsorbed from the parts feeder 13, or the component BH that was adsorbed by the nozzle 15N was dropped. The "board recognition error" is an error in which after the board KB is positioned at the working position by the conveyor 12, an attempt is made to recognize the board KB by the board recognition camera 16, but the board KB cannot be recognized normally. Is. The "nozzle tip abnormality" is an error in which the tip portion of the nozzle 15N is bent.

The "registration time" of the master data item shown in FIG. 5 is the time when the management device 3 receives the error information from the work device and registers the error information. The "start time" is the time when the management device 3 receives the first error resolution operation for the error information from the remote monitoring device 4 to which the error information is transmitted. The "end time" is when the management device 3 sends the error resolution information to the remote monitoring device 4 to which the error information is sent, or when the remote monitoring device 4 receives the information that the error resolution operation by the remote operation is abandoned. It is the time. The "+" mark in the "recovery" section is an identifier indicating the case where the error can be resolved (recovered) by remote operation. The "+" mark in the "non-recovery" section is an identifier indicating the case where the error cannot be resolved (cannot be recovered) by remote operation.

The calculation unit 32 performs a calculation based on the data created in the master data by the master data creation unit 31, and writes in the "operation time" and the "waiting time" in the master data. Here, the "operation time" is the time during which the worker is performing the error resolution operation from the remote monitoring device 4, and corresponds to the time between the start time and the end time. The "waiting time" is the time required from the registration of the error information to the start of the error resolution operation, and corresponds to the time between the registration time and the start time.

FIG. 6A is a diagram showing an example of recovery information data displayed by the display device of the remote operation system according to the embodiment of the present disclosure. The calculation unit 32 creates the "recovery information data" shown in FIG. 6A based on the master data and based on all the errors that occurred within the set period. The recovery information data shown in FIG. 6A has items of "total number of errors", "number of recovery errors", "number of non-recovery errors", "total operation time", and "total waiting time". Here, the "total number of errors" is the total number of errors that occurred within the period, and corresponds to the maximum number of "numbers" in the master data of FIG. The "recovery error number" is the total number of errors that can be resolved by remote operation, and corresponds to the total number of errors marked with "+" in the "recovery" item in the master data of FIG. The "number of non-recovery errors" is the total number of errors that could not be resolved by remote operation, and corresponds to the total number of errors marked with "+" in the "non-recovery" item in the master data of FIG.

The "total operation time" in the recovery information data shown in FIG. 6A is the total time of the "operation time" in the master data of FIG. Therefore, "9:45:00 (9 hours 45 minutes 0 seconds)", which is the total operation time in the master data of FIG. 5, corresponds to the "total operation time". The "total waiting time" in the recovery information data shown in FIG. 6A is the total time of the "waiting time" in the master data of FIG. Therefore, "1: 15:00 (1 hour 15 minutes 0 seconds)", which is the total "waiting time" in the master data of FIG. 5, corresponds to the "total waiting time".

In FIG. 4, the display device 5 is provided with a display operation unit 5S. When a person (administrator) who manages the personnel allocation system for the remote monitoring device 4 performs a predetermined operation from the display operation unit 5S, the display device 5 is displayed with the “master data” shown in FIG. 5 and the “master data” shown in FIG. 6A. "Recovery information data" can be displayed.

As described above, in the remote operation system 1 in the present embodiment, the error information generated in any of the plurality of working devices 2 is transmitted to any of the plurality of remote monitoring devices 4, and the error information is transmitted. It is configured so that the error generated in the work device 2 can be remotely resolved by transmitting the information of the operation for resolving the error (error resolution operation) from the remote monitoring device 4 to the work device 2 in which the error occurred. There is. Then, for all the errors that have occurred in the plurality of working devices 2 within a certain period, the management device 3 is between the occurrence of each of the errors and the first error resolution operation for each of the errors. Calculate the total waiting time. The display device 5 displays the total waiting time calculated by the management device 3.

The "total waiting time" in the recovery information data (FIG. 6A) displayed on the display device 5 is the three workers (identification numbers "1", "2", "3") who performed the error resolution work. The worker) can be regarded as a parameter for measuring whether or not the expected result (elimination of the error) is achieved with respect to the error generated in the plurality of work devices 2 constituting the work line 2L. Specifically, if the total value of the waiting time within a certain period is smaller than the predetermined reference time, the number of workers and the ability of the workers who performed the error resolution work within that period are sufficient. It can be judged that it was sufficient.

On the other hand, if the value of "total waiting time" is larger than the reference time, it can be determined that the number of workers or the ability of the workers involved in the error resolution work is insufficient. For example, in the example of FIG. 5, it is assumed that the reference time is set to 1 hour and 30 minutes. At this time, since the total actual waiting time was 1 hour, 15 minutes, and 0 seconds, which was shorter than that, the three workers were sufficient in terms of number and ability, and the current state of the remote monitoring device 4 was sufficient. It can be judged that the staffing system may be maintained.

On the other hand, if the reference time was set to 1 hour, the total actual waiting time would be longer than that. Therefore, it can be determined that the three workers are insufficient in number or capacity, and it is necessary to change the staffing system for the current remote monitoring device 4. Therefore, the manager who assigns or selects a worker who performs a remote operation for resolving an error generated in the work device 2 works without relying on his / her own experience or intuition (that is, objectively). It is possible to accurately assign and select persons.

FIG. 6B is a diagram showing an example of worker-specific recovery information data displayed by the display device of the remote operation system according to the embodiment of the present disclosure. Based on the master data of FIG. 5, the calculation unit 32 creates the "recovery information data for each worker" shown in FIG. 6B based on all the errors that occurred within the set period. The recovery information data for each worker shown in FIG. 6B includes "total number of errors", "number of recovery errors", "number of non-recovery errors", and "number of non-recovery errors" for each worker "1", "2", and "3" in charge. Display the contents of each item of "Total operation time" and "Operation time / number of cases".

Here, the "total number of errors" in the author-specific recovery information data of FIG. 6B is a calculation of the total number of error resolution processes performed by each worker for each worker based on the master data of FIG. .. The "recovery error number" is calculated by calculating the total number of recovery errors for each worker based on the master data of FIG. The “number of non-recovery errors” is calculated by calculating the total number of errors that could not be recovered for each worker based on the master data of FIG. The "total operation time" is calculated by calculating the total time of the "wearing time" for each worker based on the master data of FIG. "Operation time / number of cases" is calculated based on the master data of FIG. 5, the operation time per error, that is, the average operation time required to eliminate one error for each worker. Is.

As described above, in the remote operation system 1 of the present embodiment, the management device 3 causes one error for each worker who has performed an error resolution operation by any of the plurality of remote monitoring devices 4 within the set period. Calculate the average operation time required to resolve. Then, the display device 5 displays the average operation time for each worker calculated by the management device 3.

The administrator can display the "recovery information data for each worker" shown in FIG. 6B on the display device 5 by performing a predetermined operation from the display operation unit 5S. Therefore, by referring to the "recovery information data for each worker" shown in FIG. 6B, the administrator can know the work ability of each worker who performed the error resolution operation during the period, and each worker can know the work ability of each worker. You can evaluate the work.

FIG. 6C is a diagram showing an example of recovery information data for each error type of the worker displayed by the display device of the remote operation system according to the embodiment of the present disclosure. Based on the master data of FIG. 5, the calculation unit 32 creates "recovery information data for each error type of the worker" shown in FIG. 6C based on all the errors generated within the set period. The recovery information data for each error type of the worker shown in FIG. 6C is calculated by further subdividing the average operation time for each worker in the “recovery information data for each worker” of FIG. 6B according to the error type. It was done.

As described above, in the remote operation system 1 of the present embodiment, the management device 3 causes one error for each worker who has performed an error resolution operation by any of the plurality of remote monitoring devices 4 within the set period. The average operation time required to resolve the error is calculated for each error type (subdivided according to the error type). Then, the display device 5 displays the average operation time for each worker calculated by the management device 3 subdivided according to the type of error.

The administrator can display the "recovery information data for each error type of the worker" shown in FIG. 6C on the display device 5 by performing a predetermined operation from the display operation unit 5S. Therefore, by referring to the "recovery information data for each error type of the worker" shown in FIG. 6C, the administrator knows the work ability of each worker who performed the error resolution operation during the relevant period for each error type. It is possible to evaluate the work including the strengths and weaknesses of each worker for each error type.

As described above, in the remote operation system 1 according to the present embodiment, the error information generated in any of the plurality of working devices 2 is transmitted to any of the plurality of remote monitoring devices 4, and the error information is transmitted. By transmitting the information of the operation for resolving the error (error resolving operation) from the remote monitoring device 4 to the working device 2 in which the error occurred, the error generated in any of the plurality of working devices 2 can be remotely transmitted. It is configured to be resolved. Then, the management device 3 has, for all the errors generated in the plurality of working devices 2 within a certain period, from the occurrence of each of the errors until the first operation for eliminating each of the errors is performed. Calculate the total waiting time between. The display device 5 displays the total waiting time calculated by the management device 3. Therefore, the manager who assigns or selects the worker who performs the remote operation for resolving the error generated in the work device 2 works without relying on his / her own experience or intuition (that is, objectively). It is possible to accurately assign and select persons, and eventually to improve the productivity of the work line.

Although the embodiments of the present disclosure have been described so far, the present disclosure is not limited to the above-mentioned ones, and various modifications and the like are possible. For example, in the above-described embodiment, the plurality of work devices 2 constitute the work line 2L, but the work device 2 to which the present disclosure is applied does not necessarily have to form the work line 2L. Further, in the above-described embodiment, the working device 2 is a component mounting device for mounting the component BH on the substrate KB on which the work target is to be worked, but the working device 2 to which the present disclosure is applied is not limited to the component mounting device. ..

Provided is a remote operation system that can accurately perform the placement or selection of workers who perform remote operations for solving errors that occur in the work equipment without relying on the experience or intuition of the administrator.

1 Remote operation system 2 Work equipment 3 Management equipment 4 Remote monitoring equipment 5 Display equipment

Claims

Information on an error that has occurred in one of a plurality of working devices is transmitted to one of a plurality of remote monitoring devices, and information on an operation for resolving the error is transmitted from the remote monitoring device that has received the transmission of the error information. It is a remote operation system configured so that the error generated in any of the plurality of working devices can be remotely resolved by transmitting the error to the working device in which the error has occurred.
For all the errors that occurred in the plurality of working devices within a certain period, the waiting time from the occurrence of each of the all errors to the first operation for eliminating each of the all errors is performed. A remote control system with a management device that calculates the total of.
The remote operation system according to claim 1, further comprising a display device for displaying the total waiting time calculated by the management device.
The management device has an average operation time required to eliminate one error for each worker who has performed an operation for eliminating the error in any of the plurality of remote monitoring devices within the period. Is calculated,
The remote operation system according to claim 2, wherein the display device displays the average operation time for each worker calculated by the management device.
The management device subdivides and calculates the average operation time for each worker according to the type of error.
The remote operation system according to claim 3, wherein the display device displays the average operation time for each worker calculated by the management device subdivided according to the type of the error.