JP2021060824A - Substrate work machine - Google Patents

Abstract

To provide a technique which provides easy performance of a desired operation for a substrate work machine without pushing down an input part of the substrate work machine.SOLUTION: A substrate work machine according to the present invention has a display unit (touch panel 24) for displaying operation items, an imaging unit (camera 26) for imaging eyes of an operator when the operator watches the display unit (touch panel 24) displaying the operation items, an operation item selecting unit 34 for selecting operation items displayed on the display unit (touch panel 24) in response to movement of a sight line specified based on the image of the operator's eyes imaged by the imaging unit (camera 26).SELECTED DRAWING: Figure 3

Description

The techniques disclosed herein relate to substrate working machines.

A board working machine such as a component mounting machine that mounts electronic components on a board automatically works on the board. However, there are cases where work by an operator such as replenishing parts to the board working machine is required. When performing the work by such an operator, the operator needs to operate the board working machine. Normally, when the operator operates the board working machine, he / she presses an input unit such as a touch panel to select the operation of the board working machine corresponding to the work intended by the worker. Further, for example, Patent Document 1 discloses a substrate working machine that can be operated by detecting a movement of a hand instead of pressing an input unit by an operator.

JP-A-2018-56252

The substrate working machine of Patent Document 1 can be operated by the movement of a hand without directly touching the touch panel or the like. However, depending on the work performed by the worker on the board working machine, both hands of the worker may be blocked. In such a case, the technique of Patent Document 1, which requires the movement of the operator's hand, may not be able to perform a desired operation on the substrate working machine. Further, in the operation by the movement of the hand, the movement of the hand that can be detected is limited, and as a result, the types of operations that can be selected are limited.

The present specification discloses a technique for facilitating a board working machine to perform a desired operation without pressing an input portion of the board working machine.

The substrate working machine disclosed in the present specification includes a display unit that displays operation items, an imaging unit that images the operator's eyes when the operator looks at the display unit on which the operation items are displayed, and an imaging unit. It is provided with an operation item selection unit that selects an operation item displayed on the display unit in response to the movement of the line of sight identified from the captured image of the operator's eye.

In the above-mentioned board working machine, the operation items displayed on the display unit can be selected by the movement of the line of sight of the operator. As a result, the operator can select the operation item without pressing the input unit or the like. Moreover, since the movement of the line of sight is used, the degree of freedom of movement is large. Therefore, for example, even when there are many operation items to be selected, a desired operation item can be appropriately selected.

The figure which shows the schematic structure of the component mounting machine which is an example of the board working machine which concerns on Example. FIG. 2 is a cross-sectional view taken along the line II-II of FIG. The block diagram which shows the function of the control device of a component mounting machine. A flowchart showing an example of a process in which a component mounting machine is operated by the movement of the operator's line of sight.

The main features of the examples described below are listed. The technical elements described below are independent technical elements and exhibit technical usefulness alone or in various combinations, and are limited to the combinations described in the claims at the time of filing. It's not a thing.

(Feature 1) The substrate working machine disclosed in the present specification may further include a detecting unit for detecting an operation of an operator and a determining unit for determining an operation item selected by an operation item selection unit. .. The determination unit may determine the operation item according to the operation of the operator detected by the detection unit. According to such a configuration, the selection of the operation item and the determination of the operation item can be executed by different operations (operations of different parts of the operator). As a result, it is possible to suppress an erroneous operation such that an erroneous operation item is determined and executed during selection, and the operation item can be appropriately determined.

(Feature 2) The substrate working machine disclosed in the present specification may further include an authentication unit that authenticates the worker based on the image of the worker captured by the imaging unit. The operation item selection unit may select an operation item when the worker is authenticated by the authentication unit. According to such a configuration, by providing the authentication unit, it is possible to prevent the board working machine from being operated by an inappropriate person.

(Feature 3) In the board working machine disclosed in the present specification, the display unit may display an operation item when the worker is authenticated by the authentication unit. According to such a configuration, the operation item can be selected only when the operator is authenticated, so that it is possible to avoid an erroneous operation in which the operation is executed when the operator is accidentally imaged by the imaging unit. be able to.

Hereinafter, the substrate working machine according to the embodiment will be described. Here, the component mounting machine 10 will be described as an example of the board working machine with reference to FIGS. 1 and 2. The component mounting machine 10 is a device for mounting the electronic component 4 on the circuit board 2. The component mounting machine 10 is also referred to as an electronic component mounting device or a chip mounter. Usually, the component mounting machine 10 is installed side by side with other board working machines such as a solder printing machine and a board inspection machine to form a series of mounting lines.

As shown in FIGS. 1 and 2, the component mounting machine 10 includes a component mounting unit 22, a touch panel 24, a camera 26, and a control device 30. The component mounting unit 22 includes a plurality of component feeders 12, a feeder holding unit 14, a mounting head 16, a head moving device 18, and a substrate conveyor 20. Each component feeder 12 accommodates a plurality of electronic components 4. The component feeder 12 is detachably attached to the feeder holding portion 14, and supplies the electronic component 4 to the mounting head 16. The specific configuration of the component feeder 12 is not particularly limited. Each component feeder 12 is, for example, a tape-type feeder that accommodates a plurality of electronic components 4 on a winding tape, a tray-type feeder that accommodates a plurality of electronic components 4 on a tray, or a plurality of electronic components 4 in a container. It may be any of bulk feeders that randomly accommodates.

The feeder holding portion 14 includes a plurality of slots, and the component feeder 12 can be detachably installed in each of the plurality of slots. The feeder holding portion 14 may be fixed to the component mounting machine 10 or may be detachable from the component mounting machine 10. The mounting head 16 holds one or a plurality of suction nozzles 6 detachably, picks up the electronic component 4 supplied by the component feeder 12 using the suction nozzle 6, and mounts the electronic component 4 on the circuit board 2. At this time, the head moving device 18 moves the mounting head 16 with respect to the component feeder 12 and the circuit board 2. As a result, the electronic component 4 is picked up from the specific component feeder 12 among the plurality of component feeders 12, and the electronic component 4 is mounted at a predetermined position on the circuit board 2. The board conveyor 20 carries in, supports, and carries out the circuit board 2.

The touch panel 24 is a display device that provides various information of the component mounting machine 10 to the operator, and is an input device that receives instructions and information from the operator. For example, the touch panel 24 displays operation items for the operator to operate the component mounting machine 10. Further, the touch panel 24 displays the movement of the operator's line of sight identified from the image of the operator's eyes captured by the camera 26. As for the movement of the line of sight of the worker, for example, the position of the viewpoint of the worker looking at the touch panel 24 is displayed in real time, and the movement of the line of sight is displayed by changing the position of the viewpoint of the worker. The position of the operator's viewpoint is displayed by, for example, a pointer having a color different from the color used for the operation item, and is displayed so as to follow the movement of the operator's line of sight. The touch panel 24 is an example of a “display unit”.

The camera 26 is arranged above the touch panel 24. The camera 26 is arranged so that its imaging direction is substantially parallel to the horizontal plane. Specifically, the camera 26 is arranged so as to face in a direction orthogonal to the display surface of the touch panel 24, and is arranged so that an operator facing the touch panel 24 can be imaged. Specifically, the camera 26 is arranged so as to capture the eyes, face, feet, etc. of the operator when the operator is positioned in front of the display surface of the touch panel 24. As the camera 26, for example, a CCD camera is used. The image data of the image captured by the camera 26 is output to the control device 30. The camera 26 is an example of an “imaging unit” and a “detecting unit”.

The control device 30 is configured by using a computer including a memory and a CPU. An arithmetic program is stored in the memory, and when the CPU executes the arithmetic program, the CPU functions as an authentication unit 32, an operation item selection unit 34, a determination unit 36, and the like shown in FIG. The processing of the authentication unit 32, the operation item selection unit 34, and the determination unit 36 will be described in detail later.

In this embodiment, the processing when the component mounting machine 10 is operated by the operator will be described with reference to FIG. The operator can operate the component mounting machine 10 by pressing the operation items displayed on the touch panel 24. However, depending on the work performed by the operator, such as when the component mounting machine 10 is temporarily stopped while holding the board to be carried into the component mounting machine 10, the worker is in a state where both hands are blocked. You may want to operate the component mounting machine 10 with. Hereinafter, the processing of the control device 30 when the operator operates the component mounting machine 10 without directly pressing the display surface of the touch panel 24 will be described.

As shown in FIG. 4, first, the control device 30 determines whether or not the operator has acquired the image captured by the camera 26 (S12). That is, the control device 30 determines whether or not the worker is imaged in the image acquired from the camera 26. If the operator has not acquired the captured image (NO in step S12), the control device 30 waits until the operator acquires the captured image from the camera 26.

When the worker acquires the captured image (YES in step S12), the control device 30 determines whether or not a specific operation by the worker is detected from the acquired image of the worker (S14). The specific operation by the operator is, for example, an operation for urgently stopping the component mounting machine 10, and is registered in advance in the memory of the control device 30. The specific movement by the worker is not particularly limited, and examples thereof include a movement in which the worker's right foot is reciprocated three times from right to left. Then, when a specific operation by the operator is detected (YES in step S14), the control device 30 causes the component mounting machine 10 to perform a preset operation (for example, an emergency stop of the component mounting machine 10) (S16). ). As will be described later, the component mounting machine 10 can be operated after the operator is authenticated so that only the operator having the operation authority can operate the component mounting machine 10. However, for example, when a problem occurs in which the component mounting machine 10 needs to be stopped urgently, it is preferable to stop the component mounting machine 10 immediately without the time for authenticating the operator. By detecting a specific operation of the worker and immediately stopping the operation of the component mounting machine 10, it is possible to save the time for authenticating the worker and quickly stop the component mounting machine 10 in response to an emergency. it can.

When a specific operation by the worker is not detected (NO in step S14), the authentication unit 32 determines whether or not the captured worker is a registered worker based on the image captured by the camera 26. (S18). Specifically, the authentication unit 32 determines whether or not the image of the worker's face captured by the camera 26 matches the image of the worker's face registered in advance. In this embodiment, the authentication unit 32 authenticates the worker based on the image of the worker's face captured by the camera 26, but the configuration is not limited to this. It suffices if it can be determined whether or not the worker has the authority to operate the component mounting machine 10. For example, the iris is specified from the image of the worker's eye captured by the camera 26, and based on the specified iris. The worker may be authenticated. If the imaged worker is not a registered worker (NO in step S18), it is determined that the worker does not have the authority to operate the component mounting machine 10, and the process ends.

On the other hand, when the imaged worker is a registered worker (YES in step S18), it is determined that the worker has the authority to operate the component mounting machine 10, and the control device 30 uses the touch panel. 24 is displayed with an operation item (that is, an icon indicating the operation item) for operating the component mounting machine 10 (S20). As a result, the operator can select the operation item displayed on the touch panel 24. Further, since the operation items are displayed as icons, by displaying a plurality of icons (operation items) on the touch panel 24, the operator can select a desired operation item from the plurality of operation items. By displaying the operation items on the touch panel 24 after the operator is authenticated in this way, it is possible to prevent the component mounting machine 10 from being operated by a person who does not have the operation authority. Further, since it is suppressed that the component mounting machine 10 is operated due to the operator being imaged by the camera 26 due to accidentally passing in the vicinity of the camera 26, it is possible to suppress an erroneous operation of the component mounting machine 10. Can be done.

When the operation item (icon) is displayed on the touch panel 24, the operation item selection unit 34 detects the movement of the operator's line of sight (movement of the operator's viewpoint) from the captured image (S22). Then, the operation item selection unit 34 determines whether or not the operation item on the touch panel 24 has been selected by the operator based on the detected movement of the line of sight of the operator (S24). That is, the operation item selection unit 34 calculates which position on the touch panel 24 the worker is looking at (that is, the position of the worker's viewpoint) from the movement of the worker's line of sight, and determines the position of the worker's viewpoint. It is displayed on the touch panel 24 as a pointer. As a result, the touch panel 24 displays an icon indicating an operation item and a pointer indicating the position of the viewpoint of the operator. When the operator wants to select an operation item displayed on the touch panel 24, the operator moves the position of the viewpoint (pointer) in the touch panel 24 by moving the line of sight, and the position of the viewpoint (pointer) in the touch panel is the operation item. Move it so that it is located on the icon that represents. Therefore, in step S24, the operation item selection unit 34 displays the operator on the touch panel 24 based on the position of the operator's viewpoint (pointer position) and the operation item position (icon position). Judge whether or not the operation item is selected. As a technique for detecting the movement of the operator's line of sight from the image of the operator captured by the camera 26, a known technique for detecting the line of sight can be used, and thus detailed description thereof will be omitted. As described above, since the icon indicating the operation item and the pointer indicating the position of the viewpoint of the operator are simultaneously displayed on the touch panel 24, the operator can confirm the position of the displayed pointer to obtain the desired position. Operation items (icons) can be easily selected.

In this embodiment, since the operator selects the operation item based on the movement of his / her own line of sight, it is not necessary to directly press the display surface of the touch panel 24, and the operation item can be selected. Further, since the movement of the line of sight of the operator is used for selecting the operation item, the degree of freedom of movement is large as compared with the movement of, for example, a hand or a foot. Therefore, even when there are many operation items displayed on the touch panel 24, the operator can appropriately select the desired operation items.

If the operation item is not selected by the operator (NO in step S24), the process returns to step S22 and the processes of step S22 and step S24 are repeated. On the other hand, when the operation item is selected by the operator (YES in step S24), the determination unit 36 detects whether or not the operator has performed a predetermined operation from the image captured by the camera 26 (S26). .. The predetermined operation of the operator is an operation for determining the selected operation item, and is registered in advance in the memory of the control device 30. The predetermined movement of the worker is not particularly limited, and examples thereof include a movement of moving the right foot from right to left. Further, the predetermined movement of the worker is not limited to the movement of the worker's foot, and may be, for example, the movement of a part of the body such as the worker's hand. If the worker has not detected a predetermined operation (NO in step S26), it is determined that the worker has not determined any of the operation items and is selecting the operation item. Therefore, the control device 30 returns to step S22 and repeats the processes of steps S22 to S26. On the other hand, when a predetermined operation of the operator is detected (YES in step S26), it is determined that the selection of the operation item by the operator is completed and the operator has determined the selected operation item. Therefore, the determination unit 36 determines the operation item selected when a predetermined operation is detected (S28). As a result, the process of selecting and determining the operation item is completed, and the control device 30 executes the operation corresponding to the determined operation item (for example, pausing the component mounting machine 10).

In this embodiment, the operation item selection unit 34 determines whether or not the operation item is selected based on the movement of the line of sight of the operator, while the determination unit 36 is based on a predetermined movement such as the operator's foot. It is determined whether or not the selected operation item has been determined. That is, the determination of whether or not the operation item is selected by the operator and the determination of whether or not the operation item selected by the operator is determined are executed based on the movements of different parts of the operator. .. As a result, it is possible to suppress an erroneous operation in which an operator mistakenly selects an unintended operation item while selecting an operation item. Therefore, the operator can determine the operation item more appropriately.

In this embodiment, the movement of the operator's feet and the like is detected from the image captured by the camera 26, but the configuration is not limited to this. For example, the component mounting machine may include, in addition to the camera 26, a sensor that detects the movement of the operator's feet and the like. In this case, the camera may be configured to capture only the worker's face, eyes, and the like.

Further, in the present embodiment, the component mounting machine 10 is configured to be operable by the movement of the line of sight of the operator, but the configuration is not limited to such a configuration. The configuration that can be operated by the movement of the line of sight of the operator of this embodiment can be provided in other types of substrate working machines, and may be provided in, for example, a solder printing machine, a substrate inspection machine, or the like.

The technical elements described herein or in the drawings exhibit their technical usefulness alone or in various combinations, and are not limited to the combinations described in the claims at the time of filing. In addition, the techniques illustrated in this specification or drawings achieve a plurality of objectives at the same time, and achieving one of the objectives itself has technical usefulness.

2: Circuit board 4: Electronic component 8: Management device 10: Component mounting machine 22: Component mounting unit 24: Touch panel 26: Camera 30: Control device 32: Authentication unit 34: Operation item selection unit 36: Determining unit

Claims (4)

A display unit that displays operation items and
When the operator looks at the display unit on which the operation item is displayed, the image pickup unit that images the operator's eyes and the image pickup unit.
Substrate work including an operation item selection unit for selecting the operation item displayed on the display unit in response to the movement of the line of sight specified from the image of the operator's eye captured by the imaging unit. Machine. A detection unit that detects the movement of the worker,
It further includes a determination unit for determining the operation item selected by the operation item selection unit.
The board working machine according to claim 1, wherein the determination unit determines the operation item in response to the operation of the operator detected by the detection unit. An authentication unit that authenticates the worker based on the image of the worker captured by the image pickup unit is further provided.
The board working machine according to claim 1 or 2, wherein the operation item selection unit selects the operation item when the worker is authenticated by the authentication unit. The board working machine according to claim 3, wherein the display unit displays an operation item when the worker is authenticated by the authentication unit.

Images