JP7261707B2 - Work support system - Google Patents

Description

The present specification relates to a work support system that supports work performed by an operator on a board-handling work line.

A solder printer, a component mounting machine, a reflow machine, a board inspection machine, and the like are available as board-to-board working machines for producing board products on which a large number of components are mounted. It is common to arrange these work machines for the board in a row to form a work line for the board. Operator work is required to replenish consumable materials or to replace equipment or tools on the board-to-board work line. A technical example of a system that supports this kind of work is disclosed in Patent Document 1.

The feeder placement support system of Patent Literature 1 includes a display unit that superimposes and displays feeder placement support information on the image of the feeder placement unit or the field of view of the operator based on the information captured by the imaging unit. According to the description of the embodiment, it is disclosed to display information about removal, movement, and attachment of the feeder in the feeder placement section of the component mounting machine. It is said that this allows the operator to intuitively grasp the setup change work.

JP 2018-56252 A

By the way, Japanese Patent Laid-Open No. 2003-100000 discloses a technique for displaying work related to the inside of a board-oriented work machine. However, in the work line for the board, there is a case where the work machine for the board that needs work is not known, and the working efficiency is lowered. In addition, it is difficult to plan and implement an efficient work plan when the work is displayed after it becomes necessary.

An object of the present specification is to provide a work support system that supports an operator's work in a work line for substrates and improves work efficiency.

The present specification includes a storage unit that stores arrangement information representing the arrangement of a plurality of board-oriented work machines that constitute a board-oriented work line, the board-oriented work machine that requires work by an operator, and the work that requires the work. an entity identifying unit that identifies at least one of the work machines for board that are expected to become; an imaging unit that captures the work line for board that enters the field of view of the operator to obtain a view image; and based on the arrangement information an intra-image identifying unit that identifies the position of the board-working machine identified by the entity identifying unit within the visual field image; and an intra-image identifying unit that identifies the position of the operator within the visual field or within the visual field image. and a display unit for displaying that the work is required at the position or the vicinity of the board-oriented working machine.

According to the work support system disclosed in the present specification, a board-to-board work machine that requires or is expected to require work by the operator is identified, and the identified board-to-board work machine is identified within the operator's field of view or within the field-of-view image. Indicates that work is required at or near the position of the work equipment. Therefore, the operator can visually confirm the board-to-board work machine that needs to be worked, and the confirmation does not take time. Therefore, the operator's work is assisted, and work efficiency is improved.

1 is a perspective view schematically showing a board-to-board work line targeted by the work support system of the first embodiment; FIG. 3 is a block diagram showing a control configuration of the work support system; FIG. 1 is a perspective view of smart glasses including a display unit and an imaging unit; FIG. FIG. 11 is a diagram of first template information that matches the shape of a first identification marker; FIG. 10 is a diagram of second template information that matches the shape of a second identification marker; FIG. 4 is a schematic plan view of a first line for explaining relative position information representing the relative position of the work machine for a board; It is a figure of the operation|movement flow explaining operation|movement of a work assistance system. FIG. 10 is a diagram showing an example of a field-of-view image including the entire work line for a board; FIG. 10 is a diagram showing an example in which a message indicating that work is required at the specified position of the board-related work machine is superimposed on the board-related work line visible within the field of view of the operator; FIG. 11 is a perspective view illustrating a storage that is targeted in the second embodiment; It is a perspective view which shows the identification code stuck on the side surface of the feeder apparatus. FIG. 11 is a diagram of third template information that matches the shape of a storage container identification marker; FIG. 10 is a front view of the upper portion of the storage for explaining relative position information representing the relative position of the feeder device; FIG. 10 is a diagram showing an example in which the position of the feeder device used for the replacement work is superimposed on the storage that is visible within the field of view of the operator.

1. Configuration of Work Line 9 for Boards First, the configuration of the work line 9 for boards targeted by the work support system 1 of the first embodiment will be described. As shown in FIGS. 1 and 2, the substrate-to-board work line 9 includes a first line 6, a second line 7, and a host controller 8. As shown in FIG. A first line 6 and a second line 7 are installed in parallel and spaced apart in the factory. The first line 6 and the second line 7 have the same line configuration in which seven work machines for board are arranged in a line. The work line 9 for substrates may be configured with a single line or with three or more lines.

The first line 6 includes a solder printing machine 61, a print inspection machine 62, a first component mounting machine 63, a second component mounting machine 64, a third component mounting machine 65, a board inspection machine 66, and a reflow machine 67 arranged in a row. configured. Similarly, the second line 7 includes a solder printing machine 71, a print inspection machine 72, a fourth component mounting machine 73, a fifth component mounting machine 74, a sixth component mounting machine 75, a board inspection machine 76, and a reflow machine 77. They are arranged in a row. In FIG. 1, board-to-board work machines other than the component mounting machines (hereinafter used when there is no need to distinguish between the first to sixth machines) are omitted.

A first identification marker 69 identifying the first line 6 is posted on a bulletin board 68 placed near the first line 6 . A total of two first identification markers 69 may be provided on the front and back surfaces of the plate-like bulletin board 68, or a total of four may be provided so as to face four directions at a pitch of 90°. Similarly, on a bulletin board 78 placed near the second line 7, a second identification marker 79 identifying the second line 7 is posted. The shape of the first identification marker 69 is formed by drawing a thick line X mark inside a thick line circle. The shape of the second identification marker 79 is formed by a bold circle. The shape, display position, and display method of the identification marker (used hereinafter when there is no need to distinguish between the first and second markers) are not limited to the above.

Hereinafter, the first line 6 will be used as an example to describe the working machine for the substrate, and further the work of the operator M will be described. The solder printing machine 61 uses a screen and a squeegee to print creamy solder onto component mounting positions on the substrate. The print inspection machine 62 uses an inspection camera to inspect the printing state of the cream solder. A first component mounter 63, a second component mounter 64, and a third component mounter 65 mount components on the cream solder on the board. The substrate inspection machine 66 inspects the state of components on the substrate using an inspection camera. The reflow machine 67 melts and solidifies creamy solder to stabilize the mounted state of the component.

Further, the six component mounting machines having the same configuration are composed of a board transfer device, a plurality of feeder devices 5, a component transfer device, and the like. The substrate transfer device carries in the substrate from the substrate working machine of the previous process and positions it at the mounting position. In addition, the board conveying device carries out the board on which components have been mounted from the mounting position to the work machine for board in the post-process.

A plurality of feeder devices 5 are component supply devices, and are detachably mounted side by side on the front side of the component mounter. The feeder device 5 feeds out the carrier tape holding the component and supplies the component to the component transfer device. The carrier tape is provided by being wound around a tape reel corresponding to a component holding device. The component transfer device picks up a component from the feeder device 5 using a component mounting tool such as a suction nozzle, and mounts it on the positioned board.

An operation panel 6P is provided above the feeder device 5 on the front surface of the component mounting machine. The operation panel 6P has an input section for receiving commands from the operator M, and a display section for displaying the operational status of the machine and the occurrence of abnormal conditions. Furthermore, three abnormality indicator lamps 6L are provided on the upper part of the component mounting machine. The abnormality indicator lamp 6L uses the difference in display color and the difference between lighting and blinking to display the abnormality that has occurred in the aircraft by type or to display the difference in the degree of urgency. The number and lighting method of the abnormality indicator lamp 6L are not limited to those described above.

Abnormalities that occur in component mounting machines include device failures in the machine and an increase in the error rate of component picking and mounting. At this time, maintenance work, investigation and inspection work, restoration work, and the like by the operator M are required. In addition, the running out of parts caused by the consumption of parts is not abnormal, but it is common in that the operator M's work is required. When the parts run out, the operator M replaces the feeder device 5 or replaces the tape reel.

The component mounting machine may be equipped with a component supply device other than the feeder device 5, for example, a device that replenishes only components, or a device that uses a tray as a component holder. Even so, when the parts run out, the operator M needs to supply the parts or replace the tray. Further, the timing of occurrence of parts depletion is not limited to post facto detection, and may be estimated in advance based on the progress of parts consumption.

The need for operator M's work may also occur in other types of board-to-board work machines. For example, an onboard equipment failure can occur in any board-to-board work machine. Further, in the solder printing machine 61, maintenance work such as improving the state of the squeegee and removing solidified solder may be required. In the print inspection machine 62 and the board inspection machine 66, confirmation work is required when a defect is found in the inspection, and further work is required depending on the confirmation result.

The host control device 8 is configured using a computer device. The host control device 8 is communicatively connected to the work machine for board that constitutes the first line 6 and the second line 7 . The host control device 8 controls the work machine for board according to the job data to produce the board products on the first line 6 and the second line 7 respectively. The substrate products produced in the first line 6 and the second line 7 may be of the same type or different.

The job data is data describing the details of the board work for each type of board. In addition to design information such as the circuit pattern of the board, the job data includes information on the operating conditions of each work machine for the board, information on the devices and tools to be used, types of parts to be mounted, the order of mounting, and mounting coordinates, and It includes information on inspection implementation conditions and pass/fail judgments. Information on the feeder device 5 to be used next when parts run out is also set in the job data.

2. Configuration of Work Support System 1 of First Embodiment Next, the configuration of the work support system 1 of the first embodiment will be described. The work support system 1 is configured by a combination of the control function of the host control device 8 and the smart glasses 3, as shown in FIG. The control functions of the host control device 8 include a storage unit 81 , an entity identification unit 82 , an intra-image identification unit 83 , and a wireless communication unit 84 . The smart glasses 3 include an imaging unit 31 , a display unit 32 and a wireless communication unit 33 .

The smart glasses 3 have an augmented reality display function, that is, a function of displaying augmented information superimposed on a realistic entity. The smart glasses 3 have a shape similar to glasses, as shown in FIG. Therefore, the operator M can wear and use the smart glasses 3 as shown in FIG. The display units 32 of the smart glasses 3 are paired left and right corresponding to both eyes of the operator M. As shown in FIG. The display unit 32 allows the operator M's field of view to be seen through, and displays augmented reality within the operator's M field of view. Specific contents displayed on the display unit 32 will be described later.

The imaging unit 31 of the smart glasses 3 is arranged between a pair of left and right display units 32 so as to face forward. The imaging unit 31 can fit an object within the field of view of the operator M within the imaging range. When the work line 9 for the board comes into the field of view of the operator M, the imaging unit 31 captures the work line 9 for the board and acquires a view image. The wireless communication unit 33 uses wireless communication to transmit image data of the field-of-view image, and to transmit and receive other data and various information such as commands and responses.

The wireless communication unit 84 of the host control device 8 performs wireless communication with the wireless communication unit 33 of the smart glasses 3, receives image data, and transmits and receives various information. The storage unit 81 stores arrangement information representing the arrangement of the plurality of work machines for the board that constitute the work line 9 for the board. The location information consists of identification information and relative position information.

The identification information includes first identification information for identifying first identification marker 69 and second identification information for identifying second identification marker 79 . The first identification information consists of first template information 6A (see FIG. 4) that matches the shape of the first identification marker 69, and accompanying text information. The text information associates at least the first identification marker 69 with the first line 6 . The second identification information consists of second template information 7A (see FIG. 5) that matches the shape of the second identification marker 79, and accompanying text information. The text information associates at least the second identification marker 79 with the second line 7 .

The relative position information represents the relative position of the board-to-board work machine with respect to the identification marker. In the first line 6 shown in FIG. 6, the relative position information is represented by coordinate values indicating the center position of the work machine for the board in the XY coordinate system in the horizontal plane with the position of the first identification marker 69 as the origin. be done. For example, the relative position of the first component mounting machine 63 (X1, Y1), the relative position of the second component mounting machine 64 (X2, Y1), and the relative position of the third component mounting machine 65 (X3, Y1). . Similarly, in the second line 7, the relative position information is represented by coordinate values indicating the center position of the work machine for the board in the XY coordinate system in the horizontal plane with the position of the second identification marker 79 as the origin. .

The entity identification unit 82 identifies at least one of a board-oriented work machine that requires operator M's work and a board-oriented work machine that is expected to require work. In the first embodiment, the entity identification unit 82 identifies the board-oriented work machine corresponding to a plurality of works with the earliest order of necessity. It should be noted that the fact that operator M's work is required may be notified to operator M by means of the abnormality indicator lamp 6L. In other words, the work support system 1 can be used together with work support using the abnormality indicator lamp 6L.

Here, since the host control device 8 controls each of the work machines for board, the entity identifying unit 82 can easily detect the work machine for board for which the operator M needs work after the fact. Furthermore, as described above, it is possible to estimate when the feeder device 5 will run out of parts. Therefore, the entity identification unit 82 can estimate the time when the replacement work of the feeder device 5 is required in the component mounters, and can identify the component mounters with early replacement work while ranking them. In addition, it is also possible to estimate the timing of maintenance work that is performed periodically and to rank work machines for substrates.

The intra-image specifying unit 83 specifies the position of the board-oriented work machine specified by the entity specifying unit 82 in the view image based on the arrangement information stored in the storage unit 81 . Specifically, the intra-image specifying unit 83 recognizes the identification marker in the field-of-view image, and further uses the relative position information to specify the positions of the board-facing work machines corresponding to the specified plurality of works. Here, the field-of-view image corresponds to image data acquired by the imaging unit 31 of the smart glasses 3 and transmitted from the wireless communication unit 33 to the wireless communication unit 84 .

The intra-image specifying unit 83 performs pattern matching processing using the first template information 6A shown in FIG. 4 and the second template information 7A shown in FIG. 5 when recognizing the identification marker in the visual field image. . Here, the distance between the imaging unit 31 and the identification marker changes from time to time, and the size of the image of the identification marker in the visual field image changes. In addition, the image pickup unit 31 may pick up an image of the identification marker from an oblique direction, and the image of the identification marker in the field-of-view image is not circular but elliptical. Therefore, the intra-image specifying unit 83 needs to use a pattern matching processing method that corresponds to changes in size and deformation of the image of the identification marker.

When at least one of the first identification marker 69 and the second identification marker 79 is recognized by the pattern matching process, the intra-image specifying unit 83 determines the extending directions of the X-axis and the Y-axis and the scale of reduction in the visual field image. Image processing is performed to This makes it possible to specify the position of the work machine for board using the relative position information of the XY coordinate system. Further, when neither the first identification marker 69 nor the second identification marker 79 can be recognized, the intra-image specifying unit 83 does not perform subsequent processing.

Information on the position of the board-facing work machine specified by the intra-image specifying unit 83 is sent to the wireless communication unit 84 and then to the wireless communication unit 33 . At the same time, information on the order of work and incidental information on the work are transmitted. As additional information, at least one item of the remaining time until the start of the work, the content of the work, and the work position within the board-oriented work machine where the work is to be performed is transmitted. As a result, the display unit 32 acquires information on the position of the work machine for board, information on the order of work, and additional information.

Based on the acquired information, the display unit 32 displays in the field of view of the operator M that work is required at or near the position of the board-working machine. Furthermore, the display unit 32 displays the order of work at the position of the board-oriented work machine or at a position near it. In addition, the display unit 32 also displays supplementary information. These displays are by way of augmented reality displays.

3. Operation of Work Assistance System 1 of First Embodiment Next, the operation of the work assistance system 1 of the first embodiment will be described while considering the operation of the operator M. FIG. At step S1 of the operation flow shown in FIG. 7, the storage unit 81 operates. Step S1 is performed only once in principle. As an exception, step S1 is performed again when the line configuration of the substrate-to-work line 9 is changed, and when the shapes of the first identification marker 69 and the second identification marker 79 are changed.

In the next step S2, the work line 9 for substrates starts to operate. Then, in the next step S3, the entity identification unit 82 automatically starts operating, and continues to operate thereafter. Further, in step S4 after the operator M turns on the power of the smart glasses 3, the imaging unit 31 operates. In the next step S5, the intra-image specifying unit 83 operates. In the next step S6, it is determined whether the pattern matching process is good or bad.

In the case of a defect in which neither the first identification marker 69 nor the second identification marker 79 is recognized in the pattern matching process, the operator M is either away from the work line 9 for substrates or looking in another direction. In this case, execution of the operational flow is returned to step S4. Steps S4 to S6 are repeated until the operator M sees the board-to-board work line 9 from near.

Even if most of the work line 9 for the board is included in the view image, the first identification marker 69 and the second identification marker 79 may not be included in the view image. In this case, the pattern matching process will be defective. At least one of the first identification marker 69 and the second identification marker 79 may be included in the field-of-view image in addition to a portion of the work line 9 for substrates. In this case, the pattern matching process is good, but the intra-image specifying unit 83 cannot function when the position of the work machine for board specified by the entity specifying unit 82 is not included in the visual field image. Steps S4 to S6 are repeated in these two cases as well.

On the other hand, if the field-of-view image G illustrated in FIG. 8 is acquired by the imaging unit 31, the pattern matching process will be good. In FIG. 8, the view image G includes the entire work line 9 for the substrate. At this time, the display unit 32 acquires information on the position of the work machine for board specified by the intra-image specifying unit 83 , information on the order of work, and supplementary information. Then, execution of the operation flow proceeds from step S6 to step S7. In step S7, the display unit 32 displays augmented reality as illustrated in FIG.

In FIG. 9, the substance of the work line 9 for the board can be seen in the field of view of the operator M through the display unit 32 . Then, on the display unit 32, a red balloon-shaped mark (indicated by hatching with oblique lines) indicating that work is required is displayed on the first component mounting machine 63, the fifth component mounting machine 74, and the sixth component mounting machine. The position of the aircraft 75 is superimposed and highlighted. Also, a pop-up display of "Replacement order: 1st" is displayed near the sixth component placement machine 75, and a pop-up display of "Replacement order: 2nd" is displayed near the first component placement machine 63, and the fifth component placement is performed. A pop-up display of "Replacement order: 3rd" is displayed near the machine 74 . The displayed exchange order is the order determined based on the length of the remaining time, which will be described below.

Supplementary information is displayed below the “replacement order: 1st” in the vicinity of the sixth component mounting machine 75 . Specifically, the name abbreviation of the sixth component mounting machine 75 is displayed as "machine name: M3-6". In addition, the remaining time until work is estimated in advance by the entity identification unit 82 . Based on this estimation result, "remaining time: 5 minutes" is displayed.

Further, the feeder device 5 to be removed is displayed as "feeder number: FO11". The feeder number corresponds to an identification code for identifying an individual feeder device 5 . Also, the type of the part that will run out is displayed as "part ID: P01". The display of the feeder number and component ID suggests the work content and work position to be performed within the sixth component mounting machine 75 . Similar incidental information is displayed for the first component mounting machine 63 and the fifth component mounting machine 74 as well.

If the first identification marker 69 and the second identification marker 79 are not recognized in step S6, the display unit 32 displays that work is required or is predicted to be required. may For example, the display unit 32 can blink a red circle in the corner of the field of view of the operator M (for example, the upper right corner) to indicate the necessity of work. Further, the display unit 32 may use a simple display method in which the balloon-shaped mark in FIG. 9 is displayed and at least one of the exchange order and the incidental information is not displayed. Further, the display unit 32 may display the replacement order and incidental information only when the distance between the operator M and the work machine to the board becomes equal to or less than a predetermined distance. In addition, the display items and display method of the display unit 32 can be variously modified.

In addition, the substrate inspection machine 66 may produce an inspection result indicating that the substrate is defective. In this case, within the field of view of the operator M, a balloon-shaped mark is superimposed on the position of the substrate inspection machine 66 and highlighted. Then, a pop-up display of "board defect occurrence: 1st place" is displayed at a position near the board inspection machine 66, and further, "remaining time: none" is displayed. The display unit 32 can perform similar display for other board-oriented work machines.

The augmented reality display on the display unit 32 allows the operator M to visually immediately confirm the work machine for board that needs work. In the example of FIG. 9, the operator M can immediately visually confirm the sixth component mounter 75, the first component mounter 63, and the fifth component mounter 74 that replace the feeder device 5. FIG. In addition, by displaying supplementary information together, it becomes easy to recognize the work content and the like.

Further, the operator M can plan and carry out an efficient work plan for a plurality of works. For example, when the remaining time of two replacement operations is approaching, the operator M prepares two replacement feeder devices 5 at once, thereby saving the trouble of duplication. Also, for example, the operator M takes into account the difference in the remaining time of the two tasks, and appropriately determines whether to stay near the work line 9 between the tasks or temporarily leave and engage in another task. be able to.

Thereafter, steps S3 to S7 are repeated. Therefore, when the operator M moves and the direction of the field of view changes, the field of view image changes and the display content of the display unit 32 is updated. Further, when the operator M moves away from the board-related work line 9 or when the power of the smart glasses 3 is turned off, the work support system 1 substantially stops functioning.

According to the work support system 1 of the first embodiment, the operator M's work is required or is expected to be required, and the work machine for the board is specified, and the work machine for the board is displayed within the field of view of the operator M. to indicate that work is required at or near a location. Therefore, the operator M can visually check the board-oriented working machine, and the checking does not take time. Therefore, the work of the operator M is assisted, and work efficiency is improved.

4. Configuration of Storage 4 in Second Embodiment Next, a work support system according to a second embodiment will be described. The work support system of the second embodiment includes all the configurations and functions of the first embodiment, and targets the stocker 4 shown in FIG. 10 in addition to the work line 9 for substrates. The storehouse 4 is installed in the factory, and may be plural. The positional relationship between the stocker 4 and the work line 9 for substrates is not limited. The stocker 4 stores replacement feeder devices 5 (stored items).

More specifically, the stocker 4 is formed in a shelf shape having storage shelves in the upper, middle, and lower stages. Each storage shelf is divided into five compartments by partition plates, and five storage slots 41 are formed. A total of 15 storage slots 41 store and store feeder devices 5 (not shown in FIG. 10).

A code reader 42 is provided on a partition plate on one side of each storage slot 41 . The code reader 42 reads the identification code 51 (see FIG. 11) attached to the side surface of the feeder device 5 housed. The identification code 51 identifies an individual feeder device 5 and corresponds to a feeder number. Further, the code reader 42 also detects a state in which the feeder device 5 is not stored in the storage slot 41 .

By reading the identification code 51, the correspondence relationship between the position of the storage slot 41 and the feeder device 5 stored therein is determined. This correspondence relationship is transmitted to the host control device 8 and used by the entity identification unit 82 using wired or wireless communication. Note that the number of storage slots 41 is actually more than fifteen.

A storage box identification marker 44 for identifying the storage box 4 is posted on a bulletin board 43 arranged above the storage box 4 . As with the first identification marker 69, a total of two or four storage cabinet identification markers 44 may be provided. The shape of the repository identification marker 44 is formed by drawing a bold-line mark inside a thick-line circle.

5. The functions and operations of the work support system of the second embodiment are the same as those of the work support system of the first embodiment, except that the storage 4 and the feeder device 5 in the storage 4 are covered. Similar to morphology. The operator M, who performs the replacement work of the feeder device 5 based on the display of FIG. Then, when the storage 4 comes into the field of view of the operator M, the imaging unit 31 can image the storage 4 and acquire the storage vault image. The image data of the vault view image is transmitted to the host control device 8 by wireless communication and used by the intra-image specifying section 83 .

On the other hand, the storage unit 81 stores arrangement information of the feeder device 5 inside the stocker 4 . The arrangement information consists of storage container identification information and storage item relative position information. The storage identification information is information for identifying the storage identification marker 44 . The repository identification information consists of third template information 45 (see FIG. 12) that matches the shape of the repository identification marker 44 and accompanying text information. The text information associates at least the third template information 45 with the repository 4 . If there is only one storage box 4, the storage box identification information is used to detect the location of the storage box 4, and the text information is no longer necessary.

The storage item relative position information represents the relative position of the feeder device 5 with respect to the storage container identification marker 44 . As shown in FIG. 13, the storage item relative position information represents the position of the feeder device 5 (or storage slot 41) in an XZ coordinate system in a vertical plane with the location of the storage identification marker 44 as the origin. It is represented by coordinate values. For example, the relative position (X4, Z1) of the feeder device 5 housed in the central storage slot 41 of the upper stage of the storage 4 is represented.

The entity identification unit 82 identifies the feeder device 5 used for the replacement work. More specifically, the operator M removes the feeder device 5 that has run out of components from the component mounter. Further, the operator M takes out the feeder device 5 specified by the entity specifying unit 82 from the stocker 4, transports it to the work line 9 for substrates, and mounts it on the component mounting machine.

Here, the entity identifying unit 82 can recognize the feeder device 5 to be used next to the feeder device 5 that runs out of parts by referring to the job data. Further, the entity identification unit 82 can identify the feeder device 5 to be used next and the position of the storage slot 41 thereof based on the correspondence relationship between the position of the storage slot 41 and the feeder device 5 stored therein. The recognition and specific processing described above is performed with reference to the identification code 51 (feeder number) of the feeder device 5 . In addition, the number of feeder devices 5 to be identified may be plural.

The intra-image specifying unit 83 specifies the position of the feeder device 5 specified by the entity specifying unit 82 within the storage view image based on the stored article arrangement information. More specifically, the intra-image specifying unit 83 identifies the location of the specified feeder device 5 by recognizing the storage container identification marker 44 in the storage container view image and using the stored product relative position information.

The intra-image specifying unit 83 performs pattern matching processing using the third template information 45 shown in FIG. 12 when recognizing the storage container identification marker 44 in the storage container visual field image. Upon recognizing the storage container identification marker 44 by pattern matching processing, the intra-image specifying unit 83 performs image processing for determining the extending directions of the X-axis and Z-axis and the reduction scale within the visual field image. This makes it possible to specify the position of the feeder device 5 using the relative position information of the XZ coordinate system.

Information on the position of the feeder device 5 specified by the intra-image specifying unit 83 is sent to the wireless communication unit 84 and then transmitted to the wireless communication unit 33 . Accompanying information is also transmitted. The supplementary information includes three items: the position of the storage slot 41, the feeder number, and the abbreviated name of the component mounting machine to be replaced. As a result, the display unit 32 acquires the information on the position of the feeder device 5 and the incidental information, and displays the augmented reality shown in FIG. 14 .

In FIG. 14, the actual storage box 4 is visible within the field of view of the operator M through the display unit 32 . Then, the display unit 32 highlights two red balloon-shaped marks (indicated by hatching with oblique lines) indicating that they are used for the replacement work. The first balloon-shaped mark indicates the position of the feeder device 5A stored in the rightmost storage slot 41 on the upper stage. The second balloon-shaped mark indicates the position of the feeder device 5B stored in the second storage slot 41 from the left in the middle row. Further, supplementary information is displayed near each balloon-shaped mark.

The incidental information corresponding to the feeder device 5A is displayed as "storage slot ID: SLOT-05", "feeder number: F016", and "machine name: M3-6". The name abbreviation “machine name: M3-6” represents the sixth component mounting machine 75 . Therefore, the operator M can easily recognize the work content of mounting the feeder device 5A on the sixth component mounting machine 75 in the first replacement order. Further, the abbreviation “machine name: M3-1” corresponding to the feeder device 5B represents the first component mounting machine 63. As shown in FIG. Therefore, the operator M can easily recognize the work content of mounting the feeder device 5B on the first component mounting machine 63 in the second replacement order. The number of feeder devices 5 displayed may be one or three or more.

According to the work support system 1 of the second embodiment, the positions of the feeder devices (5A, 5B) to be taken out from the storage 4 are displayed within the field of view of the operator M. FIG. For this reason, the operator M can visually confirm the feeder device (5A, 5B) to be taken out, and it does not take time for confirmation, so that work efficiency is improved. In addition, by displaying supplementary information together, it becomes easy to recognize the work content and the like.

6. Applications and Modifications of Embodiments Note that in the first and second embodiments, a portable display device provided with an imaging unit 31 can be used in place of the smart glasses 3 . Mobile display devices correspond to smart phones, tablet terminals, and the like. The operator M directs the imaging unit 31 of the portable display device toward the board-related work line 9 or the storage cabinet 4 and performs imaging to acquire a field-of-view image. The display unit 32 displays the augmented reality not within the field of view of the operator M but within the field of view image.

Also, instead of replacing the feeder device 5 when parts run out, the tape reel may be replaced. In this mode, the storage 4 stores a plurality of tape reels to which identification codes are attached in storage slots 41, respectively. Then, the display unit 32 performs display related to the tape reel replacement work, and also displays incidental information about the tape reel.

Further, instead of specifying the positions of the board-oriented working machines in the view image using the arrangement information (identification information and relative position information), an identification code may be attached to each board-oriented working machine. A bar code, a two-dimensional code, or the like can be applied as the identification code. In addition, the identification code has a size that allows it to be imaged and read by the imaging unit 31 within a certain distance range. According to this, the intra-image specifying unit can recognize the identification code in the field-of-view image acquired by the imaging unit 31 and specify the position of the work machine for board.

Furthermore, a configuration that applies a GPS system (location information system) can also be adopted. In other words, the intra-image identifying unit obtains the relative positional relationship between the plurality of board-facing work machines and the operator M using the GPS system, performs image processing on the field-of-view image, and finds the relative positional relationship within the image. , the position of the board-to-board work machine can be specified. Various other applications and modifications are possible for the first and second embodiments.

1: work support system 3: smart glasses 31: imaging unit 32: display unit 33: wireless communication unit 4: storage 41: storage slot 42: code reader 44: storage identification marker 45: third template information 5, 5A, 5B: Feeder device 51: Identification code 6: First line 63: First component mounting machine 64: Second component mounting machine 65: Third component mounting machine 69: First identification marker 6A: First template information 7: Second Line 73: Fourth component mounting machine 74: Fifth component mounting machine 75: Sixth component mounting machine 79: Second identification marker 7A: Second template information 8: Host control device 81: Storage unit 82: Entity identification unit 83: In-image identification unit 84: Wireless communication unit 9: Board work line M: Operator

Claims (11)

a storage unit that stores arrangement information representing the arrangement of a plurality of board-handling work machines constituting a board-handling work line;
an entity identifying unit that identifies at least one of the board-oriented working machine that requires an operator's work and the board-oriented working machine that is expected to require the work;
an imaging unit that captures the board-facing work line within the field of view of the operator to obtain a field-of-view image;
an intra-image identifying unit that identifies the position of the board-facing working machine identified by the entity identifying unit in the field-of-view image based on the arrangement information;
a display unit for displaying, in the field of view or the field image of the operator, that the work is required at the position or the vicinity of the board-oriented work machine specified by the intra-image specifying unit;
work support system. The entity identification unit identifies the work machine for board corresponding to a plurality of the work having an earlier order of necessity,
The intra-image specifying unit specifies the positions of the board-oriented working machine corresponding to the plurality of the works specified by the entity specifying unit in the field-of-view image,
The display unit displays the order of the work at the position or the neighboring position of the board-oriented working machine specified by the intra-image specifying unit.
The work support system according to claim 1. 3. The display unit displays together at least one item of a remaining time until the start of the work, a content of the work, and a work position within the work machine for board where the work is to be performed. The work support system described in . The arrangement information includes identification information for identifying an identification marker that is arranged in the vicinity of the board-oriented work line and specifies the board-oriented work line; including location information and
The intra-image specifying unit recognizes the identification marker in the field-of-view image and specifies the position of the board-to-board working machine using the relative position information.
A work support system according to any one of claims 1 to 3. The display unit is a smart glass that allows the operator to see through the field of view and displays in the field of view of the operator, and is provided with the imaging unit, according to any one of claims 1 to 4. Work support system. 5. The work support system according to any one of claims 1 to 4, wherein said display unit is a portable display device that displays within said field of view image and is provided with said imaging unit. The work of the operator includes:
Replenishment work of materials consumed by the board-oriented working machine;
Replacing a device or instrument detachably mounted on the board-oriented working machine;
Maintenance work for the board-oriented working machine, and
Investigation and inspection work and recovery work for an abnormality that has occurred in the board-oriented work machine;
The work support system according to any one of claims 1 to 6, comprising at least one work of The operations performed by the operator include replenishment of parts consumed by a component supply device provided in a component mounting machine corresponding to the board-oriented work machine, replacement of a component holding fixture that holds a plurality of the components, and 8. The work support system according to claim 7, including at least one work of replacing said component supply device. The storage unit stores arrangement information of the storage item in a storage that stores the storage item, which is at least one of the parts for supply, the parts holding device for replacement, and the parts supply device for replacement. death,
The entity identification unit identifies the stored item used for the work of the operator,
The imaging unit acquires a vault view image by imaging the vault within the field of view of the operator,
The intra-image specifying unit specifies the position of the stored item specified by the entity specifying unit in the storage view image based on the arrangement information of the stored item,
The display unit displays the position of the storage item specified by the in-image specifying unit within the field of view of the operator or within the storage view image.
The work support system according to claim 8. The arrangement information of the stored items includes storage storage identification information for identifying a storage storage identification marker that is placed near the storage and identifies the storage storage, and relative information of the storage storage items to the storage storage identification marker. storage relative position information representing the position; and
The intra-image identifying unit identifies the storage container identification marker in the storage container view image, and further identifies the position of the storage product using the storage product relative position information.
The work support system according to claim 9. an identification code for identifying the stored item is attached to the stored item;
The storage has a code reader that reads the identification code,
The entity identification unit identifies the storage item used for the work based on the identification code read by the code reader.
The work support system according to claim 9 or 10.

Images