JP3921326B2 - Component mounting equipment - Google Patents

Description

[0001]
BACKGROUND OF THE INVENTION
The present invention relates to a component mounting apparatus for manufacturing a liquid crystal panel or the like, and more particularly to a component mounting apparatus for mounting a component on a substrate.
[0002]
[Prior art]
Conventionally, as a component mounting apparatus for manufacturing a liquid crystal panel or the like, a component for mounting a TAB-IC (Tape Automated Bonding-Integrated Circuit, hereinafter also referred to as “TAB”) on a liquid crystal substrate (hereinafter also referred to as “cell”). A mounting device is known.
[0003]
In such a component mounting apparatus, it is necessary to accurately recognize the relative positional relationship between the cell and the TAB in order to accurately join the leads respectively formed on the cell and the TAB. For this reason, in the conventional component mounting apparatus, the cell leads and TAB leads formed on the cells and TABs to be mounted are imaged by the imaging device, and image processing is performed on the captured images, thereby the cells and TABs. The position is detected. Specifically, for example, a feature portion (for example, a cross-shaped pattern) in a terminal pattern located at both ends of a cell lead group and a TAB lead group taught in advance is picked up by a matching method from picked-up images picked up by an image pickup device. The position of the cell and the TAB is detected by detecting the image recognition process (matching process).
[0004]
Here, as a method of previously teaching a pattern to be detected, after taking captured images of cell leads and TAB leads into the image processing apparatus, an area including a desired pattern included in the captured image and the area in the area A method of manually specifying the reference position is common. Specifically, for example, as shown in FIG. 6, the cursor 35 is moved on the monitor screen 30 on which the captured images of cell leads and TAB leads are displayed, and an area including a desired pattern 31 is designated as a start point 32 and an end point 33. Teach. Further, the reference position (here, the gravity center position of the pattern 31) in the area specified in this way is taught by specifying the reference point 34.
[0005]
[Problems to be solved by the invention]
As described above, in the conventional component mounting apparatus, the region including the pattern 31 and the reference position in the region on the monitor screen 30 on which the captured images of the cell lead and the TAB lead are displayed are the start point 32, the end point 33, and the reference point. The reference pattern is registered by teaching the three points 34, and the reference pattern taught in this way is detected from the captured image captured by the imaging device by the matching process, so that the cell and the TAB are registered. The position of is detected.
[0006]
However, in such a cell and TAB, the pattern 31 to be position-detected may be locally missing due to the influence of the foreign material 36 (see FIG. 7), or the pattern may be soiled or cracked. In addition, such cells and TABs may have unique color unevenness due to differences in production lots. Further, such cells and TABs may vary in the color of captured images due to the influence of members (an anisotropic conductive tape (ACF tape), etc.) for joining them.
[0007]
For this reason, in the conventional component mounting apparatus described above, there is often a difference between the reference pattern and the actual captured image to be recognized. In this case, matching between the two is performed. There is a problem that the rate is likely to decrease and a recognition error is likely to occur. If a recognition error occurs in this way, it is necessary for the operator to deal with human intervention or the like, increasing the burden on the operator and reducing the operating rate of the apparatus.
[0008]
The present invention has been made in consideration of such points, and an object of the present invention is to provide a component mounting apparatus capable of reliably and efficiently aligning a substrate and a component.
[0009]
[Means for Solving the Problems]
The present invention provides a component mounting apparatus that mounts a component on a board, an image pickup apparatus that picks up an area including a positioning mark in the board or the component, and the mark based on a captured image picked up by the image pickup apparatus. And a matching process is performed between the plurality of taught reference patterns and a captured image captured by the imaging device, whereby the board or the component has the An image processing apparatus that detects a position of a mark, and an alignment apparatus that performs alignment between the substrate and the component based on the position of the mark detected by the image processing apparatus. A component mounting apparatus is provided.
[0010]
In the present invention, the image processing apparatus registers a plurality of patterns of different portions in the same mark in the same board or component as the plurality of reference patterns, and sequentially extracts the plurality of registered patterns. In addition, it is preferable that the matching process is repeatedly performed until the matching rate between the extracted pattern and the captured image captured by the imaging device is equal to or higher than a predetermined allowable value.
[0011]
In the present invention, the image processing apparatus registers a plurality of patterns of the same type of marks in different substrates or components as the plurality of reference patterns, and sequentially extracts the plurality of registered patterns. It is preferable that the matching process is repeatedly performed until the matching rate between the extracted pattern and the captured image captured by the imaging device is equal to or greater than a predetermined allowable value.
[0012]
According to the present invention, a plurality of reference patterns are registered in the image processing device in advance, and the matching rate between the registered reference pattern and the captured image captured by the imaging device is predetermined by the image processing device. Since the matching process is repeated until the value exceeds the allowable value, the occurrence of a recognition error can be suppressed, and an increase in the operator's burden due to manual intervention or the like and a reduction in the operating rate of the apparatus can be prevented.
[0013]
According to the present invention, by registering a plurality of patterns of different portions in the same mark in the same substrate or component, local defects (substrate or component pattern in each substrate or component) are registered. Can be effectively dealt with in the case of local chipping due to the influence of foreign matter, or when the substrate or component pattern is soiled or cracked.
[0014]
In addition, according to the present invention, by registering a plurality of patterns of the same type of mark in different types of boards or components, unique characteristics of the board or components (the colors of the boards or components depending on the production lots are different). It is possible to effectively cope with the case where unevenness or the like occurs, or variation in the hue or the like of the captured image occurs due to the influence of an ACF tape or the like for joining the substrate and components.
[0015]
DETAILED DESCRIPTION OF THE INVENTION
Embodiments of the present invention will be described below with reference to the drawings. 1 to 5 are diagrams for explaining an embodiment of a component mounting apparatus according to the present invention.
[0016]
As shown in FIG. 1, the component mounting apparatus is for mounting a TAB (component) 4 on a cell (substrate) 1, and the cell 1 is used as an alignment apparatus for aligning the cells 1 and TAB 4. Of the entire apparatus by controlling the driving of the first stage 6 for moving the TAB 4 in the X, Y direction, the second stage 7 for moving the TAB 4 in the X, Y direction, and the first stage 6 and the second stage 7. And a controller 20 that supervises the above. The cell lead 3 and the TAB lead 5 are respectively formed in the cell 1 and the TAB 4, and the cell lead 3 and the TAB lead 5 are joined to each other through an anisotropic conductive film (not shown) by the crimping device 22. As a result, the TAB 4 is mounted on the cell 1.
[0017]
Further, the component mounting apparatus includes an imaging camera (imaging apparatus) 12a that sequentially images the left and right cell marks 2 on one side of the cell 1, and the left and right sides of the cell lead group and the TAB lead group among the cells 1 and TAB4. Imaging cameras (imaging devices) 12b and 12c that respectively capture the end regions are provided.
[0018]
As shown in FIG. 2, the imaging camera 12b includes a characteristic portion of the left cell lead portion (hereinafter simply referred to as “left cell lead portion”) (first mark) 3L and a corresponding characteristic portion of the left TAB lead portion of the TAB 4 ( Hereinafter, the left end region (imaging region 8) including the “left TAB lead portion” (second mark) 5L is imaged, and the imaging camera 12c has a characteristic portion of the right cell lead portion of the cell 1 (hereinafter simply “ Right end including right-side cell lead portion) (first mark) 3R and corresponding portion of right-side TAB lead portion of TAB 4 (hereinafter simply referred to as “right-side TAB lead portion”) (second mark) 5R An area (imaging area 9) is imaged.
[0019]
Here, the image processing apparatus 10 is connected to the imaging cameras 12a, 12b, and 12c, the position of the cell mark 2 is detected by image processing based on the captured image captured by the imaging camera 12a, and the imaging camera 12b. , 12c, the positions of the left cell lead portion 3L, the right cell lead portion 3R, the left TAB lead portion 5L, and the right TAB lead portion 5R of the cells 1 and TAB4 are detected by image processing based on the picked-up images. Yes. A monitor 11 is connected to the image processing apparatus 10, and captured images captured by the imaging cameras 12 a, 12 b, and 12 c are displayed on the monitor 11. The image processing apparatus 10 is connected to a controller 20 to which an operation panel 21 is connected. The position of the cell mark 2 detected by the image processing apparatus 10, the left cell lead portion 3L of the cells 1 and TAB 4, and the right side. The driving of the first stage 6 and the second stage 7 is controlled based on the positions of the cell lead portion 3R, the left TAB lead portion 5L, and the right TAB lead portion 5R.
[0020]
Here, the image processing apparatus 10 uses the left and right cell marks 2, the left cell lead portion 3L, the right cell lead portion 3R, the left TAB lead portion 5L, and the right TAB based on the captured images captured by the imaging cameras 12a, 12b, and 12c. A plurality of reference patterns corresponding to the lead portion 5R are taught, and a matching process is performed between the taught reference patterns and captured images captured by the imaging cameras 12a, 12b, and 12c. The positions of the left cell lead portion 3L, the right cell lead portion 3R, the left TAB lead portion 5L, and the right TAB lead portion 5R that the 1 and TAB 4 respectively have are detected.
[0021]
FIG. 3 is a block diagram showing a main part of the component mounting apparatus shown in FIG. As shown in FIG. 3, the image processing apparatus 10 includes an image input unit 13 that captures captured images captured by the imaging cameras 12a, 12b, and 12c. Here, the captured image captured by the image input unit 13 is subjected to multi-value processing or binarization processing by the image input unit 13, and based on a command from the control unit 19, the reference pattern registration unit 14 or the target image is received. It is selectively sent to one of the inspection pattern registration units 15.
[0022]
The reference pattern registration unit 14 registers a plurality of reference patterns 41, 42,..., 4n sent from the image input unit 13. As the plurality of reference patterns 41, 42,..., 4n, a plurality of patterns of different portions in the same mark in the same cell 1 and TAB 4 can be registered as shown in FIG. Further, as shown in FIGS. 5A and 5B, a plurality of mark patterns of the same type in different types of cells 1 and TABs 4 may be registered. FIG. 4 shows a case where reference patterns 41, 42, and 43 from the first candidate to the third candidate are registered for the left TAB lead portion 5L. 5A and 5B, the first candidate and the second candidate reference pattern 41 (41 ') for the left cell lead portion 3L and the left TAB lead portion 5L of each of the two types of cells 1 and TAB4. , 42 (42 ′) are registered.
[0023]
The inspected pattern registration unit 15 stores the image sent from the image input unit 13, and the stored captured image is sent to the comparison unit 18 based on a command from the control unit 19. Yes.
[0024]
The designation candidate update unit 16 extracts the reference patterns 41, 42,..., 4n from the reference pattern registration unit 14 in order from the first candidate to the designation candidate extraction unit 17 based on a command from the control unit 19. This command is issued. When there are no candidates for the reference patterns 41, 42,..., 4n to be extracted from the reference pattern registration unit 14 (when the nth pattern has been extracted), this is returned to the control unit 19.
[0025]
The designated candidate take-out unit 17 takes out the designated reference patterns 41, 42,..., 4n from the reference pattern registration unit 14 based on a command from the designation candidate update unit 16.
[0026]
The comparison unit 18 performs matching processing between the reference patterns 41, 42,..., 4n extracted from the designated candidate extraction unit 17 and the captured image transmitted from the inspected pattern registration unit 15. The processing result (matching rate and position information of the matched pattern) is sent to the control unit 19.
[0027]
The control unit 19 controls the image input unit 13, the inspected pattern registration unit 15, the designation candidate update unit 16, and the comparison unit 18, and issues predetermined commands to these units. The control unit 19 is preset with an allowable value of the matching rate (for example, 80%). Based on the processing result sent from the comparison unit 18, the obtained matching rate is greater than or equal to a predetermined allowable value. It is determined whether or not there is. When the control unit 19 determines that the obtained matching rate is smaller than a predetermined allowable value, a command to update the candidate for the reference pattern is issued to the designation candidate update unit 16. It has become. On the other hand, when it is determined that the obtained matching rate is equal to or greater than a predetermined allowable value, the position information of the obtained pattern is sent to the controller 20.
[0028]
Next, the operation of the present embodiment having such a configuration will be described.
[0029]
First, the operator uses the operation panel 21 connected to the controller 20 to register a registration mode in which a reference pattern is taught to the image processing apparatus 10 or a recognition mode in which matching processing is performed using the reference pattern in the image processing apparatus 10. Select one of the following.
[0030]
Here, when the registration mode is selected, the selection signal is sent from the controller 20 to the control unit 19 of the image processing apparatus 10, and the captured images taken into the image input unit 13 from the imaging cameras 12a, 12b, and 12c are sequentially displayed. It is displayed on the monitor 11.
[0031]
The operator operates the operation panel 21 while looking at the monitor screen displayed on the monitor 11, and controls the left and right cell marks 2, the left cell lead portion 3L, the right cell lead portion 3R, the left TAB lead portion 5L, and the right TAB lead portion 5R. A plurality of reference patterns 41, 42,..., 4n corresponding to each are sequentially taught (see FIG. 4 and FIGS. 5A and 5B).
[0032]
At this time, as shown in FIG. 6, the operator moves the cursor 35 on the monitor screen by operating the operation panel 21 in a state where the captured images of the cell lead 3 and the TAB lead 5 are displayed on the monitor 11. In each of the TAB lead 5, an area including a desired pattern 31 is taught by specifying a start point 32 and an end point 33. Further, the reference position in the area specified in this way is taught by specifying the reference point 34. The same applies to the cell mark 2.
[0033]
The image input unit 13 receives such a teaching signal (registration signal) from the controller 20 via the control unit 19, and is designated by the pattern (image) in the area surrounded by the start point 32 and the end point 33 and the reference point 34. The obtained reference position is sent to the reference pattern registration unit 14 as a reference pattern. The reference pattern registration unit 14 includes, as the first candidate, the second candidate,..., The nth candidate reference patterns 41, 42,. Each of the 3L, 3R and TAB lead parts 5L, 5R is registered.
[0034]
On the other hand, when the recognition mode is selected, the selection signal is sent from the controller 20 to the control unit 19 of the image processing apparatus 10. In this state, when captured images captured by the imaging cameras 12a, 12b, and 12c are taken into the image input unit 13, the captured images are sent to the inspected pattern registration unit 15 and stored therein.
[0035]
The captured image sent to the inspected pattern registration unit 15 is sent to the comparison unit 18 based on an instruction from the control unit 19, and is first extracted from the designated candidate extraction unit 17 in the comparison unit 18 (first (first) (Candidate) reference pattern 41 and the captured image sent from the inspected pattern registration unit 15 are subjected to matching processing, and the cell mark 2, cell 1 and TAB 4 have the left cell lead unit 3L and the right cell lead unit 3R, respectively. The positions of the left TAB lead portion 5L and the right TAB lead portion 5R are detected. Then, the processing result (matching rate and matched pattern position information) is sent to the control unit 19.
[0036]
Here, an allowable value of the matching rate (for example, 80%) is set in the control unit 19 in advance, and the obtained matching rate is greater than or equal to a predetermined allowable value based on the processing result sent from the comparison unit 18. It is determined whether or not.
[0037]
When the control unit 19 determines that the obtained matching rate is smaller than the predetermined allowable lower limit value, the control unit 19 corresponds to the detection target unit determined to be small for the designation candidate update unit 16. A command is issued to update the reference pattern candidates. Based on the command from the control unit 19, the designation candidate update unit 16 instructs the designation candidate extraction unit 17 to sequentially extract the reference patterns 42,..., 4n from the reference pattern registration unit 14 from the second candidates. Put out. The designated candidate take-out unit 17 takes out the designated reference patterns 42,..., 4n from the reference pattern registration unit 14 based on a command from the designated candidate update unit 16. Then, the matching process is repeatedly performed until the matching rate between the extracted reference patterns 42,..., 4n and the captured images captured by the imaging cameras 12a, 12b, 12c is equal to or greater than a predetermined allowable value.
[0038]
On the other hand, when it is determined that the obtained matching rate is equal to or greater than a predetermined allowable value, the position information of the obtained pattern is sent to the controller 20. The controller 20 controls the driving of the first stage 6 and the second stage 7 based on the obtained pattern position information. Specifically, for example, when the component mounting apparatus is a temporary pressure bonding apparatus, and information regarding the position of the cell mark 2 or the like on the cell 1 or information regarding the relative position between the cell 1 and the TAB 4 is obtained as pattern position information. First, the X and Y positions of the first stage 6 and the rotation angle θ are controlled.
[0039]
In addition, when the command to update the reference pattern candidate is issued from the control unit 19 to the designated candidate update unit 16, the candidates of the reference patterns 42,..., 4n to be extracted from the reference pattern registration unit 14 If there is no more (when the nth data has been taken out), the fact is returned to the control unit 19. The control unit 19 receives this signal, determines that a recognition error has occurred, and sends a recognition error signal to the controller 20. When receiving the recognition error signal, the controller 20 stops the operation of the component mounting apparatus and issues an alarm (monitor display, buzzer, etc.) for prompting the operator to recover.
[0040]
As described above, according to the present embodiment, a plurality of reference patterns 41, 42,..., 4n are registered in advance in the image processing apparatus 10, and the registered reference patterns 41, 42 are registered by the image processing apparatus 10. ,..., 4n and the matching process are repeatedly performed until the matching rate between the captured images captured by the imaging cameras 12a, 12b, and 12c exceeds a predetermined allowable value. It is possible to prevent an increase in the burden on the operator and a decrease in the operating rate of the apparatus.
[0041]
In particular, according to the present embodiment, by registering a plurality of patterns of different portions in the same mark in the same cell 1 and TAB 4, local defects (cells in each cell 1 and TAB 4). 1 and TAB4 patterns are locally missing due to the influence of foreign matter, or the patterns of cells 1 and TAB4 are soiled, cracked, etc.).
[0042]
In addition, according to the present embodiment, by registering a plurality of mark patterns of the same type in different types of cells 1 and TAB4, the unique characteristics of cells 1 and TAB4 (cells 1 and TAB4 are the production lots). This method effectively copes with the case where unique color unevenness or the like is caused by the difference, or the color tone or the like of the captured image varies due to the influence of the ACF tape for joining the cells 1 and TAB4. be able to.
[0043]
In the above-described embodiment, the control unit 19 of the image processing apparatus 10 sets a matching ratio allowable value (for example, 80%) common to all the reference patterns 41, 42,..., 4n. Not limited to this, for example, the reference pattern registration unit 14 may hold an allowable value of the matching rate corresponding to each of a plurality of patterns, and the control unit 19 may repeatedly perform the matching process based on the held content. Good. Thereby, more flexible matching processing can be realized in consideration of the characteristics of the cell 1 and the TAB 4, the characteristics of the reference patterns 41, 42,.
[0044]
Further, in the above-described embodiment, the cell 1 and the cell lead group 3L, the right cell lead portion 3R, the left TAB lead portion 5L, and the right TAB lead portion 5R are patterned using the pattern of the cell lead group and the TAB lead group. Although the position of TAB 4 is detected, the present invention is not limited to this, and the positions of cell 1 and TAB 4 may be detected using marks dedicated to cells 1 and TAB 4.
[0045]
【The invention's effect】
As described above, according to the present invention, a plurality of reference patterns are registered in the image processing apparatus in advance, and the registered reference pattern and the captured image captured by the imaging apparatus are registered by the image processing apparatus. Since the matching process is repeatedly performed until the matching rate is equal to or higher than a predetermined allowable value, it is possible to suppress the occurrence of a recognition error and to prevent an increase in the burden on the operator due to manual intervention or the like and a reduction in the operating rate of the apparatus. For this reason, alignment with a board | substrate and components can be performed reliably and efficiently.
[Brief description of the drawings]
FIG. 1 is a diagram showing an overall configuration of an embodiment of a component mounting apparatus according to the present invention.
FIG. 2 is a diagram for explaining an imaging area of the imaging camera shown in FIG. 1;
FIG. 3 is a block diagram showing a main part of the component mounting apparatus shown in FIG. 1;
FIG. 4 is a view for explaining an example of a method for previously teaching a pattern to be detected in the component mounting apparatus shown in FIG. 1;
FIG. 5 is a view for explaining another example of a method for previously teaching a pattern to be detected in the component mounting apparatus shown in FIG. 1;
FIG. 6 is a diagram for explaining a state in which a desired pattern is taught on a monitor screen.
FIG. 7 is a diagram showing an example of a pattern to be recognized displayed on a monitor screen (when a recognition error occurs).
[Explanation of symbols]
1 cell (substrate)
2 Cell mark 3 Cell lead 3L Left cell lead part (first mark)
3R Right cell lead (first mark)
4 TAB (parts)
5 TAB lead 5L Left TAB lead (second mark)
5R Right TAB lead (second mark)
6 First stage 7 Second stage 10 Image processing device 11 Monitors 12a, 12b, 12c Imaging camera (imaging device)
DESCRIPTION OF SYMBOLS 13 Image input part 14 Reference | standard pattern registration part 15 Inspection pattern registration part 16 Specification candidate update part 17 Specification candidate extraction part 18 Comparison part 19 Control part 20 Controller 21 Operation panel 22 Crimping apparatus 41, 42, ..., 4n Reference pattern

Claims (2)

In a component mounting device that mounts components on a board,
An imaging device for imaging an area including a positioning mark on a substrate or a component;
A plurality of reference patterns corresponding to the mark are taught based on a picked-up image picked up by the image pickup device, and between the plurality of reference patterns taught and a picked-up image picked up by the image pickup device. An image processing device that detects a position of the mark included in the substrate or the component by performing a matching process;
An alignment device that performs alignment between the substrate and the component based on the position of the mark detected by the image processing device ;
The image processing apparatus registers a plurality of patterns of different portions in the same mark in the same board or component as the plurality of reference patterns, sequentially takes out the plurality of registered patterns, and takes them out A component mounting apparatus, wherein the matching process is repeatedly performed until a matching rate between a pattern and a captured image captured by the imaging apparatus is equal to or greater than a predetermined allowable value. The image processing apparatus according to claim 1, in correspondence with each of the plurality of patterns retain the tolerance of the matching ratio, the image processing apparatus and performs repeatedly the matching processing based on the contents held The component mounting apparatus described.

Images