JP2004110703A - Environmental load evaluation system and environmental load evaluation method - Google Patents

Abstract

<P>PROBLEM TO BE SOLVED: To precisely perform the evaluation of an environmental load in an environmental load evaluation system and method. <P>SOLUTION: This system has image acquisition units 2, 3 and 6 for fetching image data of a part-mounted substrate 1 to be evaluated; a part database 71 including collation data and environment load data for a plurality of parts; a collation unit 6 for collating the image data with the collation data of the part database; a matching rate unit 6 for calculating, when the image data are not matched to the collation data, the matching rate of the patterns of preliminarily prepared parts with the image data of the parts of the substrate 1; and an environmental load calculation unit 6 for specifying a part having the highest matching rate with the preliminarily prepared part as a part to be evaluated, and extracting the environmental load data of the specified part from an environmental load database 72, thereby determining the environmental load data of the substrate 1 to be evaluated. <P>COPYRIGHT: (C)2004,JPO

Description

[0001]
TECHNICAL FIELD OF THE INVENTION
The present invention relates to an environmental load evaluation system and an environmental load evaluation method for a substrate on which electronic components are mounted (hereinafter, referred to as a component mounting substrate).
[0002]
[Prior art]
Conventionally, the life cycle from product manufacturing to disposal is divided into raw material collection and transportation, material production, parts production, product production and transportation, use, recycling, and disposal. Life cycle assessment refers to determining the amount of consumption and the type and amount of emissions, and quantitatively evaluating the impact on the environment by integrating them. As a prior art relating to life cycle assessment, for example, Japanese Patent Application Laid-Open Nos. 7-31760 and 2000-553 disclose an environmental load evaluation method and apparatus.
[0003]
Further, the environmental load evaluation method and apparatus disclosed in Japanese Patent Application Laid-Open No. H10-31760 investigates the relationship between the types and dimensions of components and the environmental load in advance and creates a database to reduce the environmental load of the component mounting board. Attempts have been made to reduce the labor and time required for the evaluation of the components.However, even if information on the circuit configuration at the design stage is known for the actual component mounting board, Or, because a designed part is not procured and a substitute part is used, it is usual that when a circuit board is actually manufactured, it is not known what kind of part is mounted on the board. Therefore, the components mounted on each board are specified by visual inspection, document inspection, or the like, and the type and number of the components manually specified in this manner are used for calculating the environmental load.
[0004]
In such manual work, in some cases, the work of removing and inspecting the soldered parts from the board or measuring the size to evaluate information such as the type and dimensions of the parts on the board May be required. In electrical products, as the circuit becomes more complicated, the number of components mounted on a substrate is increasing at an accelerating rate. Therefore, it is troublesome and time-consuming to manually evaluate the environmental load of a huge number of parts by going back to the manufacturing stage.
[0005]
In order to solve this problem, the applicant of the present application has proposed, on June 21, 2002, an “environmental load evaluation system and an environmental load evaluation method” that can automatically evaluate the environmental load of a component mounting board in a short time. A patent application for the subject invention was filed (see Japanese Patent Application No. 2002-181744).
[0006]
The environmental load evaluation system includes an image acquisition unit that captures image data obtained by capturing an image of a component mounting board to be evaluated, a component database including collation data and environmental load data for a plurality of components, and a collation of the image data with the component database. Identifies each component of the component mounting board to be evaluated by comparing it with the application data, and extracts environmental load data of the specified component from the component database to obtain the environmental load data of the component mounting board to be evaluated. And a collating unit.
[0007]
The system also includes a weight data unit that captures weight data obtained by measuring the weight of the component mounting board to be evaluated, and a board determination database that includes collation data and environmental load data for a plurality of component mounting boards. The collation unit executes a first collation process for evaluating the component mounting board to be evaluated as a whole by collating the image data and the weight data with the collation data in the board determination database, and the first collation process specifies If the process fails, a second matching process for specifying each component of the component mounting board to be evaluated is executed.
[0008]
According to this environmental load evaluation system, based on the image data captured by the camera and the measured weight data, the board determination database or the component database is referred to recognize and specify the component mounting board or the component on the board. In addition, the environmental load of the component mounting board can be obtained. Therefore, it is now possible to accurately evaluate the environmental impact of component mounting boards for electrical products, which has been done manually for a long time, in a short time without manual labor, and to save labor in the life cycle assessment. Cost reduction can be realized.
[0009]
[Patent Document 1]
Japanese Patent Application No. 2002-181744 (paragraphs [0020] to [0045] in [Claims], [Detailed Description of the Invention] and
4 to 8 in the drawings).
[0010]
[Problems to be solved by the invention]
However, although the environmental load evaluation system proposed in the above-mentioned Japanese Patent Application No. 2002-181744 can automatically evaluate the environmental load of the component mounting board in a short time, the recognition rate becomes low when the number of component data held by the system is small, All components on the board that do not match the component data are allocated, that is, the environmental load of the unmatched components is distributed and assigned to the matched components. There is a problem that it is difficult to evaluate the load.
[0011]
Therefore, an object of the present invention is to solve the above-mentioned problem, that is, to provide an environmental load evaluation system and an environmental load evaluation method for accurately evaluating an environmental load.
[0012]
[Means for Solving the Problems]
To achieve the above object, an environmental load evaluation system (method) according to a first embodiment of the present invention includes: an image acquisition unit that captures image data obtained by capturing an image of a component mounting board to be evaluated; A parts database including load data, a matching unit that matches the image data with matching data of the parts database, and when the image data and the matching data do not match according to the matching result of the matching unit, A matching ratio unit that calculates a matching ratio between the image data of the component on the component mounting board to be evaluated and the image pattern of the component prepared in advance, and the image data and the matching data match according to the matching result of the matching unit. If not, the matching rate unit is used to calculate from the previously prepared parts. Identify the component with the highest matching rate as the component to be evaluated, and when the image data and the data for collation match by the collation result of the collation unit, identify each component of the component mounting board to be evaluated, An environmental load calculation unit for extracting environmental load data of the component mounting board to be evaluated by extracting environmental load data of each specified component from the environmental load database.
[0013]
In the environmental load evaluation system (method) according to the first aspect, when a matching rate calculated by the matching rate unit is larger than a predetermined threshold, a component having a highest matching rate is specified as the component to be evaluated, When the calculated matching ratio is equal to or less than a predetermined threshold value, an allocation unit is provided for allocating the environmental load to the environmental load of the specified component without specifying the component to be evaluated.
[0014]
The environmental load evaluation system (method) according to the first aspect, further comprising a weight measurement unit that measures the weight of the component mounting board to be evaluated, wherein the comparison data in the component database includes component weight data, The environmental load amount of the component that is not specified because the image data and the data for collation do not match according to the collation result of the collation unit is converted into the weight of the component mounting board and the weight data of the component stored in the component database. Based on the collation result of the collation unit, the image data and the collation data are matched and allocated to the environmental load amount of the specified component.
[0015]
An environmental load evaluation system (method) according to a second embodiment of the present invention that achieves the above object includes an image acquisition unit that captures image data obtained by capturing an image of a component mounting board to be evaluated, collation data and an environment for a plurality of components. A parts database including load data, a matching unit that matches the image data with matching data of the parts database, and when the image data and the matching data do not match according to the matching result of the matching unit, A storage unit that extracts a similar component from another information source based on the image data of the component to be evaluated, and stores environmental load data of the extracted component.
[0016]
In the environmental load evaluation system (method) according to the second aspect, environmental load data of components stored in the storage unit is obtained via the Internet.
[0017]
BEST MODE FOR CARRYING OUT THE INVENTION
Hereinafter, embodiments of the present invention will be described with reference to the accompanying drawings.
[0018]
FIG. 1 is a configuration diagram of an environmental load evaluation system for a component mounting board according to a first embodiment of the present invention. An environmental load evaluation system 10 according to the present invention shown in FIG. 1 is a camera (image acquisition unit) that is fixed on a component mounting board (hereinafter simply referred to as a board) 1 to be evaluated and captures image data of the board 1. 2, an illumination device 3 fixed on the substrate 1, and illuminating the substrate 1, a scale 4 for measuring the weight of the substrate 1, a stage 5 on which the scale 4 on which the substrate 1 is mounted, a camera 2, an illumination device 3, It has a control device 6 connected to the balance 4 and the stage 5.
[0019]
An external storage device 7, for example, a magnetic disk, is connected to the control device 6. The external storage device 7 has a collation database (DB) that records collation data on a plurality of components on the board 1 and component mounting boards. ) 71 and an environmental load database (DB) 72 which records environmental load data on a plurality of components and component mounting boards.
[0020]
FIG. 2 is a detailed view of the control device 6 shown in FIG. The control device 6 includes a computer main body 60, an input device 61 such as a keyboard 611 and a mouse 612, an output device 62 such as a display 621 and a printer 622, and programs and programs between the computer main body 60 and an external computer via a LAN or the Internet. It has a communication device 63 for transmitting and receiving data.
[0021]
The computer main body 60 includes a CPU 601, a RAM 602 as a main storage device used as a temporary storage area for programs and data executed by the CPU 601 and a work area of the CPU 601, a ROM 603 for storing fixed programs and data, and a RAM 602 as necessary. An auxiliary storage device 604 composed of a magnetic disk or the like for storing programs and data to be loaded, a reading device 605 for a program or data recording medium M such as a flexible disk FD or a compact disk CD, a CPU 601, an input device 61, and an output device 62 Alternatively, it has an interface 606 for communicably connecting with the communication device 63. The CPU 601, the RAM 602, the ROM 603, the auxiliary storage device 604, the reading device 605, and the interface 606 are communicably connected to each other via a bus line 607.
[0022]
The control device 6 includes a stage driving device that moves the stage 5 in three-dimensional directions and rotates the stage 5 around each dimensional direction. In the present embodiment, the camera 2 is fixed, and the stage 5 is moved in the three-dimensional direction or rotated around each moving direction. However, the stage 5 is fixed, and the camera 2 is moved in the three-dimensional direction instead of the stage 5. Alternatively, other forms such as moving in a different direction or rotating around each moving direction may be adopted.
[0023]
The illumination device 3 has a configuration in which the color of the illumination light and the irradiation angle of the illumination light with respect to the substrate 1 can be selected so that the contrast of the components on the substrate 1 can be as large as possible. By sending a switching signal from the control device 6 to the illumination device 3, the color of the illumination light is selected from W (white), R (red), G (green) or B (blue), and the irradiation angle is set to the substrate 1 Illuminating light is selected from right above, upper left, upper right, upper front, or upper rear.
[0024]
3A and 3B are diagrams illustrating a specific example of a collation database, wherein FIG. 3A is a diagram illustrating a component collation database, and FIG. 3B is a diagram illustrating a board collation database. As shown in FIG. 3A, the collation DB 71 stores a table in which the components mounted on the substrate 1, that is, the electronic device names, element numbers (No.), and patterns are written. As shown in FIG. 3A, as element names, a logic IC, a memory, a resistor, a capacitor, and the like are assigned. , Each No. Is marked with a pattern. This pattern is image data for collating with the image data of the part to be collated. As shown in FIG. 3B, the collation DB 71 stores a board name, a board number (No.) indicating each function of the board 1 and each No. Is stored in the table. This pattern is image data for collating with the image data of the substrate to be collated.
[0025]
First, after the camera 2 acquires the image data of the board 1, the acquired image data is specified on the basis of the board collation DB 71. If it is impossible to specify the board 1, the board 1 is specified based on the part collation DB 71 by recognizing each component on the board 1. The environmental load data corresponding to the substrate 1 is calculated from the environmental load DB 72 based on the specified data of the substrate 1. In this case, for a component that cannot be specified, matching is performed with the general component shape pattern shown in FIG. 3A stored in the component DB 71, and the image data of the component to be compared and the image in each DB 71 are matched. The matching rate with the data is calculated, and the part to be matched is regarded as the part of the image data with the highest matching rate. Here, allocation is performed for components whose matching ratio does not satisfy a fixed value (60%). Here, the allocation refers to a process of allocating the environmental load of a component that cannot be identified, in accordance with the area of the image data of the component whose environmental load has been identified.
[0026]
Shape recognition for component identification is performed by moving the stage in a two-dimensional (planar) direction. When the movement of the stage in the two-dimensional direction is insufficient, the stage is rotated in three-dimensional directions and around each direction. By doing so, it is possible to recognize image data with higher contrast or characters written on components.
[0027]
FIG. 4 is a diagram showing functional modules of a program of the environmental load evaluation method. The program of the environmental load evaluation method according to the present invention includes an image recognition module 401, a camera control module 402, a scanning module 403, a matching module 404, a tallying / report module 405, an allocation module 406, a graphing module 407, and a weight data acquisition module 408. Including.
[0028]
The image recognition module 401 analyzes image data captured from the camera 2.
[0029]
The camera control module 402 controls the camera 2 to adjust the zoom, focus, imaging position, and the like, and causes the substrate 1 to be imaged.
[0030]
The scanning module 403 captures the image data captured by the camera 2 into the RAM 602 in the computer main body 60.
[0031]
The matching module 404 identifies the board 1 or a component on the board 1 by comparing the image data with the data in the board DB and the component DB of the matching DB based on the result of the image recognition.
[0032]
The tabulation / form module 405 summarizes the environmental load evaluation data of each specified component based on the result of the image recognition / target specification.
[0033]
The allocation module 406 assigns an environmental load to components that cannot be recognized and specified among the components on the board 1 to be evaluated with reference to the recognized and specified component data.
[0034]
The graphing module 407 graphs and displays data on the environmental load calculated for the substrate 1.
[0035]
The weight data acquisition module 408 loads the weight data from the scale 4 into the RAM 602 in the computer main body 60.
[0036]
The above-described module is a functional module of a program executed by the CPU 601 in the computer main body 60, and operates as a functional unit of the control device 6 at the time of execution. The camera control module 402 and the scanning module 403 may constitute a functional unit for acquiring image data. The image recognition module 401 and the matching module 404 may constitute a functional unit for recognition and collation.
[0037]
Next, an environmental load evaluation method according to the present invention will be described.
[0038]
FIG. 5 is a flowchart of a process of the first environmental load evaluation method for the component mounting board according to the first embodiment of the present invention. The configuration of the device is the same as that shown in FIG. 1, in which the camera 2 moves and the stage 5 is fixed.
[0039]
In step ST1, the accuracy of the matching process in the environmental load evaluation is set by setting an initial value of the image recognition accuracy. This is to set conditions for matching determination by setting the number of parameters to be matched and the parameter range for determining matching when matching (collating) captured image data with board data or component data. is there.
[0040]
In step ST2, the measurement of the substrate 1 is started by the control device 6. A measurement instruction is sent from the camera control module 402 to the camera 2, and the scanning module 403 captures image data capable of grasping the layout of the entire substrate 1.
[0041]
In step ST3, image data of the entire substrate 1 is fetched, and the area of the substrate 1 is measured. An image recognition process is performed by the image recognition module 401 on the image data of the entire substrate 1.
[0042]
In step ST4, the weight of the substrate 1 is measured by the scale 4 by the weight data acquisition module 408, and the weight data is acquired.
[0043]
In step ST5, it is determined from the image data of the entire substrate 1 whether or not the substrate has already been measured. More specifically, the matching module 404 compares the image analysis result and the weight data of the substrate 1 with the data of the substrate DB to determine whether or not the substrate 1 matches the substrate data of the substrate DB. If the result of the determination is YES, the process proceeds to step ST15, where the result is displayed in ST15, and this routine ends. If the determination result is NO, the process proceeds to step ST6, the camera 2 is operated in ST6, and the process proceeds to step ST7. In this embodiment, only the camera 2 is provided. However, if an X-ray camera is provided, not only image data of a visible image but also image data of a hidden part can be obtained.
[0044]
In steps ST7, ST8, ST9, ST10, ST21, and ST22, the scanning of each component on the board 1 is started, and when the camera 2 detects the coordinate end point on the board 1, the data is totaled, and the environmental load is recorded. Work is performed (process A). Here, the process A will be described below.
[0045]
The control device 6 acquires from the external storage device 7 information that associates the image data such as the types and sizes of the boards and components with the environmental load (step ST20). Next, items to be recognized for the component are listed (a: shape, b: color, c: nameplate, etc.), and it is checked whether all items can be recognized using the image data obtained by scanning in step ST7. In other words, two types of information (association information and image data) are matched using the arithmetic unit of the control device 6, and the type of each component (LSI, resistor, capacitor, etc.) mounted on the board 1 by pattern recognition by pattern recognition. ) Is recognized (pattern matching: steps ST6, ST7, ST8).
[0046]
The environmental load of the component is calculated from the recognized data (pattern matching: steps ST6, ST7, ST8).
[0047]
In step ST21, for unrecognizable image data, matching is performed with a general component image, and a matching ratio is calculated.
[0048]
In step ST22, a part having a matching rate of 60% or more is regarded as the part type, and the area is calculated. For other components, the area is calculated as unrecognizable component data and stored in the external storage device 7 of the control device 6 (step ST23). Scanning is performed (step ST7) until the coordinates become END (step ST8), and the above operation is repeated (until the coordinate end point of the substrate 1 is detected).
[0049]
When the tabulation and reporting are completed in step ST10, the process A is terminated. In step ST11, the recognition rate (the sum of the masses of the board and the recognized components and the ratio of the mass of the entire board) is calculated from the tabulation result. As a result, if the value of the recognition rate is less than 0.9, the image recognition accuracy is reduced (the number of items required for recognition is reduced: three to two), and the result is fed back to the above-described pattern recognition work (step ST12). , ST13).
[0050]
The feedback is repeated twice. When the recognition rate becomes 0.9 or more in step ST11, the unrecognized data is allocated (step ST14), and the final environmental load evaluation result is displayed on the display connected to the control device 6. 621 is displayed in a chart format (step ST15).
[0051]
FIG. 6 is a detailed flowchart of the matching rate calculation processing in the processing A shown in FIG. 5, and FIG. 7 is an explanatory diagram of the matching rate calculation. FIG. FIG. 7B is a diagram illustrating an example of calculating the matching ratio, and FIG. 8B is a diagram illustrating an example of calculating the matching ratio by checking the match / mismatch of the contours.
[0052]
In step ST1, components for which a matching ratio is to be calculated are selected. In this selection, the category of the element similar to the pattern stored in the part DB shown in FIG. 3A in the collation DB 71 determines one of the logic IC, the memory, the resistor, the capacitor, and the like.
[0053]
In step ST2, each No. in the same category is selected. Calculate the matching rate for the part. Here, a calculation example of the matching ratio will be described.
[0054]
FIG. 7A shows an example in which matching / mismatching of image data is checked in pixel units and a matching ratio is calculated. The number of pixels that match and the number of pixels that do not match within a predetermined range of the image data are counted, and a matching ratio is calculated by the following equation.
[0055]
Matching rate = (number of matched pixels / (number of matched pixels + number of mismatched pixels)) * 100
FIG. 7B shows an example in which matching / mismatching of contours is checked and a matching ratio is calculated. Specifically, a perimeter L1 whose contour is coincident with a perimeter L2 whose contour does not coincide with the entire perimeter TL (= L1 + L2) is calculated from the ratio of the coincidence of the characteristic shapes, and a matching ratio is calculated by the following equation.
[0056]
Matching rate = (L1 / (L1 + L2)) * 100
In step ST3, it is determined that the component for which the matching ratio has been calculated is a component in the same category as the component having the highest matching ratio.
[0057]
In step ST4, cutting out, counting, and area calculation are performed. Here, “cutting out” means to insert a check indicating that the component has been specified.
[0058]
In step ST5, the data is totaled and a form is output.
[0059]
Next, an operation of cutting out commonly used parts will be described.
[0060]
FIGS. 8A and 8B are explanatory diagrams of a component cutting operation, in which FIG. 8A is a diagram illustrating a component mounting board to be worked, and FIG. 8B is a diagram illustrating a result of the component cutting operation. The image processing function of the environmental load evaluation system shown in FIG. 1 will be described below with reference to FIG.
[0061]
A: In the pattern recognition, matching is performed between the image data of the part to be matched and the image data existing in the matching DB. If it is determined that the parts are the same, the parts are cut out and the parts to be matched determined in the same manner. Is counted. B: Character recognition is performed in the same manner.
[0062]
If the same component is mounted on the same substrate at a different angle, the cutout and the number are counted by C: angle recognition. Here, the area of the recognized component is calculated at the same time by cutting and filling. Next, an embodiment of a processing method in a case where the image of the entire substrate 1 cannot be captured by the camera 2 will be described.
[0063]
9A is a diagram illustrating an image obtained by dividing the entire mounted circuit board into four parts by a camera, and FIG. 9B is a diagram illustrating an entire image of the mounted circuit board subjected to a joining process. A substrate 1 having a size of about 30 cm, such as a motherboard, cannot often be processed at one time. In such a case, a process such as joining four images into one is performed by an image joining process.
[0064]
FIG. 10 is a flowchart of a process of the second environmental load evaluation method for the component mounting board according to the first embodiment of the present invention. This is a simple environmental load evaluation device using only two-dimensional image data. The device configuration is different from the embodiment shown in FIG. 1 in that the stage 5 moves and the camera 2 is fixed. In FIG. 10, those having the same step numbers as those in the flowchart shown in FIG.
[0065]
In step ST30, it is determined from the image data of the entire substrate 1 whether or not the substrate has already been measured. If the determination result is YES, the result is displayed in step ST15 and the process ends. If the determination result is NO, pattern matching work (shape, character, angle, etc.) of the individual parts on the board 1 with the image data stored in the collation DB 71 is performed based on the entire image data acquired in step ST20. ) Is performed (step ST9). In step ST9, the matched components count the same components on the board 1, and when the counting operation is completed, the area occupied by the components on the board 1 is calculated (step ST33).
[0066]
This series of data is recorded in the external storage device 7 of the control device 6, and information relating the image data of the component and the environmental load is acquired from the external storage device 7, totaled, and a form is created (step ST10). . For the image data that cannot be recognized in step ST9, matching is performed with general component image data stored in advance in the collation DB 71, and a matching ratio is calculated (step ST32).
[0067]
If the matching ratio is 60% or more in step ST34, it is regarded as the part type, and the number count and the area are calculated (step ST35). In addition, information relating the image data of the component type and the amount of environmental load is acquired from the external storage device 7, totaled, and a form is created (step ST10). For other components, the area is calculated as unrecognizable component data and stored in the external storage device 7 of the control device 6 (step ST36).
[0068]
In step ST11, the recognition rate (the ratio of the sum of the areas of the recognized components to the sum of the areas of the unrecognized components) is calculated from the total result. As a result, if the value of the recognition rate is less than 0.9, Then, the image recognition accuracy is reduced (the number of items required for recognition is reduced: from three to two), and the result is fed back to the above-described pattern recognition work (steps ST12 and ST37).
[0069]
If the recognition rate becomes 0.9 or more after repeating the feedback twice, the unrecognized data is allocated (step ST14), and the final environmental load evaluation result is displayed on the display 621 connected to the control device 6 in a chart. It is displayed in a formatted form (step ST15).
[0070]
FIG. 11 is a configuration diagram of an environmental load evaluation system for a component mounting board according to a first example of the second embodiment of the present invention. It has substantially the same configuration as the embodiment shown in FIG. 1, and differs from the embodiment shown in FIG. 1 in that an external collation database DB71 ′ and an external environmental load database DB72 ′ are provided.
[0071]
First, after the camera 2 acquires the image data of the board 1, the acquired image data is specified on the basis of the board collation DB 71. If it is impossible to specify the board 1, the board 1 is specified based on the part collation DB 71 by recognizing each component on the board 1. The environmental load data corresponding to the substrate 1 is calculated from the environmental load DB 72 based on the specified data of the substrate 1. In this case, for an unrecognized component that cannot be specified, a similar component is extracted by searching the external database, that is, the external collation database DB71 ′ and the external environmental load database DB72 ′, based on the image data of the component.
[0072]
FIG. 12 is a configuration diagram of an environmental load evaluation system for a component mounting board according to a second example of the second embodiment of the present invention. The example shown in FIG. 12 is a case where electronic data of documents and catalogs is stored as external databases (external collation database DB71 ′ and external environmental load database DB72 ′). Here, the document and catalog data are, for example, data stored on a hard disk HD such as a magnetic disk after being read by a scanner, data recorded on a medium such as a CD, or paper-based information in a PDF (Portable Document Format). For example, the file may be an electronic file. Here, the PDF means a format related to a character font and an image format for exchanging document files between computers having different OSs.
[0073]
FIG. 13 is a configuration diagram of an environmental load evaluation system for a component mounting board according to a third example of the second embodiment of the present invention. This is a case where external databases (external collation database DB71 ′ and external environmental load database DB72 ′) are searched through the Internet.
[0074]
FIGS. 14A and 14B are diagrams illustrating an example of searching for image information from character information, wherein FIG. 14A is a diagram illustrating input character data, and FIG. 14B is a diagram illustrating output image data. FIG. 14 schematically shows an example of an image search by the search engine Google (http://images.google.com/). When "semiconductor" is input and searched as an input keyword, image information of various semiconductors can be searched on the site, and a target semiconductor image and information related thereto can be obtained.
[0075]
FIGS. 15A and 15B are diagrams illustrating an example of searching for image information from image information, in which FIG. 15A is a diagram illustrating input image data, and FIG. 15B is a diagram illustrating output image data. FIG. 15 schematically shows an example of an image search by the search engine eVision (http://www.evisionglobal.com/#). When a search is performed based on the image input from the camera, image information of various semiconductors can be searched at the site, and a target semiconductor image and information relating thereto can be obtained.
[0076]
FIG. 16 is a flowchart of a process of an environmental load evaluation method for a component mounting board according to the second embodiment of the present invention. The device configuration is different from the embodiment shown in FIG. 1 in that the stage 5 moves and the camera 2 is fixed. In FIG. 10, those having the same step numbers as those in the flowchart shown in FIG.
[0077]
In step ST40, it is determined from the image of the entire substrate 1 whether or not the substrate has already been measured. If the result of the determination is YES, the result is displayed in step ST15 and the process ends. If the result of the determination is NO, the process proceeds to step ST41.
[0078]
In step ST41, a pattern matching operation (shape, character, angle, etc.) with the image data stored in the collation DB 71 is performed for each component on the board based on the entire image acquired in step ST20. For the part that has been successfully matched, a series of data is recorded in the external storage device 7 of the control device 6 (step ST45), and information relating the image data of the component and the environmental load is acquired and totaled from the external storage device 7 ( In step ST10, a form is created (step ST10). For image data that cannot be recognized by matching, the external storage device 7 is searched, and matching is performed again.
[0079]
After the tabulation and report formation, the recognition rate (the sum of the mass of the board and the recognized parts and the ratio of the mass of the entire board) is calculated from the tabulation result in step ST10, and the value of the calculation result is set to 0 in step ST11. If the value is less than 0.9, the image recognition accuracy is lowered and the pattern matching operation of step ST41 is fed back (steps ST12 and ST44).
[0080]
When the feedback was repeated three times, the recognition rate became 0.9 or more. Therefore, data that could not be recognized was allocated (step ST14), and the final environmental load evaluation result was displayed on the display 621 connected to the control device 6. The information is displayed in a chart format (step ST15).
[0081]
As another embodiment, in the whole board image recognition in step ST3 of FIG. 16, when the captured image is a three-dimensional image and the amount of image information used for determination by pattern matching is increased, the recognition rate is higher than that of only the two-dimensional image. Can be improved. As still another embodiment, if the information obtained by searching the external storage device for the unrecognizable data shown in FIG. 16 is taken in (additionally registered) as an internal database, the recognition rate can be further improved.
[0082]
Further, as another embodiment, at the time of the pattern matching shown in FIG. 16, if the search database is classified in advance according to the functional category (LSI, resistor, capacitor) of the component normally mounted on the printed circuit board, A search can be performed from image data having similar part functions, and the recognition rate can be further improved.
[0083]
(Supplementary Note 1) An image acquisition unit that captures image data obtained by imaging the component mounting board to be evaluated, a component database including collation data and environmental load data for a plurality of components, and a collation between the image data and the component database. A collation unit for collating the data,
When the matching result of the matching unit does not match the image data and the matching data, matching is performed to calculate a matching rate between the image data of the component on the component mounting board to be evaluated and the image pattern of the component prepared in advance. Rate unit,
When the image data and the matching data do not match according to the matching result of the matching unit, the part having the highest matching rate calculated by the matching rate unit among the parts prepared in advance is set as the evaluation target. Parts and
When the image data and the matching data match according to the matching result of the matching unit, each component of the component mounting board to be evaluated is specified, and environmental load data of each specified component is extracted from the environmental load database. An environmental load calculation unit that obtains environmental load data of the component mounting board to be evaluated,
An environmental load evaluation system comprising:
[0084]
(Supplementary Note 2) When the matching ratio calculated by the matching ratio unit is larger than a predetermined threshold, a component having the highest matching ratio is specified as the component to be evaluated, and the calculated matching ratio is equal to or smaller than a predetermined threshold. 2. The environmental load evaluation system according to claim 1, further comprising: an allocation unit that allocates the environmental load to the environmental load of the specified component without specifying the component to be evaluated.
[0085]
(Supplementary Note 3) A weight measuring unit for measuring the weight of the component mounting board to be evaluated is provided, wherein the collation data in the component database includes weight data of the component, and the image data and the image data are obtained by the collation result of the collation unit. Based on the weight of the component mounting board and the weight data of the component stored in the component database, the environmental load amount of the component that is not identified because the matching data does not match is determined by the matching result of the matching unit. 3. The environmental load evaluation system according to claim 1 or 2, wherein the data and the collation data are matched to allocate to the environmental load amount of the specified component.
[0086]
(Supplementary Note 4) An area calculation unit that calculates an area from image data of the component to be evaluated is provided. The collation data in the component database includes area data of the component. Based on the area of the image data and the area data of the parts stored in the parts database, the environmental load amount of the part that is not specified because the data for matching does not match is determined by the matching result of the matching unit. 4. The environmental load evaluation system according to any one of appendices 1 to 3, wherein the data and the collation data match and allocate to the specified environmental load.
[0087]
(Supplementary note 5) The environmental load evaluation system according to any one of Supplementary notes 1 to 4, further comprising a counting unit that counts the same part specified as a result of the collation performed by the collation unit.
[0088]
(Supplementary Note 6) An image acquisition unit that captures image data obtained by capturing an image of a component mounting board to be evaluated, a component database including collation data and environmental load data for a plurality of components, and a collation between the image data and the component database. A collation unit for collating the data,
When the image data and the matching data do not match according to the matching result of the matching unit, a similar component is extracted from another information source based on the image data of the component to be evaluated, and the extracted component is And a storage unit for storing environmental load data.
[0089]
(Supplementary note 7) The environmental load evaluation system according to supplementary note 6, wherein the environmental load data of the components stored in the storage unit is obtained via the Internet.
[0090]
(Supplementary note 8) The environmental load evaluation system according to supplementary note 6, wherein the environmental load data of the components stored in the storage unit is obtained from an electronic medium.
[0091]
(Supplementary note 9) The environmental load evaluation system according to supplementary note 6, wherein the environmental load data of the components stored in the storage unit is obtained by reading image data such as a catalog with a scanner.
[0092]
(Supplementary note 10) The environmental load evaluation system according to Supplementary note 6, wherein the environmental load data of the component stored in the storage unit is obtained by reading character information stamped on the component and acquiring the read character information.
[0093]
(Supplementary note 11) The environmental load evaluation system according to supplementary note 6, wherein the image data is three-dimensional image data of the component to be evaluated.
[0094]
(Supplementary Note 12) The environmental load evaluation system according to supplementary note 6, wherein the components stored in the component database are classified by function.
[0095]
(Supplementary Note 13) The environmental load evaluation system according to Supplementary Note 6, wherein the component to be evaluated is specified from a component having a functional classification similar to a pattern of image data of the component.
[0096]
(Supplementary Note 14) A component database including collation data and environmental load data for a plurality of components is provided in advance, image data obtained by imaging the component mounting board to be evaluated is fetched, and the image data and the collation data of the component database are compared. Collate,
When the image data and the data for collation do not match according to the collation result of the collation unit, calculate a matching ratio between the image data of the component on the component mounting board to be evaluated and the image pattern of the component prepared in advance,
When the image data and the matching data do not match according to the matching result of the matching unit, the part having the highest matching ratio calculated from the parts prepared in advance is specified as the part to be evaluated,
When the image data and the matching data match according to the matching result of the matching unit, each component of the component mounting board to be evaluated is specified, and environmental protection data of each specified component is extracted from the environmental load database. To obtain environmental load data of the component mounting board to be evaluated.
An environmental load evaluation method comprising the steps of:
[0097]
(Supplementary Note 15) When the calculated matching ratio is larger than a predetermined threshold, the component having the highest matching ratio is specified as the component to be evaluated, and when the calculated matching ratio is equal to or smaller than a predetermined threshold, 15. The environmental load evaluation method according to claim 14, wherein the environmental load is allocated to the environmental load of the specified component without specifying the component to be evaluated.
[0098]
(Supplementary Note 16) The weight data of the component is stored in advance in the matching data in the component database, the weight of the component mounting board to be evaluated is measured, and the image data and the matching data are determined based on the matching result of the matching unit. The amount of environmental load of a component that does not match and is not identified is determined based on the weight of the component mounting board and the weight data of the component stored in the component database based on the matching result of the matching unit. 16. The environmental load evaluation method according to appendix 14 or 15, wherein allocation is performed to the specified environmental load amount in accordance with the application data.
[0099]
(Supplementary Note 17) Matching data and environmental load data for a plurality of components are stored in the component database in advance, image data obtained by imaging the component mounting board to be evaluated is fetched, and the image data and the matching data in the component database are compared. When the image data and the matching data do not match according to the matching result, a similar component is extracted from another information source based on the image data of the component to be evaluated, and the extracted component is Store environmental load data,
An environmental load evaluation method comprising the steps of:
[0100]
(Supplementary note 18) The environmental load evaluation method according to supplementary note 17, wherein the environmental load data of the component stored in the component database is obtained via the Internet.
[0101]
【The invention's effect】
As described above, according to the present invention, it is possible to provide an environmental load evaluation system and method for accurately evaluating an environmental load.
[Brief description of the drawings]
FIG. 1 is a configuration diagram of an environmental load evaluation system for a component mounting board according to a first embodiment of the present invention.
FIG. 2 is a detailed view of the control device shown in FIG.
FIG. 3 is a diagram showing a specific example of a component database.
FIG. 4 is a diagram showing functional modules of a program of an environmental load evaluation method.
FIG. 5 is a flowchart of a process of a first environmental load evaluation method for a component mounting board according to the first embodiment of the present invention.
FIG. 6 is a detailed flowchart of a matching ratio calculation process in process A shown in FIG. 5;
FIGS. 7A and 7B are explanatory diagrams of a matching ratio calculation. FIG. 7A is a diagram showing an example of checking matching / mismatching of image data in pixel units and calculating a matching ratio. FIG. 7B is a diagram showing matching / mismatching of contours. It is a figure showing the example which calculates a check matching rate.
FIGS. 8A and 8B are explanatory diagrams of a component cutting operation, in which FIG. 8A is a diagram illustrating a component mounting board to be worked, and FIG. 8B is a diagram illustrating a result of the component cutting operation.
9A is a diagram illustrating an image obtained by dividing the entire mounted circuit board into four parts by a camera, and FIG. 9B is a diagram illustrating an entire mounted circuit board image obtained by performing a joining process;
FIG. 10 is a flowchart of a process of a second environmental load evaluation method for a component mounting board according to the first embodiment of the present invention.
FIG. 11 is a configuration diagram of an environmental load evaluation system for a component mounting board according to a first example of the second embodiment of the present invention.
FIG. 12 is a configuration diagram of an environmental load evaluation system for a component mounting board according to a second example of the second embodiment of the present invention.
FIG. 13 is a configuration diagram of an environmental load evaluation system for a component mounting board according to a third example of the second embodiment of the present invention.
14A and 14B are diagrams illustrating an example in which image information is retrieved from character information, wherein FIG. 14A is a diagram illustrating input character data, and FIG. 14B is a diagram illustrating output image data.
15A and 15B are diagrams illustrating an example in which image information is retrieved from image information, wherein FIG. 15A is a diagram illustrating input image data, and FIG. 15B is a diagram illustrating output image data.
FIG. 16 is a flowchart of a process of an environmental load evaluation method for a component mounting board according to a second embodiment of the present invention.
[Explanation of symbols]
1. Component mounting board
2. Camera
3. Lighting device
4: Scale
5 ... stage
6 ... Control device
7 External storage device
71 ... collation database DB
72… Environmental impact database DB

Claims (10)

An image acquisition unit that captures image data of the component mounting board to be evaluated; a component database including collation data and environmental load data for a plurality of components; collating the image data with collation data in the component database A matching unit to be
When the matching result of the matching unit does not match the image data and the matching data, matching is performed to calculate a matching rate between the image data of the component on the component mounting board to be evaluated and the image pattern of the component prepared in advance. Rate unit,
When the image data and the matching data do not match according to the matching result of the matching unit, the part having the highest matching rate calculated by the matching rate unit among the parts prepared in advance is set as the evaluation target. Parts and
When the image data and the matching data match according to the matching result of the matching unit, each component of the component mounting board to be evaluated is specified, and environmental load data of each specified component is extracted from the environmental load database. An environmental load calculation unit that obtains environmental load data of the component mounting board to be evaluated,
An environmental load evaluation system comprising: When the matching ratio calculated by the matching ratio unit is larger than a predetermined threshold, the part with the highest matching ratio is specified as the component to be evaluated, and when the calculated matching ratio is equal to or less than a predetermined threshold, The environmental load evaluation system according to claim 1, further comprising an allocation unit that allocates the environmental load amount to the environmental load amount of the specified component without specifying the component to be evaluated. A weight measuring unit for measuring the weight of the component mounting board to be evaluated is provided, the collation data in the component database includes weight data of components, and the image data and the collation data according to the collation result of the collation unit. The amount of environmental load of a component that does not match and is not identified is determined based on the weight of the component mounting board and the weight data of the component stored in the component database based on the result of the comparison performed by the matching unit. 3. The environmental load evaluation system according to claim 1, wherein the data is allocated to the environmental load amount of the specified component in accordance with the application data. 4. An image acquisition unit that captures image data of the component mounting board to be evaluated; a component database including collation data and environmental load data for a plurality of components; collating the image data with collation data in the component database A matching unit to be
When the image data and the matching data do not match according to the matching result of the matching unit, a similar component is extracted from another information source based on the image data of the component to be evaluated, and the extracted component is And a storage unit for storing environmental load data. The environmental load evaluation system according to claim 4, wherein the environmental load data of the components stored in the storage unit is obtained via the Internet. A component database including data for collation and environmental load data is provided in advance for a plurality of components, image data obtained by capturing an image of the component mounting board to be evaluated is captured, and the image data is collated with collation data in the component database.
When the image data and the data for collation do not match according to the collation result of the collation unit, calculate a matching ratio between the image data of the component on the component mounting board to be evaluated and the image pattern of the component prepared in advance,
When the image data and the matching data do not match according to the matching result of the matching unit, the part having the highest matching ratio calculated from the parts prepared in advance is specified as the part to be evaluated,
When the image data and the matching data match according to the matching result of the matching unit, each component of the component mounting board to be evaluated is specified, and environmental protection data of each specified component is extracted from the environmental load database. To obtain environmental load data of the component mounting board to be evaluated.
An environmental load evaluation method comprising the steps of: When the calculated matching ratio is larger than a predetermined threshold, the component with the highest matching ratio is specified as the component to be evaluated, and when the calculated matching ratio is equal to or less than a predetermined threshold, the component to be evaluated is The environmental load evaluation method according to claim 6, wherein the environmental load is allocated to the environmental load of the specified component without specifying the environmental load. The weight data of the component is stored in advance in the matching data in the component database, the weight of the component mounting board to be evaluated is measured, and the image data does not match the matching data according to the matching result of the matching unit. Based on the weight of the component mounting board and the weight data of the component stored in the component database, the image data and the matching data are determined based on the weight of the component mounting board and the weight data of the component stored in the component database. The environmental load evaluation method according to claim 6, wherein the allocation is performed to the identified environmental load amount. The data for collation and the environmental load data for a plurality of components are stored in advance in the component database, the image data obtained by imaging the component mounting board to be evaluated is fetched, and the image data is compared with the collation data in the component database. When the image data does not match the collation data according to the collation result, a similar component is extracted from another information source based on the image data of the component to be evaluated, and environmental load data of the extracted component is extracted. Store,
An environmental load evaluation method comprising the steps of: The environmental load evaluation method according to claim 9, wherein the environmental load data of the component stored in the component database is obtained via the Internet.

Images