WO2015136669A1 - 画像処理装置および基板生産システム - Google Patents
画像処理装置および基板生産システム Download PDFInfo
- Publication number
- WO2015136669A1 WO2015136669A1 PCT/JP2014/056694 JP2014056694W WO2015136669A1 WO 2015136669 A1 WO2015136669 A1 WO 2015136669A1 JP 2014056694 W JP2014056694 W JP 2014056694W WO 2015136669 A1 WO2015136669 A1 WO 2015136669A1
- Authority
- WO
- WIPO (PCT)
- Prior art keywords
- processing
- resolution
- data
- super
- image
- Prior art date
Links
- 238000012545 processing Methods 0.000 title claims abstract description 339
- 238000004519 manufacturing process Methods 0.000 title claims abstract description 83
- 239000000758 substrate Substances 0.000 title claims description 34
- 238000000034 method Methods 0.000 claims description 147
- 230000008569 process Effects 0.000 claims description 144
- 238000003384 imaging method Methods 0.000 claims description 59
- 238000005457 optimization Methods 0.000 claims description 14
- 238000003860 storage Methods 0.000 description 13
- 238000007689 inspection Methods 0.000 description 12
- 238000012546 transfer Methods 0.000 description 11
- 230000032258 transport Effects 0.000 description 5
- 230000015654 memory Effects 0.000 description 3
- 230000000694 effects Effects 0.000 description 2
- 230000007246 mechanism Effects 0.000 description 2
- 230000000295 complement effect Effects 0.000 description 1
- 238000010586 diagram Methods 0.000 description 1
- 238000000605 extraction Methods 0.000 description 1
- 230000006870 function Effects 0.000 description 1
- 238000012423 maintenance Methods 0.000 description 1
- 229910044991 metal oxide Inorganic materials 0.000 description 1
- 150000004706 metal oxides Chemical class 0.000 description 1
- 230000004048 modification Effects 0.000 description 1
- 238000012986 modification Methods 0.000 description 1
- 230000003287 optical effect Effects 0.000 description 1
- 238000004806 packaging method and process Methods 0.000 description 1
- 238000007639 printing Methods 0.000 description 1
- 238000003672 processing method Methods 0.000 description 1
- 238000007650 screen-printing Methods 0.000 description 1
- 239000004065 semiconductor Substances 0.000 description 1
- 229910000679 solder Inorganic materials 0.000 description 1
- 230000009466 transformation Effects 0.000 description 1
Images
Classifications
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
- G06T3/00—Geometric image transformations in the plane of the image
- G06T3/40—Scaling of whole images or parts thereof, e.g. expanding or contracting
- G06T3/4053—Scaling of whole images or parts thereof, e.g. expanding or contracting based on super-resolution, i.e. the output image resolution being higher than the sensor resolution
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
- G06T7/00—Image analysis
- G06T7/0002—Inspection of images, e.g. flaw detection
- G06T7/0004—Industrial image inspection
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N1/00—Scanning, transmission or reproduction of documents or the like, e.g. facsimile transmission; Details thereof
- H04N1/04—Scanning arrangements, i.e. arrangements for the displacement of active reading or reproducing elements relative to the original or reproducing medium, or vice versa
- H04N1/19—Scanning arrangements, i.e. arrangements for the displacement of active reading or reproducing elements relative to the original or reproducing medium, or vice versa using multi-element arrays
- H04N1/195—Scanning arrangements, i.e. arrangements for the displacement of active reading or reproducing elements relative to the original or reproducing medium, or vice versa using multi-element arrays the array comprising a two-dimensional array or a combination of two-dimensional arrays
- H04N1/19594—Scanning arrangements, i.e. arrangements for the displacement of active reading or reproducing elements relative to the original or reproducing medium, or vice versa using multi-element arrays the array comprising a two-dimensional array or a combination of two-dimensional arrays using a television camera or a still video camera
-
- H—ELECTRICITY
- H05—ELECTRIC TECHNIQUES NOT OTHERWISE PROVIDED FOR
- H05K—PRINTED CIRCUITS; CASINGS OR CONSTRUCTIONAL DETAILS OF ELECTRIC APPARATUS; MANUFACTURE OF ASSEMBLAGES OF ELECTRICAL COMPONENTS
- H05K13/00—Apparatus or processes specially adapted for manufacturing or adjusting assemblages of electric components
- H05K13/08—Monitoring manufacture of assemblages
- H05K13/081—Integration of optical monitoring devices in assembly lines; Processes using optical monitoring devices specially adapted for controlling devices or machines in assembly lines
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
- G06T2207/00—Indexing scheme for image analysis or image enhancement
- G06T2207/10—Image acquisition modality
- G06T2207/10004—Still image; Photographic image
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
- G06T2207/00—Indexing scheme for image analysis or image enhancement
- G06T2207/20—Special algorithmic details
- G06T2207/20004—Adaptive image processing
- G06T2207/20008—Globally adaptive
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
- G06T2207/00—Indexing scheme for image analysis or image enhancement
- G06T2207/30—Subject of image; Context of image processing
- G06T2207/30108—Industrial image inspection
- G06T2207/30141—Printed circuit board [PCB]
Definitions
- the present invention relates to an image processing apparatus applied to a production facility that produces a substrate on which electronic components are mounted, and a substrate production system including the image processing apparatus.
- the production facility constitutes a production line for circuit board products as a board production device and an inspection device.
- This production facility performs various production processes (including inspection processes) on the substrate.
- the production facility takes an image of the object with the imaging device, and controls the production process based on the state of the object recognized by the image processing device using the image data acquired by the imaging.
- Patent Document 1 discloses a component mounter that recognizes the holding state of an electronic component held by a suction nozzle by image processing and reflects it in mounting control on a board.
- an imaging device provided in a production facility often employs a lens unit in which the focal length is set constant in consideration of the fact that the distance to an object to be imaged is substantially constant and the equipment cost.
- An imaging apparatus employing such a lens unit captures an image with a predetermined camera field of view, and acquires image data with a resolution corresponding to the number of pixels of the image sensor.
- the camera field of view is set to a wide area
- the object is small
- the area of the object occupied in the image data is small, and there is a possibility that the resolution required for image processing cannot be ensured.
- the lens unit of the imaging apparatus is set to have a camera field of view narrow to some extent in order to acquire image data with sufficient resolution even for a small object.
- the object may exceed the camera field of view depending on the size of the object. Therefore, Patent Document 2 is configured to acquire high resolution data by super-resolution processing. Thereby, even if the camera field of view is set in a range in which the object is accommodated, the image processing apparatus can perform image processing using high-resolution data in which a necessary resolution is ensured.
- the present invention has been made in view of such circumstances, and provides an image processing apparatus capable of reducing the load of image processing while reducing the time required for image processing using super-resolution processing.
- the purpose is to do.
- An image processing apparatus is an image processing apparatus that is applied to a production facility that executes various production processes on a substrate, and the production facility captures an object and acquires image data;
- a control device that controls the production process based on the state of the object recognized by the image processing apparatus using the image data, and the image processing apparatus performs the image processing when the production process is executed.
- a process determination unit that determines whether or not the super-resolution processing for the data needs to be executed for each type of the object, and a super-resolution process using a plurality of the image data according to the determination result by the process determination unit And recognizing the state of the object based on one of the image data and the high resolution data corresponding to the determination result by the processing determination unit. It includes a state recognition unit for, a.
- the super-resolution processing unit executes the super-resolution processing according to the determination result by the processing determination unit to generate high-resolution data. That is, the image processing device switches whether to execute the super-resolution processing depending on the type of the object, and recognizes the state of the object based on the low resolution data (image data) or the high resolution data. Therefore, excessive super-resolution processing is suppressed in the object recognition processing by the image processing apparatus. Therefore, when image processing is performed on a wide variety of objects, the time required for image processing is shortened, and the load of image processing is reduced.
- FIG. 1 It is a block diagram showing the whole substrate production system in an embodiment. It is a general view which shows the component mounting machine in FIG. It is a flowchart which shows a part data generation process and a process management data generation process. It is a figure which shows the relationship between the result of suitability determination, and process management data. It is a flowchart which shows the mounting process by a component mounting machine. It is a flowchart which shows the recognition process of a holding state. It is a figure which shows the process management data in a deformation
- the image processing apparatus is applied to a production facility constituting a board production system for circuit board products.
- the production equipment includes a board production apparatus and an inspection apparatus for a production line in the board production system, an off-line auxiliary apparatus, and the like.
- the substrate production system 1 includes a production line 2, a camera stand 3, a substrate transfer device 5, and a host computer 40.
- the production line 2 is configured by installing a plurality of production facilities (substrate production apparatus and inspection apparatus) that execute various production processes on a substrate in the substrate transport direction.
- the board production apparatus includes a component mounter 10 for mounting electronic components on a board, a screen printing machine (not shown), and the like.
- the inspection apparatus includes a print inspection apparatus and an appearance inspection apparatus (not shown).
- Various production facilities such as a board production apparatus and an inspection apparatus in the production line 2 are communicably connected to the host computer 40 via a network. Thereby, the production facility of the production line 2 is configured to be able to input / output various data with the host computer 40.
- the camera stand 3 captures an object with the general-purpose camera 31 and executes various image processes.
- the general-purpose camera 31 is configured to be relatively movable with a mounting table (not shown) on which electronic components are mounted.
- the camera stand 3 includes a part data generation unit 32 in the present embodiment.
- the part data generation unit 32 generates part data M2 used for the mounting process before the electronic component mounting process (production process in the component mounting machine 10) is executed by the component mounting machine 10.
- the camera stand 3 is a production facility that assists the production of substrates offline.
- part data is data including part types and shape data related to the specifications of electronic parts.
- the classification includes electronic component types, identification codes assigned to the respective types, image processing for image data, vision types used in comparison with image data, shape information relating to shapes and dimensions, and the like.
- the part data M2 is stored in the storage device 42 of the host computer 40 when used in common for mounting processing of the plurality of component mounting machines 10.
- the part data generation unit 32 performs image processing using image data acquired by the general-purpose camera 31.
- An object to be imaged by the general-purpose camera 31 is a type of electronic component that is mounted on a substrate in the mounting process by the component mounter 10.
- the part data generation unit 32 recognizes the outer shape of the electronic component by image processing, and generates part data M2 by associating various types of information including the outer shape of the electronic component for each type of electronic component.
- the substrate transport device 5 is configured by a belt conveyor or the like, and sequentially transports the substrate in the transport direction.
- the board conveying device 5 positions the board at a predetermined position in the component mounting machine 10. Then, after the mounting process by the component mounter 10 is executed, the board transfer device 5 carries the board out of the component mounter 10.
- the host computer 40 monitors the operation status of the production line 2 and controls a board production apparatus including the component mounter 10.
- the host computer 40 includes a data optimization unit 41 and a storage device 42.
- the data optimization unit 41 optimizes the mounting data M1 used by the component mounter 10 for mounting processing.
- the mounting data M1 is an operation program that defines the mounting order of electronic components.
- the data optimization unit 41 changes the mounting order of the electronic components in the mounting data so that the tact time of the production process is minimized. Specifically, the data optimizing unit 41 executes the optimization process in consideration of the mounting environment such as the coordinates on the board Bd on which the electronic component is mounted and the supply position for each type of electronic component. By optimizing the mounting data M1, the moving distance of the mounting head 26, which will be described later, is shortened, and the standby time is shortened, thereby improving the production efficiency.
- the storage device 42 of the host computer 40 is constituted by a hard disk, a flash memory, or the like.
- the storage device 42 stores various data for controlling the substrate production apparatus. Specifically, the storage device 42 stores the production plan including the type of board to be produced and the production quantity, the mounting data M1 optimized by the data optimization unit 41, and the like.
- the configuration of the component mounter 10 will be described with reference to FIGS. 1 and 2.
- the component mounter 10 includes a base 11, a component supply device 12, a component transfer device 13, a component camera 14, a board camera 15, and a control device 16.
- the devices 12 and 13 and the component camera 14 are provided on the base 11 of the component mounter 10.
- the horizontal direction of the component mounter 10 (direction from the upper left to the lower right in FIG. 2) is the X-axis direction
- the horizontal longitudinal direction of the component mounter 10 from the upper right to the lower left in FIG. 2).
- the direction of heading is the Y-axis direction
- the vertical height direction vertical direction in FIG. 2) is the Z-axis direction.
- the component supply device 12 is a device that supplies electronic components to be mounted on the board Bd.
- the component supply device 12 is disposed on the front side in the Y-axis direction of the component mounter 10 (lower left side in FIG. 2).
- the component supply apparatus 12 is a feeder system that uses a plurality of cassette-type feeders 21.
- the component supply apparatus 12 pitch-feeds a component packaging tape in which electronic components are stored at predetermined intervals. Thereby, the component supply apparatus 12 supplies an electronic component in the supply position Ps located in the front end side (upper right side of FIG. 2) of the feeder 21.
- the component transfer device 13 is configured to be movable in the X-axis direction and the Y-axis direction.
- the component transfer device 13 is arranged from the rear side in the longitudinal direction of the component mounting machine 10 (upper right side in FIG. 2) to the upper side of the component supply device 12 on the front side.
- the component transfer device 13 includes a head driving device 25, a mounting head 26, and a plurality of suction nozzles 27.
- the head drive device 25 is configured to be able to move the moving table in the XY axis directions by a linear motion mechanism.
- the mounting head 26 is detachably provided on the moving table of the head driving device 25.
- Each suction nozzle 27 is detachably provided on the mounting head 26.
- the mounting head 26 supports the respective suction nozzles 27 so as to be rotatable about the R axis parallel to the Z axis and to be movable up and down.
- Each suction nozzle 27 is controlled in the elevation position and angle with respect to the mounting head 26 and the supply state of negative pressure.
- Each suction nozzle 27 sucks and holds the electronic component supplied at the supply position Ps at the tip by being supplied with a negative pressure.
- the component transfer device 13 has a function of holding an electronic component in the component mounter 10 and corresponds to a “holding device” of the present invention.
- the component camera 14 and the substrate camera 15 are digital imaging devices having an imaging element such as a CCD (Charge Coupled Device) or a CMOS (Complementary Metal Oxide Semiconductor).
- the component camera 14 and the board camera 15 execute an imaging process within a range that fits in the camera field of view based on a control signal from the control device 16 that is connected to be communicable.
- the component camera 14 and the board camera 15 send image data acquired by imaging the object to the control device 16.
- the component camera 14 is fixed to the base 11 and the electronic component held by each suction nozzle 27 is an object to be imaged.
- the lens unit of the component camera 14 is set so as to focus on an object located at a certain distance from the image sensor. Further, the camera field of view Fv of the lens unit of the component camera 14 is set in a range in which all of the plurality of suction nozzles 27 supported by the mounting head 26 are accommodated. That is, when the image is captured by the component camera 14 set in the camera field of view Fv, all the electronic components held by the plurality of suction nozzles 27 can be stored in one image data.
- the control device 16 that has acquired the image data from the component camera 14 recognizes the holding state of the electronic component by the suction nozzle 27 by image processing.
- the control device 16 corrects the position and angle of the suction nozzle 27 in accordance with the holding state of the electronic component, thereby improving the accuracy of the mounting process. Details of the recognition processing of the holding state of the electronic component will be described later.
- the board camera 15 is fixed to the moving table of the head driving device 25 and the board positioned in the component mounter 10 is used as an object to be imaged.
- the control device 16 that has acquired the image data from the substrate camera 15 recognizes the positioning state of the substrate Bd by the substrate transport device 5 by recognizing, for example, a substrate mark attached to the substrate Bd by image processing. And the control apparatus 16 correct
- the control device 16 is mainly composed of a CPU, various memories, and a control circuit.
- the storage unit 29 of the control device 16 stores mounting data M1 for operating the component mounter 10, image data transferred from the component camera 14 and the board camera 15, and the like.
- the control device 16 controls the mounting process based on the state of the object recognized by the image processing device 50 described later using the acquired image data.
- the control device 16 corrects the operations of the component supply device 12 and the component transfer device 13 based on the mounting data M1 according to information acquired by image processing. This improves the accuracy of the mounting process.
- a holding state of an electronic component used when the control device 16 of the component mounting machine 10 corrects the position and angle of the suction nozzle 27 (the “object state” of the present invention). Is included).
- image data acquired by imaging with the component camera 14 is used.
- the lens unit of the component camera 14 sets the camera field of view in consideration of the range in which the focal length is set constant and the plurality of suction nozzles 27 supported by the mounting head 26 are arranged. Has been. For this reason, when the acquired image data is used as it is in the holding state recognition process, the area of the small component in the image data is small, and the resolution required in the recognition process may not be ensured.
- the image processing apparatus 50 performs super-resolution processing as necessary, such as when the target of mounting processing is a small component.
- the image processing device 50 uses the high-resolution data that secures the required resolution in the recognition process of the holding state of the electronic component, thereby improving the accuracy of the recognition process.
- the image processing apparatus 50 includes a mounting machine side processing unit Dp provided in the component mounting machine 10 and an auxiliary machine side processing unit Ds provided in the camera stand 3.
- the mounting machine side processing unit Dp includes a processing determination unit 51, a super-resolution processing unit 52, and a state recognition unit 53.
- the auxiliary machine side processing unit Ds includes a part data generation unit 32, a suitability determination unit 55, and a process management data generation unit 56.
- the processing determination unit 51 of the mounting machine side processing unit Dp determines whether it is necessary to execute the super-resolution processing on the image data for each type of electronic component when the component mounting machine 10 executes the mounting process of the electronic component. Specifically, each time the suction nozzle 27 holds an electronic component in the mounting process, the process determination unit 51 determines whether to execute the super-resolution process according to the type of the electronic component. In the present embodiment, the process determination unit 51 determines whether or not the super-resolution process is necessary based on the process management data M3. Details of the process management data M3 will be described later.
- the super-resolution processing unit 52 performs high-resolution processing by executing super-resolution processing using a plurality of image data according to the determination result by the processing determination unit 51 when the electronic component mounting process is executed by the component mounting machine 10. Generate data.
- Super-resolution processing is image processing for increasing the resolution of input image data, and a plurality of types of processing methods are known.
- the super-resolution processing unit 52 employs multi-frame type super-resolution processing. Specifically, the super-resolution processing unit 52 performs super-resolution processing using a plurality of image data captured at imaging positions where the relative positions of the component camera 14 with respect to the electronic component are different from each other.
- the super-resolution processing unit 52 does not always execute the super-resolution processing every time the suction nozzle 27 holds an electronic component in the mounting process. That is, the super-resolution processing unit 52 executes super-resolution processing using image data with an electronic component corresponding to the specified type as an object, according to the determination result by the processing determination unit 51. As described above, the image processing apparatus 50 is configured to switch whether or not to execute the super-resolution processing depending on the type of electronic component.
- the state recognition unit 53 recognizes the state of the electronic component based on one of the image data and the high resolution data corresponding to the determination result by the processing determination unit 51 when the electronic component mounting process is executed by the component mounting machine 10.
- the state of the electronic component is a holding state including the position and angle of the electronic component held by the suction nozzle 27.
- the state recognition unit 53 determines the electronic component based on the high-resolution data generated by the super-resolution processing unit 52. Perform recognition processing.
- the state recognizing unit 53 when the process determining unit 51 determines that the execution of the super-resolution processing is “unnecessary”, the image data acquired by the imaging of the component camera 14 (hereinafter, “low resolution data”). The electronic component recognition process is performed based on the above.
- the recognition accuracy is lowered. This is because, for example, when the number of pixels used to indicate one side of the electronic component is less than a predetermined number of pixels, it is difficult to determine the length and angle of the one side. Therefore, high-resolution data in which one side of the electronic component is indicated with a predetermined number of pixels is generated by super-resolution processing and used for recognition of the holding state.
- the state recognition unit 53 recognizes the holding state including the position of the electronic component in the X-axis direction and the Y-axis direction with respect to the suction nozzle 27 and the rotation angle of the electronic component with respect to the central axis of the suction nozzle 27.
- the state recognition unit 53 repeats the same process for the number of electronic components T held by the plurality of suction nozzles 27 supported by the mounting head 26.
- the state recognition part 53 memorize
- the adequacy determination unit 55 of the auxiliary machine side processing unit Ds uses the resolution of the image data acquired by imaging the electronic component as a recognition process by the state recognition unit 53 before the electronic component mounting process is performed by the component mounting machine 10. It is determined for each type of object whether or not it matches.
- the image data used by the suitability determination unit 55 for the suitability determination is acquired by imaging the general-purpose camera 31 of the camera stand 3. More specifically, in the present embodiment, the suitability determination unit 55 diverts the image data used by the part data generation unit 32 to generate the part data M2.
- the image data used by the state recognition unit 53 of the mounting machine side processing unit Dp for the recognition processing is acquired by imaging the component camera 14 of the component mounting machine 10 during the execution of the mounting process. Therefore, the image data used for the suitability determination of the suitability determination unit 55 is different from the image data used for the recognition process by the state recognition unit 53. Therefore, the suitability determination unit 55 considers the difference between the performance of the general-purpose camera 31 of the camera stand 3 and the performance of the component camera 14 of the component mounter 10, and the image data is adapted to the recognition processing by the state recognition unit 53. It is determined whether or not.
- the performance of the general-purpose camera 31 and the performance of the component camera 14 are approximately the same.
- the determination result as to whether the resolution of the image data acquired by the imaging of the general-purpose camera 31 is suitable for the recognition processing by the state recognition unit 53 is the same for the image data acquired by the imaging of the component camera 14. This is the same as the result of the determination of suitability.
- the suitability determination unit 55 determines the suitability by taking into account the variation to the low resolution side due to the difference in camera field of view. To do.
- the suitability determination unit 55 employs a method for determining the suitability based on high resolution data and low resolution data. That is, the suitability determination unit 55 is used for the high-resolution data generated by the super-resolution processing using the plurality of image data acquired by the general-purpose camera 31 imaging the electronic component, and the super-resolution processing. Based on any of the image data (low resolution data), it is determined whether or not the resolution of the image data is suitable for the recognition processing by the state recognition unit 53.
- the suitability determination unit 55 performs image processing for recognizing the position of the electronic component on, for example, high resolution data and low resolution data. Then, the suitability determination unit 55 determines that the resolution of the low resolution data is suitable for the recognition processing by the state recognition unit 53 when each position of the electronic component falls within the allowable error. On the other hand, when each position of the recognized electronic component exceeds the allowable error, or when the position of the electronic component cannot be recognized with the low resolution data, the resolution of the low resolution data is used for the recognition processing by the state recognition unit 53. Judged as inappropriate.
- the process management data generation unit 56 generates process management data M3 in which whether or not super-resolution processing is necessary is set for each type of electronic component based on the determination result by the suitability determination unit 55.
- the process management data M ⁇ b> 3 indicates whether or not super-resolution processing is necessary (necessary, necessary, necessary) for each electronic component type (A, B, C,). Unnecessary, ..) is set.
- the process management data generation unit 56 sets that super-resolution processing is necessary when the determination result of the suitability determination unit 55 is “unsuitable” when generating the process management data M3, and the determination result of the suitability determination unit 55 Is set to be super-resolution processing is unnecessary.
- the process management data generation unit 56 sends the generated process management data M3 to the component mounter 10.
- the component mounter 10 stores the acquired processing management data M3 in the storage unit 29. Then, at the time of executing the mounting process by the component mounter 10, the process determining unit 51 of the mounter side processing unit Dp determines whether or not the super-resolution process needs to be executed based on the process management data M3.
- step 11 (hereinafter, “step” is expressed as “S”)).
- the auxiliary machine side processing unit Ds performs imaging processing of the electronic component for a specified number of times by the general-purpose camera 31 (S12).
- This imaging process is for using image data used for the subsequent super-resolution process.
- the electronic component is imaged at a plurality of imaging positions (corresponding to the specified number of times) where the relative positions of the general-purpose camera 31 with respect to the electronic component are different from each other.
- the “plurality of image pickup positions” are positions shifted from each other by an amount obtained by adding a distance that is an integral multiple of the above interval to a distance that is smaller than the pixel interval in the image sensor of the general-purpose camera 31, for example.
- the “specified number of times” is a specified number of times of imaging so that a reference resolution is ensured in high-resolution data generated by multi-frame type super-resolution processing. That is, by performing super-resolution processing using a plurality of image data acquired by imaging more than the specified number of times, high-resolution data having a reference resolution suitable for at least recognition processing by the state recognition unit 53 is generated. .
- a different value may be set for each type of electronic component, or a constant value may be set for any type.
- the auxiliary device side processing unit Ds performs super-resolution processing using a plurality of image data to generate high resolution data (S13). Specifically, the auxiliary machine side processing unit Ds first aligns a plurality of image data. This alignment is performed based on, for example, a command value obtained by moving the general-purpose camera 31 relative to the mounting table of the camera stand 3 at the time of imaging, or a result of image processing for matching a reference point included in the image data. . Then, the auxiliary machine side processing unit Ds executes a reconstruction process for generating high resolution data based on the plurality of aligned image data. By such super-resolution processing, the auxiliary machine side processing unit Ds acquires high resolution data in which the electronic component is indicated with a predetermined number of pixels.
- the part data generation unit 32 generates part data M2 corresponding to the type of the electronic component set in S11 using the high resolution data acquired by the super-resolution processing in S13 (S14).
- the auxiliary machine side processing unit Ds determines whether or not the generation of the part data M2 has been completed for all types of target electronic components (S15).
- the above processing (S11 to S15) is repeated. If the generation of the part data M2 is completed for all types of electronic components (S15: Yes), the generation process of the part data M2 (S11 to S15) is ended, and the process management data M3 is generated. To do.
- the auxiliary machine side processing unit Ds uses one of the plurality of image data acquired by the imaging in S12 as low resolution data, and performs prescribed image processing using the low resolution data (S21). Further, the auxiliary machine side processing unit Ds performs a prescribed image process using the high resolution data acquired by the super-resolution process of S13 (S22).
- the prescribed image processing (S21, S22) includes, for example, binarization and edge extraction. Through the prescribed image processing (S21, S22), the position, angle, and outer shape of the electronic component in each image data are recognized.
- the suitability determination unit 55 determines whether or not the low resolution data is suitable for the recognition processing by the state recognition unit 53 based on the result of the prescribed image processing (S21, S22) (S23).
- the suitability determination unit 55 determines that the position of the electronic component recognized using the low resolution data in S21 is within an allowable error range with respect to the position of the electronic component recognized using the high resolution data in S22. Judgment is made according to whether or not it is accommodated. This is based on the fact that when the resolution of the low resolution data is above a certain level, the position of the electronic component recognized by the image processing is the same as the result of the image processing using the high resolution data (position of the electronic component). is doing.
- the suitability determination unit 55 When the low-resolution data is suitable for the recognition processing by the state recognition unit 53 (S23: Yes), the suitability determination unit 55 performs super-resolution when executing the mounting processing by the component mounter 10 for the type of the electronic component. The process is set as “unnecessary” in the process management data M3 (S24). On the other hand, when the low-resolution data is not suitable for the recognition processing by the state recognition unit 53 (S23: No), the suitability determination unit 55 determines the electronic component type at the time of executing the mounting processing by the component mounter 10. The super-resolution processing is set as “necessary” in the processing management data M3 (S25).
- the auxiliary machine side processing unit Ds determines whether or not the setting (S24, S25) relating to the necessity of the super-resolution processing has been completed for all types of target electronic components (S26).
- the type of the target electronic component remains (S26: No)
- the above processing (S21 to S26) is repeated.
- the setting related to the necessity of the super-resolution processing (S24, S25) is completed for all electronic component types (S26: Yes)
- the generation processing (S21 to S26) of the processing management data M3 is ended. .
- processing management data M3 in which necessity of execution of super-resolution processing is set for each type of all electronic components to be processed is automatically generated.
- the determination result by the suitability determination unit 55 and the process management data M3 have a relationship as shown in FIG.
- the suitability determination unit 55 uses the low resolution data of type A as shown in the left table of FIG. Evaluate as “impossible”.
- the suitability determination unit 55 can recognize the position of the electronic component by the image processing of S21 for the electronic component type B, it has an allowable error from the position of the electronic component recognized by the image processing using the high resolution data. If it exceeds, the low resolution data of type B is evaluated as “insufficient”. When the position of the electronic component recognized by the image processing in S21 is within the allowable error range with respect to the position of the electronic component recognized in S22, the suitability determination unit 55 class C Are evaluated as “fit”.
- the processing management data generation unit 56 selects the types A and B of the corresponding electronic components. Assuming that the low-resolution data according to the above is not compatible with the electronic component recognition process, “necessary” is set as to whether the super-resolution process is necessary or not (right table in FIG. 4).
- the suitability determination unit 55 evaluates the low resolution as “conformity” (S23: Yes)
- the process management data generation unit 56 determines whether the corresponding electronic component type C is super The necessity of resolution processing is set as “unnecessary”.
- the control device 16 of the component mounting machine 10 first executes a suction process for sequentially sucking electronic components to the plurality of suction nozzles 27 in accordance with the mounting data M1 (S31). Next, the control device 16 moves the mounting head 26 above the mounting position on the substrate Bd.
- the mounting machine side processing unit Dp executes a recognition process of the holding state of the electronic component held by the suction nozzle 27 while the mounting head 26 is moving (S32). Thereafter, the control device 16 of the component mounter 10 executes a mounting process for sequentially mounting electronic components on the board Bd (S33). Then, the control device 16 determines whether or not all the electronic components have been mounted (S34), and repeats the above processing (S31 to S34) until the mounting is completed.
- control device 16 determines whether or not there is an electronic component sucked by the suction nozzle 27, whether or not the electronic component is held, whether the electronic component is held by the suction nozzle 27, based on the result of the electronic component state recognition process (S32). Recognize holding status. Then, when the electronic component to be mounted is correct, the control device 16 corrects the position and angle of the suction nozzle 27 according to the holding state of the electronic component, and controls the electronic component mounting process.
- the mounting machine side processing unit Dp refers to the process management data M3 generated in the auxiliary machine side processing unit Ds of the camera stand 3 before executing the mounting process of the component mounting machine 10 (S41). Then, the mounting machine side processing unit Dp acquires the necessity of executing the super-resolution processing for the type of electronic component currently held by the suction nozzle 27 by the suction processing (S31).
- the mounting machine side processing unit Dp sets the number of imaging based on the necessity of executing the acquired super-resolution processing (S42). Specifically, for the type of electronic component held by the suction nozzle 27, when it is necessary to execute super-resolution processing, for example, “4 times” defined in advance is set as the number of times of imaging. This corresponds to the quantity of image data used for super-resolution processing. In addition, when it is not necessary to perform the super-resolution processing, “one time” is set as the number of times of imaging. When the plurality of suction nozzles 27 hold different types of electronic components, the maximum number of imaging is set.
- the control device 16 moves the mounting head 26 to the first imaging position (S43).
- the first imaging position is, for example, a position where the optical axis of the component camera 14 coincides with the stop of the rotating member that rotatably holds the plurality of suction nozzles 27 in the mounting head 26.
- the control apparatus 16 performs the imaging process of several electronic components (S44).
- control device 16 inputs from the motor control circuit of the control device 16 that the suction nozzle 27 supported by the mounting head 26 is above the component camera 14. And the control apparatus 16 sends out a control command so that it may image with respect to the component camera 14.
- FIG. As a result, all the electronic components held by the plurality of suction nozzles 27 are imaged, and image data obtained by the imaging is stored in the storage unit 29.
- the control device 16 determines whether or not the imaging at the four imaging positions has been completed (S45), and if not completed (S45: No), the above processing (S43 to S45) is repeated.
- the control device 16 moves the mounting head 26 in the X-axis direction or the Y-axis direction by a distance corresponding to half of the pixel interval in the image sensor (S43).
- the control apparatus 16 performs the imaging process of the electronic component which moved only the half pixel again (S44).
- the storage unit 29 stores image data obtained by the first imaging process.
- the storage unit 29 adds to the above image data, image data shifted by a half pixel in the X axis direction, and a half pixel in the Y axis direction. Image data shifted by only one pixel, and image data shifted by half a pixel in the X-axis direction and Y-axis direction, respectively.
- the process determination unit 51 determines whether or not it is necessary to perform the super-resolution process on the image data based on the process management data M3 (S46).
- the super-resolution processing unit 52 executes the super-resolution processing using a plurality of image data to generate high-resolution data (S47). . Since this super-resolution processing is substantially the same as the super-resolution processing (S13) by the auxiliary machine side processing unit Ds, detailed description thereof is omitted.
- the state recognition unit 53 After the super-resolution processing (S47) by the super-resolution processing unit 52 is completed, or when the processing determining unit 51 determines that the super-resolution processing is not necessary (S46: No), the state recognition unit 53. Performs a holding state recognition process including the position and angle of the electronic component held by the suction nozzle 27 (S48). Here, the state recognition unit 53 recognizes the holding state of the electronic component based on one of the image data and the high resolution data corresponding to the determination result by the processing determination unit 51.
- the state recognition unit 53 uses the high-resolution data generated by the super-resolution processing (S47) for the recognition processing.
- the determination result is “unnecessary” (S46: No)
- the state recognizing unit 53 uses the image data (low-resolution data) obtained by the imaging process (S44) as it is for the recognition process.
- the state recognition unit 53 executes a holding state recognition process based on the low resolution data or the high resolution data and the part data M2 corresponding to the type of the electronic component. Specifically, the state recognition unit 53 performs pattern matching based on the electronic component in the low resolution data or the high resolution data, and the vision type and shape information of the part data M2. The state recognition unit 53 stores, as the holding state of the electronic component, the amount of deviation of the electronic component in the X-axis direction and the Y-axis direction with respect to each suction nozzle 27 and the rotation angle of the electronic component with respect to the central axis of the suction nozzle 27. And the holding state recognition process is terminated.
- the image processing apparatus 50 is applied to a production facility (component mounter 10) that executes various production processes (mounting processes) for the board Bd.
- the production facility includes an imaging device (component camera 14) that captures an image of an object (electronic component) and acquires image data, and an object (electronic component) recognized by the image processing device 50 using the image data.
- the image processing apparatus 50 includes a processing determination unit 51 that determines whether or not super-resolution processing for image data needs to be performed for each type of object (electronic component) during execution of production processing (mounting processing), and a processing determination unit A super-resolution processing unit 52 that generates high-resolution data by executing super-resolution processing using a plurality of image data according to the determination result by 51, and determination by the processing determination unit 51 among the image data and the high-resolution data A state recognizing unit 53 that recognizes the state of the object (electronic component) based on the one corresponding to the result.
- the super-resolution processing unit 52 performs the super-resolution processing according to the determination result by the processing determination unit 51 to generate high-resolution data (S47). That is, the image processing device 50 switches whether to execute the super-resolution processing depending on the type of electronic component, and recognizes the holding state of the electronic component based on the low resolution data or the high resolution data. Accordingly, excessive super-resolution processing is suppressed in the electronic component recognition processing by the image processing device 50. Accordingly, when image processing is performed on a wide variety of electronic components, the time required for image processing is shortened, and the load of image processing is reduced.
- the image processing apparatus 50 determines whether or not the resolution of the image data acquired by imaging the target object (electronic component) before the execution of the production process (mounting process) matches the recognition process by the state recognition unit 53. Based on the determination result by the suitability determination unit 55 for each type of object (electronic component) and the determination result by the suitability determination unit 55, the necessity of execution of the super-resolution processing is set for each type of object (electronic component). And a process management data generation unit 56 for generating the processed process management data M3. The process determination unit 51 determines whether or not the super-resolution process is necessary based on the process management data M3 (S46).
- the process management data M3 referred to by the process determination unit 51 is automatically generated (S21 to S26). Further, the process management data M3 reflects the determination result by the suitability determination unit 55 based on the image data actually obtained by imaging the electronic component. Therefore, in the process management data M3, whether or not the super-resolution process is necessary is set more appropriately. Therefore, it is possible to reliably prevent the super-resolution processing from being performed excessively. Further, since the process management data M3 is automatically generated, the operator's workload is reduced.
- the suitability determination unit 55 is used for high-resolution data generated by super-resolution processing using a plurality of image data acquired by imaging an object (electronic component) and the super-resolution processing. Based on any one of the image data, it is determined whether or not the resolution of the image data is compatible with the recognition processing by the state recognition unit 53 (S23).
- the suitability determination unit 55 compares the actually generated high resolution data with the image data (low resolution data) that has not been subjected to super-resolution processing, thereby determining the suitability of the low resolution data. Is determined (S23). As a result, if it is determined that the low resolution data matches the recognition process even when compared with the high resolution data (S23: Yes), execution of unnecessary super-resolution processing is prevented. On the other hand, when it is determined that the low-resolution data is not suitable for the recognition process (S23: No), the super-resolution process (S47) is appropriately executed, and the accuracy of the recognition process is prevented from being lowered. .
- the object is an electronic component mounted on the board Bd, and the image processing apparatus 50 uses the image data acquired by imaging the electronic component before the execution of the production process (mounting process) to use the electronic component.
- a part data generation unit 32 is further provided for generating part data M2 in which various types of information including the shape of the electronic component are associated with each type of electronic component.
- the suitability determination unit 55 determines whether or not the resolution of the image data used to generate the part data M2 by the part data generation unit 32 is suitable for the recognition processing by the state recognition unit 53 (S23).
- the suitability determination unit 55 performs determination based on image data acquired by imaging using an electronic component as an electronic component in order to generate part data M2 (S23). Therefore, the image data can be diverted without newly imaging an electronic component for determination. Therefore, the process management data M3 is generated more efficiently.
- super-resolution processing is executed in the generation of the part data M2 (S13).
- the suitability determination unit 55 can also use the high-resolution data generated by the super-resolution processing (S13) for the suitability determination (S23).
- the production facility is a component mounter 10 that mounts an electronic component on the board Bd, and the object (electronic component) is an electronic component that is held by a holding device of the component mounter 10.
- the object electronic component
- the configuration of the image processing apparatus 50 as described above it is possible to reduce the time required for the imaging process (S44) and the image process (S47, S48) during the execution of the mounting process, and to shorten the cycle time. Therefore, it is particularly useful to apply the present invention to the component mounter 10.
- processing management data M3 ⁇ Modification of Embodiment>
- necessity of super-resolution processing is set for each type of electronic component.
- a process reference indicating the degree of super-resolution processing may be set for each type of object (electronic component).
- the processing level of the processing management data M3 is defined by the quantity (frame) of image data used when the super-resolution processing unit 52 generates high-resolution data. May be.
- the super-resolution processing unit 52 acquires a processing level corresponding to the type of the object from the processing management data M3 when the super-resolution processing is executed. Then, the super-resolution processing unit 52 generates high-resolution data that satisfies the processing level by super-resolution processing using a plurality of image data. According to such a configuration, the super-resolution processing unit 52 executes the super-resolution processing according to the processing level set in advance for each type of the target object (electronic component).
- the image processing apparatus 50 executes the super-resolution processing with the processing contents set in stages in the case of execution.
- the higher the amount of image data used for the processing the higher the resolution image data can be obtained.
- the processing level according to the type of the object can be set with the above configuration, it is possible to prevent the degree of super-resolution processing from becoming excessive.
- the processing level is defined by the quantity of image data used for the super-resolution processing
- the operator can confirm the degree of the super-resolution processing with the quantity of the image data by referring to the processing management data M3. Therefore, the manageability of the process management data M3 is improved.
- an aspect of defining the processing level with a target resolution or the like can be adopted as the processing level. In such a configuration, since the quantity of image data is appropriately determined according to the performance of the component camera 14, the versatility of the process management data M3 is improved.
- the process management data M3 is automatically generated by the generation process (S21 to S26) of the auxiliary machine side processing unit Ds.
- the process management data M3 may be generated based on production results by an operator or an administrator of the production line 2.
- the component mounter 10 acquires the processing management data M3 from the host computer 40 together with the mounting data M1 and the part data M2 before executing the mounting process.
- the suitability determination unit 55 is based on the high-resolution data generated by the super-resolution processing (S13) and any low-resolution data used for the super-resolution processing (S13). Whether or not the resolution of the resolution data matches the recognition process by the state recognition unit 53 is determined (S23). On the other hand, the suitability determination unit 55 may perform the suitability determination according to other modes without depending on the comparison between the high resolution data and the low resolution data.
- the suitability determination unit 55 employs a method of comparing the position of the target obtained from the relative position of the imaging device and the target at the time of imaging with the position of the target acquired by image processing on the image data. May be. Specifically, the image processing apparatus 50 first determines the position of the electronic component based on a command value obtained by moving the general-purpose camera 31 relative to the mounting table of the camera stand 3 in the imaging process (S12).
- the image processing device 50 calculates the position of the electronic component with respect to the general-purpose camera 31 by image processing on the image data. Then, the suitability determination unit 55 determines suitability based on whether or not the position on the image data is within the allowable error range with respect to the control position. According to such a configuration, the image processing device 50 can reduce the processing load because it is not necessary to perform the super-resolution processing for the suitability determination.
- the board production system 1 includes a data optimization unit 41 that optimizes the mounting data M1.
- the data optimizing unit 41 may optimize the mounting data M1 based on the coordinates on the board on which the electronic component is mounted and the necessity of the super-resolution processing in the processing management data M3.
- the data optimization unit 41 changes the mounting order so that the grouped types of electronic components are mounted on the board Bd through a series of processes (S31 to S33).
- the data optimization unit 41 may optimize the mounting data M1 based on the coordinates on the board Bd on which the electronic component is mounted and the necessity of the super-resolution processing in the processing management data M3. That is, the data optimizing unit 41 considers the contents of the processing management data M3 when grouping the electronic components inside the mounting data M1. For example, when a plurality of suction nozzles 27 hold different types of electronic components in the suction processing (S31), the data optimization unit 41 performs grouping into types that require super-resolution processing and types that do not need to be optimized. Turn into.
- the mounting data M1 optimized as described above in the suction process (S31), it is suppressed that the electronic component of the type that requires the super-resolution process and the unnecessary electronic component are held together. Accordingly, in the state recognition process (S32), the number of times of repeating the process related to imaging (S43 to S45) is reduced, so that the tact time is further shortened. Further, when the processing management data M3 has a processing level set, the data optimization unit 41 may optimize the mounting data M1 based on the processing level. This further improves the efficiency of the mounting process.
- the “production facility” is exemplified as the component mounter 10 and the “object” is an electronic component.
- the image processing apparatus 50 may use a board production apparatus other than the component mounter 10, an inspection apparatus, or the like as the “production facility”.
- the production facility is a print inspection apparatus
- the object is solder printed on a substrate by a screen printer.
- the object is a portion of the substrate corresponding to the divided inspection area. Accordingly, it is possible to set so that the super-resolution processing is performed only on a portion where small components are mounted or a portion where electronic components are densely packed.
- each part of the image processing apparatus 50 may be configured to be provided in the component mounter 10. That is, in the component mounter 10, part data M2 and process management data M3 are generated. Even in such a configuration, the same effects as in the embodiment can be obtained.
Landscapes
- Engineering & Computer Science (AREA)
- Physics & Mathematics (AREA)
- Theoretical Computer Science (AREA)
- General Physics & Mathematics (AREA)
- Microelectronics & Electronic Packaging (AREA)
- Manufacturing & Machinery (AREA)
- Operations Research (AREA)
- Signal Processing (AREA)
- Multimedia (AREA)
- Quality & Reliability (AREA)
- Computer Vision & Pattern Recognition (AREA)
- Supply And Installment Of Electrical Components (AREA)
- Image Processing (AREA)
- Length Measuring Devices By Optical Means (AREA)
Abstract
Description
(基板生産システムの全体構成)
基板生産システム1の全体構成について、図1を参照して説明する。基板生産システム1は、図1に示すように、生産ライン2と、カメラスタンド3と、基板搬送装置5と、ホストコンピュータ40とを備えて構成される。生産ライン2は、基板に対する各種の生産処理を実行する複数の生産設備(基板生産装置、検査装置)を基板の搬送方向に設置して構成される。
部品実装機10の構成について、図1および図2を参照して説明する。部品実装機10は、基台11と、部品供給装置12と、部品移載装置13と、部品カメラ14と、基板カメラ15と、制御装置16とを備えて構成される。各装置12,13および部品カメラ14は、部品実装機10の基台11に設けられている。また、図2に示すように、部品実装機10の水平幅方向(図2の左上から右下に向かう方向)をX軸方向、部品実装機10の水平長手方向(図2の右上から左下に向かう方向)をY軸方向、鉛直高さ方向(図2の上下方向)をZ軸方向とする。
部品実装機10およびカメラスタンド3に適用される画像処理装置50の構成について説明する。ここで、本発明の「生産設備」は「部品実装機10」および「カメラスタンド3」であり、本発明の「対象物」は部品実装機10の保持装置(部品移載装置13)に保持された「電子部品」である態様を例示する。
上記のカメラスタンド3におけるパートデータM2および処理管理データM3の生成処理について、図3を参照して説明する。各データM2,M3の生成処理は、部品実装機10による実装処理の実行の前に行われる。各データM2,M3の生成処理において、図5に示すように、先ずカメラスタンド3の載置台に電子部品がセットされる(ステップ11(以下、「ステップ」を「S」と表記する))。
部品実装機10による電子部品の実装処理について、図5を参照して説明する。この実装処理において、部品実装機10の制御装置16は、実装データM1に従って、先ず複数の吸着ノズル27に電子部品を順次吸着させる吸着処理を実行する(S31)。次に、制御装置16は、実装ヘッド26を基板Bdにおける装着位置の上方へと移動させる。
上記の電子部品の保持状態の認識処理(S32)について、図5および図6を参照して説明する。実装機側処理部Dpは、部品実装機10の実装処理の実行前にカメラスタンド3の補助機側処理部Dsにおいて生成された処理管理データM3を参照する(S41)。そして、実装機側処理部Dpは、吸着処理(S31)により吸着ノズル27が現在保持している電子部品の種別について、超解像処理の実行の要否を取得する。
本実施形態に係る画像処理装置50は、基板Bdに対する各種の生産処理(実装処理)を実行する生産設備(部品実装機10)に適用される。生産設備(部品実装機10)は、対象物(電子部品)を撮像し画像データを取得する撮像装置(部品カメラ14)と、画像データを用いて画像処理装置50が認識した対象物(電子部品)の状態に基づいて生産処理(実装処理)を制御する制御装置16と、を備える。画像処理装置50は、生産処理(実装処理)の実行時において画像データに対する超解像処理の実行の要否を対象物(電子部品)の種別ごとに判定する処理判定部51と、処理判定部51による判定結果に応じて複数の画像データを用いた超解像処理を実行して高解像度データを生成する超解像処理部52と、画像データおよび高解像度データのうち処理判定部51による判定結果に対応する一方に基づいて対象物(電子部品)の状態を認識する状態認識部53と、を備える。
部品実装機10による実装処理では、多種の電子部品を大量に実装することを要求されることがある。上記のような画像処理装置50の構成により、実装処理の実行時における撮像処理(S44)や画像処理(S47,S48)に要する時間を短縮し、サイクルタイムの短縮が可能である。よって、本発明を部品実装機10に適用することは特に有用である。
(処理管理データM3)
実施形態において、処理管理データM3は、図4の右側表で示されるように、電子部品の種別ごとに、超解像処理の要否が設定される。これに対して、処理管理データM3は、対象物(電子部品)の種別ごとに超解像処理の程度を示す処理基準が設定されるようにしてもよい。具体的には、処理管理データM3の処理水準は、図7に示すように、超解像処理部52が高解像度データを生成する際に用いる画像データの数量(フレーム)をもって規定されるようにしてもよい。
実施形態において、適否判定部55は、超解像処理(S13)により生成された高解像度データと、当該超解像処理(S13)に用いられた何れかの低解像度データとに基づいて、低解像度データの解像度が状態認識部53による認識処理に適合するか否かを反手する(S23)。これに対して、適否判定部55は、高解像度データと低解像度データとの比較によらず、他の態様により適否判定を行うようにしてもよい。
実施形態において、基板生産システム1は、実装データM1を最適化するデータ最適化部41を備える。このデータ最適化部41は、電子部品が実装される基板上の座標および処理管理データM3における超解像処理の要否に基づいて、実装データM1を最適化するようにしてもよい。
実施形態における態様は、「生産設備」は部品実装機10であり、且つ「対象物」は電子部品であるものとして例示された。これに対して、画像処理装置50は、部品実装機10の他に、部品実装機10以外の基板生産装置や、検査装置などを上記の「生産設備」としてもよい。
2:生産ライン、 3:カメラスタンド(生産設備)
5:基板搬送装置
10:部品実装機(生産設備)
11:基台、 12:部品供給装置、 13:部品移載装置
14:部品カメラ、 15:基板カメラ、 16:制御装置
21:フィーダ、
25:ヘッド駆動機構、 26:実装ヘッド
27:吸着ノズル、 29:記憶部
31:汎用カメラ、 32:パートデータ生成部
40:ホストコンピュータ
41:データ最適化部、 42:記憶装置
50:画像処理装置
Dp:実装機側処理部
51:処理判定部、 52:超解像処理部、 53:状態認識部
Ds:補助機側処理部
55:適否判定部、 56:処理管理データ生成部
M1:実装データ、 M2:パートデータ、 M3:処理管理データ
Bd:基板、 T:電子部品(対象物)、 Ps:供給位置
Claims (8)
- 基板に対する各種の生産処理を実行する生産設備に適用される画像処理装置であって、
前記生産設備は、
対象物を撮像し画像データを取得する撮像装置と、
前記画像データを用いて前記画像処理装置が認識した前記対象物の状態に基づいて前記生産処理を制御する制御装置と、を備え、
前記画像処理装置は、
前記生産処理の実行時において前記画像データに対する超解像処理の実行の要否を前記対象物の種別ごとに判定する処理判定部と、
前記処理判定部による判定結果に応じて複数の前記画像データを用いた超解像処理を実行して高解像度データを生成する超解像処理部と、
前記画像データおよび前記高解像度データのうち前記処理判定部による判定結果に対応する一方に基づいて前記対象物の状態を認識する状態認識部と、
を備える画像処理装置。 - 前記画像処理装置は、
前記生産処理の実行前において前記対象物を撮像して取得された画像データの解像度が前記状態認識部による認識処理に適合するか否かを対象物の種別ごとに判定する適否判定部と、
前記適否判定部による判定結果に基づいて、前記対象物の種別ごとに超解像処理の実行の要否が設定された処理管理データを生成する処理管理データ生成部と、
をさらに備え、
前記処理判定部は、超解像処理の実行の要否を前記処理管理データに基づいて判定する、請求項1の画像処理装置。 - 前記適否判定部は、前記対象物を撮像して取得された複数の画像データを用いた超解像処理により生成された高解像度データと、当該超解像処理に用いられた何れかの前記画像データとに基づいて、前記画像データの解像度が前記状態認識部による認識処理に適合するか否かを判定する、請求項2の画像処理装置。
- 前記対象物は、前記基板に実装される電子部品であり、
前記画像処理装置は、前記生産処理の実行前において前記電子部品を撮像して取得された画像データを用いて、前記電子部品の形状を含む各種情報を前記電子部品の種別ごとに関連付けたパートデータを生成するパートデータ生成部をさらに備え、
前記適否判定部は、前記パートデータ生成部により前記パートデータの生成に用いられた前記画像データの解像度が前記状態認識部による認識処理に適合するか否かを判定する、請求項2または3の画像処理装置。 - 前記処理管理データは、前記対象物の種別ごとに超解像処理の程度を示す処理水準が設定され、
前記超解像処理部は、超解像処理の実行時において前記処理管理データから前記対象物の種別に応じた前記処理水準を取得し、複数の前記画像データを用いた超解像処理により当該処理水準を満たす前記高解像度データを生成する、請求項2~4の何れか一項の画像処理装置。 - 前記処理水準は、前記超解像処理部が前記高解像度データを生成する際に用いる前記画像データの数量をもって規定されている、請求項5の画像処理装置。
- 前記生産設備は、前記基板に電子部品を実装する部品実装機であり、
前記対象物は、前記部品実装機の保持装置により保持された前記電子部品である、請求項1~6の何れか一項の画像処理装置。 - 請求項7の画像処理装置と、
前記電子部品が実装される前記基板上の座標および前記処理管理データにおける超解像処理の要否に基づいて、前記電子部品の実装順序が規定された実装データを最適化するデータ最適化部と、
を備える基板生産システム。
Priority Applications (5)
Application Number | Priority Date | Filing Date | Title |
---|---|---|---|
US15/125,221 US11004177B2 (en) | 2014-03-13 | 2014-03-13 | Image processing device and board production system |
PCT/JP2014/056694 WO2015136669A1 (ja) | 2014-03-13 | 2014-03-13 | 画像処理装置および基板生産システム |
EP14885828.5A EP3118572B1 (en) | 2014-03-13 | 2014-03-13 | Image processing device and substrate production system |
JP2016507205A JP6310058B2 (ja) | 2014-03-13 | 2014-03-13 | 画像処理装置および基板生産システム |
CN201480077045.7A CN106104195B (zh) | 2014-03-13 | 2014-03-13 | 图像处理装置及基板生产系统 |
Applications Claiming Priority (1)
Application Number | Priority Date | Filing Date | Title |
---|---|---|---|
PCT/JP2014/056694 WO2015136669A1 (ja) | 2014-03-13 | 2014-03-13 | 画像処理装置および基板生産システム |
Publications (1)
Publication Number | Publication Date |
---|---|
WO2015136669A1 true WO2015136669A1 (ja) | 2015-09-17 |
Family
ID=54071146
Family Applications (1)
Application Number | Title | Priority Date | Filing Date |
---|---|---|---|
PCT/JP2014/056694 WO2015136669A1 (ja) | 2014-03-13 | 2014-03-13 | 画像処理装置および基板生産システム |
Country Status (5)
Country | Link |
---|---|
US (1) | US11004177B2 (ja) |
EP (1) | EP3118572B1 (ja) |
JP (1) | JP6310058B2 (ja) |
CN (1) | CN106104195B (ja) |
WO (1) | WO2015136669A1 (ja) |
Cited By (5)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
JP2017168637A (ja) * | 2016-03-16 | 2017-09-21 | 富士機械製造株式会社 | 部品実装機及びヘッドユニット |
WO2018154691A1 (ja) * | 2017-02-23 | 2018-08-30 | 株式会社Fuji | 対基板作業装置および画像処理方法 |
EP3407696A4 (en) * | 2016-01-19 | 2019-01-16 | Fuji Corporation | MOUNTING DEVICE AND PICTURE PROCESSING METHOD |
WO2020065698A1 (ja) * | 2018-09-25 | 2020-04-02 | 株式会社Fuji | 部品データ、部品データ作成システム、部品実装機及び部品実装ラインの生産最適化システム |
JP2020136599A (ja) * | 2019-02-25 | 2020-08-31 | 株式会社Fuji | データ作成装置、決定装置、装着作業機、及び、装着作業実行方法 |
Families Citing this family (6)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
JP6322811B2 (ja) * | 2014-07-28 | 2018-05-16 | パナソニックIpマネジメント株式会社 | 部品実装装置および部品実装方法 |
EP3593960A4 (en) * | 2017-03-06 | 2020-01-22 | Fuji Corporation | DATA STRUCTURE FOR GENERATING IMAGE PROCESSING DATA AND METHOD FOR GENERATING IMAGE PROCESSING DATA |
CN110771277B (zh) * | 2017-06-21 | 2021-06-01 | 株式会社富士 | 对基板作业装置 |
EP3825680A4 (en) * | 2018-07-19 | 2021-07-07 | Fuji Corporation | TEST CONFIGURATION DEVICE AND TEST CONFIGURATION PROCEDURE |
EP3941176A4 (en) * | 2019-03-14 | 2022-04-06 | FUJI Corporation | OBJECT DETERMINATION METHOD AND OBJECT DETERMINATION DEVICE |
CN114073175B (zh) * | 2019-07-04 | 2023-09-22 | 株式会社富士 | 元件安装系统 |
Citations (5)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
JPH11191157A (ja) * | 1997-12-25 | 1999-07-13 | Toshiba Corp | 画像処理装置 |
JP2005127836A (ja) * | 2003-10-23 | 2005-05-19 | Yamaha Motor Co Ltd | 部品認識方法、部品認識装置、表面実装機、部品試験装置および基板検査装置 |
JP2006287116A (ja) * | 2005-04-04 | 2006-10-19 | Yamaha Motor Co Ltd | 照明装置、部品認識装置、表面実装機および部品試験装置 |
JP2007248145A (ja) * | 2006-03-14 | 2007-09-27 | Omron Corp | 検査方法および検査装置 |
JP2011155050A (ja) * | 2010-01-26 | 2011-08-11 | Hitachi High-Tech Instruments Co Ltd | 電子部品装着装置 |
Family Cites Families (25)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
US6938335B2 (en) * | 1996-12-13 | 2005-09-06 | Matsushita Electric Industrial Co., Ltd. | Electronic component mounting method |
JP4420498B2 (ja) * | 1999-11-30 | 2010-02-24 | 積水化学工業株式会社 | 設計支援システム |
JPWO2003075027A1 (ja) * | 2002-03-07 | 2005-06-30 | ヤマハ発動機株式会社 | 電子部品検査装置 |
CA2422224A1 (en) * | 2002-03-15 | 2003-09-15 | Affymetrix, Inc. | System, method, and product for scanning of biological materials |
WO2006064680A1 (ja) * | 2004-12-15 | 2006-06-22 | Matsushita Electric Industrial Co., Ltd. | 動作時間短縮方法、動作時間短縮装置、プログラムおよび部品実装機 |
JP4964522B2 (ja) * | 2006-07-12 | 2012-07-04 | ヤマハ発動機株式会社 | スクリーン印刷装置 |
US8180179B2 (en) * | 2007-12-21 | 2012-05-15 | Canon Kabushiki Kaisha | Image processing apparatus, image processing method, program executing image processing method, and storage medium |
JP2009246935A (ja) * | 2008-03-14 | 2009-10-22 | Sanyo Electric Co Ltd | 画像処理装置およびそれを搭載した撮像装置 |
JP4565016B2 (ja) | 2008-05-16 | 2010-10-20 | キヤノン株式会社 | 画像処理装置、画像処理方法及びそのプログラムならびにこのプログラムを記憶させたコンピュータ読み取り可能な記憶媒体 |
JP5094601B2 (ja) * | 2008-07-09 | 2012-12-12 | キヤノン株式会社 | 画像処理装置及び画像処理方法ならびにプログラム |
JP2010041336A (ja) * | 2008-08-04 | 2010-02-18 | Toshiba Corp | 画像処理装置、および画像処理方法 |
JP5094642B2 (ja) * | 2008-08-28 | 2012-12-12 | キヤノン株式会社 | 画像処理装置およびその制御方法とプログラム |
JP2010161760A (ja) * | 2008-12-09 | 2010-07-22 | Sanyo Electric Co Ltd | 画像処理装置及び電子機器 |
CN101477066B (zh) * | 2009-01-09 | 2012-02-01 | 华南理工大学 | 基于超分辨率图像重建的电路板元件安装/焊接质量检测方法及系统 |
JP4998485B2 (ja) * | 2009-01-23 | 2012-08-15 | パナソニック株式会社 | 部品実装ライン及び部品実装方法 |
JP5182122B2 (ja) * | 2009-01-27 | 2013-04-10 | オムロン株式会社 | 部品実装基板の品質管理用の情報表示システムおよび情報表示方法 |
JP5524495B2 (ja) * | 2009-03-10 | 2014-06-18 | 富士機械製造株式会社 | 撮像システムおよび電子回路部品装着機 |
JP4875117B2 (ja) * | 2009-03-13 | 2012-02-15 | 株式会社東芝 | 画像処理装置 |
JP5393550B2 (ja) * | 2010-03-18 | 2014-01-22 | 株式会社日立ハイテクノロジーズ | 走査荷電粒子顕微鏡を用いた画像生成方法及び装置、並びに試料の観察方法及び観察装置 |
JP2012021852A (ja) * | 2010-07-13 | 2012-02-02 | Olympus Corp | 基板検査装置および基板検査方法 |
KR101624210B1 (ko) * | 2010-08-27 | 2016-05-31 | 한화테크윈 주식회사 | 초해상도 영상 복원 방법, 및 이를 이용한 불법 주정차 단속 시스템 |
JP5791408B2 (ja) | 2011-07-15 | 2015-10-07 | 富士機械製造株式会社 | 電子部品実装装置 |
CN102881000B (zh) * | 2012-09-07 | 2016-05-18 | 华为技术有限公司 | 一种视频图像的超分辨率方法、装置和设备 |
JP5895131B2 (ja) * | 2012-12-25 | 2016-03-30 | パナソニックIpマネジメント株式会社 | 電子部品実装システムおよび電子部品実装方法 |
US9669432B2 (en) * | 2013-08-27 | 2017-06-06 | Te Connectivity Corporation | Component feeding system |
-
2014
- 2014-03-13 CN CN201480077045.7A patent/CN106104195B/zh active Active
- 2014-03-13 US US15/125,221 patent/US11004177B2/en active Active
- 2014-03-13 EP EP14885828.5A patent/EP3118572B1/en active Active
- 2014-03-13 WO PCT/JP2014/056694 patent/WO2015136669A1/ja active Application Filing
- 2014-03-13 JP JP2016507205A patent/JP6310058B2/ja active Active
Patent Citations (5)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
JPH11191157A (ja) * | 1997-12-25 | 1999-07-13 | Toshiba Corp | 画像処理装置 |
JP2005127836A (ja) * | 2003-10-23 | 2005-05-19 | Yamaha Motor Co Ltd | 部品認識方法、部品認識装置、表面実装機、部品試験装置および基板検査装置 |
JP2006287116A (ja) * | 2005-04-04 | 2006-10-19 | Yamaha Motor Co Ltd | 照明装置、部品認識装置、表面実装機および部品試験装置 |
JP2007248145A (ja) * | 2006-03-14 | 2007-09-27 | Omron Corp | 検査方法および検査装置 |
JP2011155050A (ja) * | 2010-01-26 | 2011-08-11 | Hitachi High-Tech Instruments Co Ltd | 電子部品装着装置 |
Cited By (10)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
EP3407696A4 (en) * | 2016-01-19 | 2019-01-16 | Fuji Corporation | MOUNTING DEVICE AND PICTURE PROCESSING METHOD |
JP2017168637A (ja) * | 2016-03-16 | 2017-09-21 | 富士機械製造株式会社 | 部品実装機及びヘッドユニット |
WO2018154691A1 (ja) * | 2017-02-23 | 2018-08-30 | 株式会社Fuji | 対基板作業装置および画像処理方法 |
JPWO2018154691A1 (ja) * | 2017-02-23 | 2019-11-07 | 株式会社Fuji | 対基板作業装置および画像処理方法 |
US10863661B2 (en) | 2017-02-23 | 2020-12-08 | Fuji Corporation | Substrate working device and image processing method |
WO2020065698A1 (ja) * | 2018-09-25 | 2020-04-02 | 株式会社Fuji | 部品データ、部品データ作成システム、部品実装機及び部品実装ラインの生産最適化システム |
JPWO2020065698A1 (ja) * | 2018-09-25 | 2021-02-25 | 株式会社Fuji | 部品データ、部品データ作成システム、部品実装機及び部品実装ラインの生産最適化システム |
JP7019065B2 (ja) | 2018-09-25 | 2022-02-14 | 株式会社Fuji | 部品実装ラインの生産最適化システム |
JP2020136599A (ja) * | 2019-02-25 | 2020-08-31 | 株式会社Fuji | データ作成装置、決定装置、装着作業機、及び、装着作業実行方法 |
JP7269028B2 (ja) | 2019-02-25 | 2023-05-08 | 株式会社Fuji | 決定装置 |
Also Published As
Publication number | Publication date |
---|---|
EP3118572B1 (en) | 2021-08-25 |
CN106104195A (zh) | 2016-11-09 |
CN106104195B (zh) | 2019-01-29 |
EP3118572A4 (en) | 2017-03-22 |
JP6310058B2 (ja) | 2018-04-11 |
JPWO2015136669A1 (ja) | 2017-04-06 |
EP3118572A1 (en) | 2017-01-18 |
US20170069057A1 (en) | 2017-03-09 |
US11004177B2 (en) | 2021-05-11 |
Similar Documents
Publication | Publication Date | Title |
---|---|---|
JP6310058B2 (ja) | 画像処理装置および基板生産システム | |
JP6212134B2 (ja) | 組立機 | |
JP6018844B2 (ja) | 部品装着方法、部品装着装置、及びプログラム | |
US11076520B2 (en) | Production management device for mounting components on multiple board types | |
CN107006148B (zh) | 元件安装装置及元件安装系统 | |
WO2016117017A1 (ja) | 検査支援装置および検査支援方法 | |
JP5190127B2 (ja) | 基板処理装置 | |
JP6646916B2 (ja) | 基板用の画像処理装置および画像処理方法 | |
JP6648252B2 (ja) | 画像処理システム及び画像処理方法 | |
JP6309962B2 (ja) | 組立機 | |
JP6904978B2 (ja) | 部品装着機 | |
JP6715714B2 (ja) | 検査支援装置および検査支援方法 | |
WO2016092673A1 (ja) | 部品実装機 | |
JPWO2019016923A1 (ja) | 対基板作業システム | |
CN110431929B (zh) | 对基板作业机 | |
JP6621639B2 (ja) | 基板用の画像処理装置 | |
JP7153126B2 (ja) | 良否判定装置および良否判定方法 | |
JP6670410B2 (ja) | 検査支援装置および検査支援方法 | |
JP2014029961A (ja) | 部品実装システム | |
JP7269028B2 (ja) | 決定装置 | |
JP7153127B2 (ja) | 良否判定装置および良否判定方法 | |
JP7026234B2 (ja) | 作業支援装置および対基板作業機 | |
JP2020129706A (ja) | 検査方法 | |
JP2004335940A (ja) | 電子部品実装装置および電子部品実装方法 | |
JP2017129895A (ja) | データ処理装置、実装装置、基板検査装置、データ処理方法及びプログラム |
Legal Events
Date | Code | Title | Description |
---|---|---|---|
121 | Ep: the epo has been informed by wipo that ep was designated in this application |
Ref document number: 14885828 Country of ref document: EP Kind code of ref document: A1 |
|
ENP | Entry into the national phase |
Ref document number: 2016507205 Country of ref document: JP Kind code of ref document: A |
|
WWE | Wipo information: entry into national phase |
Ref document number: 15125221 Country of ref document: US |
|
NENP | Non-entry into the national phase |
Ref country code: DE |
|
REEP | Request for entry into the european phase |
Ref document number: 2014885828 Country of ref document: EP |
|
WWE | Wipo information: entry into national phase |
Ref document number: 2014885828 Country of ref document: EP |