CN110248086A - Image processing apparatus, mounting device, image processing method - Google Patents

Image processing apparatus, mounting device, image processing method Download PDF

Info

Publication number
CN110248086A
CN110248086A CN201910171309.XA CN201910171309A CN110248086A CN 110248086 A CN110248086 A CN 110248086A CN 201910171309 A CN201910171309 A CN 201910171309A CN 110248086 A CN110248086 A CN 110248086A
Authority
CN
China
Prior art keywords
image
mode
priority
image processing
processing apparatus
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Granted
Application number
CN201910171309.XA
Other languages
Chinese (zh)
Other versions
CN110248086B (en
Inventor
山田和范
横濑仁彦
田中槙太郎
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
Juki Corp
Original Assignee
Juki Corp
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Juki Corp filed Critical Juki Corp
Publication of CN110248086A publication Critical patent/CN110248086A/en
Application granted granted Critical
Publication of CN110248086B publication Critical patent/CN110248086B/en
Active legal-status Critical Current
Anticipated expiration legal-status Critical

Links

Classifications

    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06TIMAGE DATA PROCESSING OR GENERATION, IN GENERAL
    • G06T5/00Image enhancement or restoration
    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06VIMAGE OR VIDEO RECOGNITION OR UNDERSTANDING
    • G06V10/00Arrangements for image or video recognition or understanding
    • G06V10/20Image preprocessing
    • G06V10/32Normalisation of the pattern dimensions
    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06VIMAGE OR VIDEO RECOGNITION OR UNDERSTANDING
    • G06V20/00Scenes; Scene-specific elements
    • G06V20/10Terrestrial scenes
    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04NPICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N23/00Cameras or camera modules comprising electronic image sensors; Control thereof
    • H04N23/60Control of cameras or camera modules
    • H04N23/667Camera operation mode switching, e.g. between still and video, sport and normal or high- and low-resolution modes
    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04NPICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N23/00Cameras or camera modules comprising electronic image sensors; Control thereof
    • H04N23/80Camera processing pipelines; Components thereof
    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04NPICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N5/00Details of television systems
    • H04N5/222Studio circuitry; Studio devices; Studio equipment
    • H04N5/262Studio circuits, e.g. for mixing, switching-over, change of character of image, other special effects ; Cameras specially adapted for the electronic generation of special effects
    • H04N5/2628Alteration of picture size, shape, position or orientation, e.g. zooming, rotation, rolling, perspective, translation

Abstract

The present invention provides image processing apparatus, mounting device, image processing method, inhibits equipment cost, and reference objects suitably different to size is shot.Image processing apparatus (30) is based on the photographed data inputted from single filming apparatus (32), image recognition is carried out to component, the image processing apparatus (30) is configured to include mode selection part (41), selects mode standard or image quality mode of priority;Image production part (45) generates standard picture according to the photographed data of common shooting condition;Image transformation component (46) carries out image transformation from standard picture to high resolution image in image quality mode of priority;And Image recognizing section (47) carries out image recognition to component according to standard picture or high resolution image.

Description

Image processing apparatus, mounting device, image processing method
Technical field
The present invention relates to image processing apparatus, mounting device, image procossings used in the image recognition in shooting image Method.
Background technique
In the past, as the camera system for being equipped on various manufacturing devices, it is known that will correspondingly be clapped with the size of reference object Distinguish the camera system used in the shooting visual field for taking the photograph device (for example, referring to patent document 1).It is clapped documented by patent document 1 It takes the photograph in system, for standard-sized reference object, is shot by the filming apparatus in the standard visual field, for minute shape Reference object is shot by the filming apparatus in the high-res visual field.The shooting image taken by each filming apparatus, point It is not sent to capture card by after shooting image digitazation, various image procossings are implemented for shooting image by processor etc. Image recognition is carried out to reference object.
Patent document 1: Japanese Unexamined Patent Publication 2005-064048 bulletin
But in the camera system documented by patent document 1, multiple bats must be prepared in order to shoot the change in the visual field System is taken the photograph, the equipment cost of camera system increases.It is also envisaged that reference object is shot by the camera system of 1 system, But if only passing through the filming apparatus in the standard visual field, then it is directed to the reference object of minute shape, occurred since resolution is insufficient Identification mistake deteriorates accuracy of identification.It on the other hand, must basis if only passing through the filming apparatus in the high-res visual field The size of reference object and divide identification, there is a problem of handle the time it is elongated.
Summary of the invention
The present invention proposes in view of the problem, one of its goals is to, it provides and is able to suppress equipment cost, and Image processing apparatus that suitably reference object different to size is shot, mounting device, image processing method, program.
The image processing apparatus of one embodiment of the present invention, it is right based on the photographed data inputted from single filming apparatus Reference object carries out image recognition, which is characterized in that, comprising: mode selection part, to mode standard or Image quality mode of priority is selected;Image production part generates standard picture according to the photographed data of common shooting condition; Image transformation component carries out image transformation from standard picture to high resolution image in image quality mode of priority;And image recognition Portion carries out image recognition to reference object according to standard picture or high resolution image.
The image processing method of one embodiment of the present invention, it is right based on the photographed data inputted from single filming apparatus Reference object carries out image recognition, which is characterized in that, has following step: excellent to mode standard or image quality The step of first mode is selected;The step of generating standard picture according to the photographed data of common shooting condition;In image quality The step of carrying out image transformation to high resolution image from standard picture in mode of priority;And according to standard picture or high image quality figure As the step of carrying out image recognition to reference object.
According to these structures, image recognition is carried out to reference object by standard picture in mode standard, it is excellent in image quality Image recognition is carried out to reference object by high resolution image in first mode.It as a result, correspondingly will mark with the size of reference object Quasi-mode and image quality mode of priority, which are distinguished, to be used, and thus, it is possible to suitably carry out image recognition to reference object.In addition, by soft The processing of part module side and generating high resolution image from standard picture there is no need to prepare multiple filming apparatus can reduce and set Standby cost.
In above-mentioned image processing apparatus, the size of the mode selection part and reference object is correspondingly to mode standard Or image quality mode of priority is selected.According to this structure, the mode matched with the size of reference object is automatically selected.
In above-mentioned image processing apparatus, described image transformation component carries out image transformation by the processing of super resolution degree.Root According to the structure, handled by using super resolution degree, even so that the processing of software module side, can also fully improve parsing Degree is able to suppress as the reduction of resolution accuracy of identification caused by insufficient.
In above-mentioned image processing apparatus, inputs and clap from the filming apparatus via capture card (capture board) Data are taken the photograph, there is forwarding condition configuration par, which sets the forwarding of photographed data for the capture card Condition.According to this structure, in image processing apparatus side, the forwarding condition to capture card is set, can be improved photographed data from Forwarding speed of the capture card to image processing apparatus.The shortening amount of the forwarding time of photographed data is served as to the processing of image transformation Time, thus, it is possible to inhibit the increase of productive temp time.
In above-mentioned image processing apparatus, the forwarding condition configuration par, correspondingly with the outer dimension of reference object It will be set as forwarding condition whether there is or not shearing forwarding.According to this structure, the data ruler for reducing photographed data can be forwarded by shearing It is very little and improve forwarding speed.
In above-mentioned image processing apparatus, there is shooting condition configuration part, which is directed to the bat It takes the photograph device and sets shooting condition.According to this structure, in image processing apparatus side, the shooting condition to filming apparatus is set, It can be improved forwarding speed of the shooting image from filming apparatus to image processing apparatus.
In above-mentioned image processing apparatus, the mode selection part is to mode standard, image quality mode of priority, speed-priority Any one of mode is selected, and the shooting condition configuration part is in mode standard and image quality mode of priority to common bat The condition of taking the photograph is set, and is set in speed-priority mode to the shooting condition of image quality low compared with common shooting condition Fixed, described image generating unit generates standard picture according to common photographed data in mode standard and image quality mode of priority, Low image quality image is generated according to the photographed data of low image quality in speed-priority mode, described image transformation component is preferential in image quality Image transformation is carried out from standard picture to high resolution image in mode, described image identification part is according to standard picture, high image quality figure Picture, low image quality image carry out image recognition to reference object.According to this structure, in speed-priority mode reduce image quality and into Row shooting, therefore can be improved forwarding speed of the shooting image from filming apparatus to image processing apparatus.
In above-mentioned image processing apparatus, the shooting condition configuration part, by the shooting in speed-priority mode The merging treatment of device is set as the shooting condition of low image quality.According to this structure, by making filming apparatus merge movement, from And shooting image can be improved and reducing the merging image of data size and is turned from filming apparatus to image processing apparatus Send out speed.
In above-mentioned image processing apparatus, have mode specifying part, the mode specifying part from user receive mode standard, Image quality mode of priority, speed-priority mode it is specified, compared with the mode selected by the mode selection part, make to pass through institute It is preferential to state the specified mode out of mode specifying part.According to this structure, the mould that can will be automatically selected out by mode selection part Formula is changed according to the judgement of user.
In above-mentioned image processing apparatus, the image recognition of described image identification part and the image of described image transformation component Transformation is performed in parallel by multiprocessor or multi-core processor.It according to this structure, can be for image recognition and image transformation point Other allocation processing device kernel converts image recognition and image and concurrently acts and improve processing speed.
The mounting device of one embodiment of the present invention is characterized in that, comprising: the image processing apparatus of above-mentioned record;And Filming apparatus is input to described image processing unit using image of component as shooting image, is handled and filled by described image It sets according to image of component and image recognition is carried out to component.It according to this structure, can be corresponding to part dimension and suitably to portion Part carries out image recognition, therefore correspondingly can suitably install component with recognition result.
The program of one embodiment of the present invention is based on the photographed data inputted from single filming apparatus and to shooting pair Program as carrying out the image processing apparatus of image recognition, the program are characterized in that, under executing described image processing unit State step: the step of selecting mode standard or image quality mode of priority;According to the photographed data of common shooting condition The step of generating standard picture;The step of carrying out image transformation to high resolution image from standard picture in image quality mode of priority; And the step of image recognition carried out to reference object according to standard picture or high resolution image.According to this structure, by scheming As installation procedure in processing unit, so as to inhibit equipment cost, and reference objects suitably different to size is carried out Shooting.
The effect of invention
According to the present invention, it is used by distinguishing mode standard and image quality mode of priority, so as to inhibit equipment cost, And suitably the reference object different to size is shot.
Detailed description of the invention
Fig. 1 is the schematic diagram for indicating the mounting device entirety of present embodiment.
Fig. 2 is the schematic diagram for indicating the mounting head periphery of present embodiment.
Fig. 3 is the filming apparatus of present embodiment and the block diagram of image processing apparatus.
Fig. 4 is the flow chart of the model selection process of present embodiment.
The explanation of label
1: mounting device
30: image processing apparatus
31: capture card
32: filming apparatus
41: mode selection part
42: mode specifying part
43: forwarding condition configuration par
44: shooting condition configuration part
45: image production part
46: image transformation component
47: Image recognizing section
51: processor cores
52: processor cores
P: component (reference object)
W: substrate
Specific embodiment
In the following, being illustrated referring to attached drawing to the mounting device of present embodiment.Fig. 1 is the peace for indicating present embodiment The schematic diagram of assembling device entirety.Fig. 2 is the schematic diagram for indicating the mounting head periphery of present embodiment.In addition, present embodiment A mounting device only example, can suitably change.
As shown in Figure 1, mounting device 1 is configured to that installation will be passed through by the component P (referring to Fig. 2) that feeder 13 supplies First 12 install to the specified position of substrate W.In the base station 10 of mounting device 1, configured with substrate W is conveyed in X-direction Substrate delivery section 11.Substrate delivery section 11 from the one end of X-direction component is installed before substrate W under mounting head 12 Side moves in and positions, and the substrate W after component is installed is moved out outside the other end lateral device of X-direction.In addition, across base The two sides of plate delivery section 11 are separably linked with made of configuring multiple feeders 13 transversely arrangedly in X-direction and supply To device receptacle 14.
It is detachably mounted with tep reel 15 in feeder 13, is wound in tep reel 15 and encapsulates many component P Material containing band.Feeder 13 by the rotation of the sprocket wheel in device, thus towards being mounted supply position that first 12 pick up and In turn component P is sent out.In the supply position of mounting head 12, removed from material containing band by the covering band on surface, the mouth of material containing band Component P in bag exposes to outside.In addition, in the present embodiment, belt-type feeder is exemplified as feeder 13, but It can have other feeders.
On base station 10, it is provided with the mobile mechanism for moving horizontally a pair of of mounting head 12 in X-direction and Y direction 16.Mobile mechanism 16 is with a pair of of the Y-axis driving portion 17 extended in Y direction and the X-axis driving portion 18 extended in X-direction. A pair of of Y-axis driving portion 17 is supported in the support portion (not shown) being uprightly arranged in the quadrangle of base station 10, and X-axis driving portion 18 is in Y-axis Direction can movably be set to a pair of of Y-axis driving portion 17.In addition, mounting head 12 can be movably arranged at X-axis in X-direction On driving portion 18, by X-axis driving portion 18 and Y-axis driving portion 17 make mounting head 12 move horizontally will from feeder 13 pick up to Component P to the desired position of substrate W install.
As shown in Fig. 2, mounting head 12 be arranged in the mounting head main body 21 for being supported in X-axis driving portion 18 (referring to Fig.1) it is multiple It adsorbs suction nozzle 22 (only illustrating 1 in the present embodiment) and constitutes.Each absorption suction nozzle 22 is supported via suction nozzle driving portion 23 In mounting head main body 21, by the lower movement in the Z-axis direction of suction nozzle driving portion 23, and rotate about the z axis.Each absorption suction nozzle 22 with The connection (not shown) of attraction source, keeps component P and carrying out the attraction in self-gravitation source.It is provided in absorption suction nozzle 22 Helical spring, on one side make coil spring contracts, while incite somebody to action from the component P that absorption suction nozzle 22 adsorbs to substrate W carry.
In mounting head main body 21, it is provided with to (the ginseng of elevation measurement sensor 24 detected with the height of substrate W apart According to Fig. 1) and implement the image recognition of component shape, adsorb the component test section 25 of wrong detection.It is sensed in elevation measurement In device 24, by checking that the reflection of light is detected to from distance of the substrate W until adsorbing suction nozzle 22, it is based on testing result The amount of movement of the up and down direction of absorption suction nozzle 22 is controlled.In component test section 25, illumination region 26 and acceptance part 27 exist Horizontal direction is opposite, according to come the light of self-luminescent part 26 by the shading status of component P shading to component shape, absorption mistake etc. into Row checks.In addition, component test section 25 can also issue LED light from illumination region towards acceptance part, it can also be from illumination region direction Acceptance part issues laser.
In mounting head main body 21, it is provided with from surface and marks the substrate imaging portion 28 shot to the BOC on substrate W (referring to Fig.1) and from the component that oblique upper shoots the carrying movement of the component P realized by absorption suction nozzle 22 it shoots Portion 29.In substrate imaging portion 28, the shooting image based on BOC label carries out image recognition to position, warpage of substrate W etc., Component P is corrected relative to the loading position of substrate W based on these recognition results.In component shoot part 29, with component P Shooting image correspondingly to whether there is or not by absorption 22 adsorption element P of suction nozzle, whether there is or not boarded parts P to check in substrate W.From Photographed data is input to image processing apparatus 30 (referring to Fig. 3) by the filming apparatus 32 of component shoot part 29 etc., at image It manages device 30 and is based on photographed data to component P progress image recognition.
In addition, installing various parts for substrate, but must change according to part dimension in common mounting device The visual field of filming apparatus and shot.Therefore, on the basis of the filming apparatus in the standard visual field, have as option with The corresponding filming apparatus in the high-res visual field, lens, thus on one side with part dimension correspondingly to the standard visual field and high parsing The degree visual field switches over, is shot on one side.However, it is desirable to prepare the filming apparatus in the high-res visual field, lens, there are equipment Cost increases such problems.On the other hand, only by the filming apparatus in the high-res visual field, it is necessary to according to part dimension into Row segmentation identification, since shooting processing is repeated, the processing time is elongated.
Therefore, in the image processing apparatus of present embodiment, substitution has the super resolution degree visual field as option Filming apparatus, but the change of super resolution degree is carried out by software module for the standard picture obtained from the filming apparatus in the standard visual field It changes equal images transformation and improves image quality.High resolution image corresponding with the super resolution degree visual field is created by software module, thus The filming apparatus in the standard visual field and the filming apparatus in the high-res visual field can be combined and reduce equipment cost.In addition, improving The shortening time of forwarding time is served as the processing time of the image transformation of software module side by the forwarding speed of photographed data, by This inhibits the increase of productive temp time.
In the following, being illustrated referring to Fig. 3 to filming apparatus and image processing apparatus.Fig. 3 is the shooting dress of present embodiment It sets and the block diagram of image processing apparatus.In addition, in a block diagram of fig. 3, filming apparatus and image processing apparatus simplification are carried out It records, but be set as filming apparatus and image processing apparatus there is the structure usually having.In addition, the shooting image of Fig. 3 and The movement of image processing apparatus shows an example, is not limited to the structure.
As shown in figure 3, being connected with filming apparatus 32 via capture card 31 in image processing apparatus 30, pass through filming apparatus 32 photographed datas taken are digitized by capture card 31 and are input to image processing apparatus 30.In image processing apparatus 30 In, various processing correspondingly are implemented to photographed data with part dimension, image knowledge is carried out to component P thus according to shooting image , do not implement positioning, check, measure etc..Be provided in the image processing apparatus 30 mode selection part 41, mode specifying part 42, Forward condition configuration par 43, shooting condition configuration part 44, image production part 45, image transformation component 46, Image recognizing section 47.
In mode selection part 41, correspondingly mode standard or image quality mode of priority are automatically selected with part dimension It selects.In this case, the outer dimension of component or electrode size are compared with a reference value as part dimension.For example, such as The short side dimension of fruit component is greater than or equal to a reference value, then selects mode standard, if the short side dimension of component is less than A reference value then selects image quality mode of priority.In addition, for example, if the electrode length of component P is long more than or equal to benchmark Degree, then select mode standard, if the electrode length of component P is less than datum length, carries out to image quality mode of priority Selection.In mode selection part 41, it is not limited to correspondingly carry out the structure of model selection with part dimension, it can also be with portion Part name, other alternative conditions correspondingly carry out model selection.
In addition, in mode selection part 41, it, can also be to speed-priority other than mode standard and image quality mode of priority Mode is selected.Mode standard is used in the mode of the standard picture taken under common shooting condition, mainly in Type component is used into the shooting processing of large component.Image quality mode of priority is using improving image quality compared with standard picture High resolution image mode, mainly small parts shooting processing in used.Speed-priority mode be using with standard Image compares the mode for reducing the low image quality image of image quality, unrelated with part dimension, excellent compared with the accuracy of identification with component First consider to be used in the case where processing speed.
In mode specifying part 42, the mode of mode standard, image quality mode of priority, speed-priority mode is received from user It is specified.If specifying mode from user in mode specifying part 42, with the mode phase selected by mode selection part 41 Than making preferential by the specified mode out of mode specifying part 42.It therefore, can will be with part dimension correspondingly by mode selection part 41 modes automatically selected out, change according to the judgement of user.For example, if the precision of grade of errors reduces, Speed-priority mode can be specified, if the speed of grade of errors reduces, be able to use precision priority mode, it can Mode is neatly changed according to the purposes of user.
In forwarding condition configuration par 43, setting photographed data is directed to the forwarding condition of capture card 31.As forwarding condition, With the outer dimension of component correspondingly to whether there is or not shearing forwardings to set in mode standard and image quality mode of priority.If from It forwards condition configuration par 43 that condition entry will be forwarded to capture card 31, then reflects forwarding condition for capture card 31.If will cut It cuts forwarding and is set as engineering noise, then photographed data is integrally forwarded to image processing apparatus 30 from capture card 31, if will shearing Forwarding is set as " effective ", then shears a part of photographed data from capture card 31 and be forwarded to image processing apparatus 30.
For example, if part dimension be greater than or equal to a reference value, will shearing forwarding be set as engineering noise, be forwarded and Photographed data is not sheared by capture card 31.On the other hand, if part dimension is less than a reference value, shearing is forwarded It is set as " effective ", the middle section of photographed data is correspondingly sheared with forwarding size by capture card 31 and is forwarded.Shooting Device 32 shoots member storage in center, therefore by shearing the middle section of photographed data, thus portion Part image will not lack.The data size for reducing photographed data can be forwarded to improve forwarding speed by shearing.Therefore, even if It is mode standard, also can makes speed-priority by shearing forwarding.
In shooting condition configuration part 44, setting is directed to the shooting condition of filming apparatus 32.As shooting condition, in standard " usual " is set in mode and image quality mode of priority, setting reduces image quality compared with " usual " in speed-priority mode " low image quality ".If shooting condition is input to filming apparatus 32 from shooting condition configuration part 44 via capture card 31, it is directed to Filming apparatus 32 and reflect shooting condition.In the case where shooting condition is " usual " by filming apparatus 32 with standard specification pair Component is shot, and parsing is reduced compared with standard specification by filming apparatus 32 in the case where shooting condition is " low image quality " Degree, compression ratio and component is shot.
For example, being shot with standard specification to component, therefore shot in mode standard and image quality mode of priority Without reducing data size.On the other hand, in speed-priority mode, (binning) processing is merged when shooting, because This reads in multiple pixels as 1 pixel, is thus shot with the state for reducing data size.In speed-priority mode In so that filming apparatus 32 is merged movement, thus, it is possible to improved and reducing the merging image after data size forwarding speed Degree.In addition, the shooting condition as low image quality can set other than merging treatment and reject pixel according to regulation ratio Rejecting processing.
In image production part 45, according to the shooting number of common shooting condition in mode standard and image quality mode of priority According to and generate standard picture, low image quality figure is generated according to the photographed data of the shooting condition of low image quality in speed-priority mode Picture.In addition, carrying out image transformation from standard picture to high resolution image in image quality mode of priority in image transformation component 46. Standard picture is the image of standard size, standard pixel rate, and low-res image is the image of minification, high pixel rate, high Resolution image is the image of up-sizing, low pixel rate.As described above, generating standard picture, low solution for each mode Analysis degree image, very high resolution image.
In addition, having used super resolution degree to handle in the image transformation of the image transformation component 46 of present embodiment, according to mark Quasi- image estimates correct pixel value and increases pixel number, it is thus achieved that high-res.It is handled by using super resolution degree, Even can also fully improve resolution to the processing of software module side, it is able to suppress as caused by resolution deficiency The reduction of accuracy of identification.In addition, image transformation is not limited to the processing of super resolution degree, for example, can also make as image transformation With following interpolations, that is, the bilinearity for being carried out interpolation using the weighted average of the brightness value of 4 pixels around concerned pixel is inserted It mends, the bicubic interpolation by the brightness value of 16 pixels around concerned pixel by the approximate interpolation of 3 formulas progress.
In Image recognizing section 47, image recognition is carried out to component P according to standard picture in mode standard, it is excellent in image quality Image recognition is carried out to component P according to high resolution image in first mode, according to low image quality image to portion in speed-priority mode Part P carries out image recognition.Correspondingly mode is selected with part dimension etc., image recognition is carried out according to image quality appropriate, Therefore inhibit the generation of identification mistake caused by insufficient, the deterioration of accuracy of identification by resolution.For example, about small parts, High resolution image is generated in high image quality mode, image recognition is carried out to small parts with high precision according to high resolution image.Moreover, Recognition result based on Image recognizing section 47 and implement localization process, inspection processing, measurement processing etc. various processing.
In addition, mode selection part 41, mode specifying part 42, forwarding condition configuration par 43, shooting condition configuration part 44, image Generating unit 45, image transformation component 46, Image recognizing section 47 are made of processor, memory of the various processing of execution etc..As place Device is managed, provided with multi-core processor or multiprocessor with multiple processor cores.Memory is depending on the application by ROM (ReadOnlyMemory), one or more storage mediums such as RAM (RandomAccessMemory) are constituted.It deposits in memory Contain the program for making image processing apparatus 30 execute image processing method.
Herein, processor cores are assigned with for the image recognition etc. implemented by common image processing apparatus 51, processor cores 52 are assigned with for newly additional image transformation etc..Image recognition and image is converted concurrently to act, Which thereby enhance processing speed.In addition, being not only image transformation in processor cores 52, being also assigned with model selection, mode Any processing or all processing that specified, forwarding condition setting, shooting condition are set.In addition, being not limited in 2 processors Core 51,52 is also provided with more than or equal to 3 processor cores.
Next, the processing motion flow to image processing apparatus 30 is illustrated.First by mode selection part 41 with Part dimension correspondingly carries out model selection.As described above, by as the outer dimension of part dimension, electrode length and a reference value It is compared, thus any one of mode standard and image quality mode of priority is selected.In addition, if passing through mode specifying part 42 specify mode by user, then the model selection of mode selection part 41 is capped.Even if being identified for example, being reduced by image quality In the case that the reduction of precision is also lacked, speed-priority mode is manually selected.In addition, about passing through what mode selection part 41 was realized The detailed content of model selection corresponding with part dimension, describes below.
If the mode of image processing apparatus 30 is determined, set by forwarding condition configuration par 43 for capture card 31 Forwarding condition, and shooting condition is set for filming apparatus 32 by shooting condition configuration part 44.In forwarding condition configuration par In 43, outer dimension is compared with a reference value, shearing forwarding is thus set as engineering noise or " effective ".In shooting condition In configuration part 44, it is set as " usual " in mode standard and image quality mode of priority, " low picture is set as in speed-priority mode Matter ".Moreover, if shot with the standard visual field (for example, the visual field 54mm) to component by filming apparatus 32, via adopting Photographed data is forwarded to image processing apparatus 30 from filming apparatus 32 by truck 31.
In the selection of mode standard, shooting condition is set to " usual ", therefore from filming apparatus 32 by standard size The photographed data of (for example, 1024 × 1024) is forwarded to capture card 31.Engineering noise is set in the shearing forwarding of capture card 31 In the case where, image processing apparatus 30 is forwarded to from capture card 31 by standard-sized photographed data.On the other hand, in capture card In the case that 31 shearing forwarding is set to " effective ", middle section (example will be only cut out from photographed data from capture card 31 Such as, photographed data 512 × 512) is forwarded to image processing apparatus 30.
In the selection of image quality mode of priority also when the selection of mode standard in the same manner as, from filming apparatus 32 by gauge The photographed data of very little (for example, 1024 × 1024) is forwarded to capture card 31.In addition, to whether there is or not the shearing of capture card 31 forwarding is corresponding Ground is to standard-sized photographed data or shears middle section from photographed data and is forwarded.In the selection of speed-priority mode When, shooting condition is set to " low image quality ", therefore the shooting number of (for example, 512 × 512) will be reduced the size from filming apparatus 32 According to being forwarded to capture card 31.Also, image processing apparatus 30 is forwarded to from capture card 31 by the photographed data of minification.
If photographed data is input to image processing apparatus 30, shooting image is generated by image production part 45.? In mode standard, standard pixel rate (for example, 56 μm) are generated with standard size (for example, 1024 × 1024) according to photographed data Standard picture.In image quality mode of priority, image transformation is carried out to standard picture by image transformation component 46, with up-sizing (for example, 2048 × 2048) generate the high resolution image of low pixel rate (for example, 28 μm).In speed-priority mode, according to bat Data are taken the photograph to reduce the size the low image quality image that (for example, 512 × 512) generate high pixel rate (for example, 112 μm).
Moreover, if standard picture, high resolution image, low image quality image are input to Image recognizing section 47, according to mark Quasi- image, high resolution image, low image quality image carry out image recognition to component.As described above, passing through in image quality mode of priority Image converts and generates high resolution image from standard picture, and there is no need to prepare the shooting of high image quality dress as option It sets.In addition, can make to shoot number by shearing forwarding if shearing forwarding is set as " effective " as forwarding condition According to data size become smaller, by the shortening amount of forwarding time be used for image transformation the processing time.Do not make as a result, equipment cost and The whole processing time increases, it will be able to suitably carry out image recognition to component.
Next, being illustrated referring to Fig. 4 to model selection process.Fig. 4 is the model selection process of present embodiment Flow chart.In addition, be configured to the outer dimension as component in the flow chart of figure 4 and short side dimension is used for model selection, But the process illustrates an example, is not limited to the structure.In addition, suitably being carried out using the label of Fig. 3 in Fig. 4 Explanation.
As shown in figure 4, if having started model selection process by mode selection part 41, in mode specifying part 42 It is specified whether there is or not mode from the user and is determined (step S01).(the step S01 in the case where being determined as " having mode specified " For Yes), (step S02) preferentially will be set by the specified mode out of user.Thereby, it is possible to unrelated and manual with part dimension Ground sets mode.In the case where being determined as " specified without mode " (step S01 is No), by mode selection part 41 referring to portion The dimension data of part and (step S03) is determined to the electrode whether there is or not component.
It is whether big to the short side dimension of component in the case where being determined as " the not electrode of component " (step S03 is No) In or be equal to a reference value (for example, 0.5mm) determined (step S04).It is greater than or equal in the short side dimension for being determined as component In the case where a reference value (step S04 is Yes), " usual " is set to shooting condition, the shearing forwarding of condition is forwarded to be set The mode standard for being set to engineering noise is selected (step S05).The case where the short side dimension for being determined as component is less than a reference value Under (step S04 be No), " usual " is set to shooting condition, forwards the shearing of condition to forward to be set to the picture of " effective " Matter mode of priority is selected (step S06).
In the case where being determined as " having the electrode of component " (step S03 is Yes), whether the electrode length of component is greater than Or it is equal to a reference value (for example, 0.4mm) and is determined (step S07).It is less than a reference value in the electrode length for being determined as component In the case of (step S07 be No), " usual " is set to shooting condition, forwards the shearing of condition to forward to be set to engineering noise Image quality mode of priority selected (step S08).The case where the electrode length for being determined as component is greater than or equal to a reference value Under (step S07 be Yes), determined (step to whether the short side dimension of component is greater than or equal to a reference value (for example, 0.5mm) Rapid S09).
In the case where being determined as that the short side dimension of component is greater than or equal to a reference value (step S9 is Yes), to shooting item The shearing that part is set to " usual ", forwarding condition forwards the mode standard for being set to engineering noise to be selected (step S10). In the case where being determined as that the short side dimension of component is less than a reference value (step S9 is No), shooting condition is set to " logical Often ", the mode standard for forwarding the shearing forwarding of condition to be set to " effective " is selected (step S11).In addition, about shooting Speed-priority mode of the condition for " low image quality ", outer dimension, electrode length independent of component, but in step S02 It is manually specified by mode specifying part 42 by user.
As previously discussed, in the image processing apparatus of present embodiment 30, pass through standard picture pair in mode standard Component P carries out image recognition, carries out image recognition to component P by high resolution image in image quality mode of priority.As a result, with bat The size for taking the photograph object, which correspondingly distinguishes mode standard and image quality mode of priority, to be used, and thus, it is possible to suitably carry out to component P Image recognition.In addition, the processing by software module side generates high resolution image from standard picture, it is multiple there is no need to prepare Filming apparatus can reduce equipment cost.
In addition, in the present embodiment, illustrating through the filming apparatus of component shoot part to the portion as reference object The structure that part is shot, but it is not limited to the structure.For example, it can be the filming apparatus by substrate imaging portion to work The structure shot for the base plate mark of reference object.
In addition, in the present embodiment, high resolution image is not necessarily determined by the size of resolution.High resolution image packet Image containing good-looking in resolution identical with standard picture.Therefore, image transformation component is not limited to solve Analysis degree gets higher such image transformation.
In addition, in the present embodiment, low image quality image is not necessarily determined by the size of resolution.Low image quality image packet Containing the image apparently deteriorated in resolution identical with standard picture.Therefore, the shooting condition of low image quality and unlimited It is lower such shooting condition due to resolution.
In addition, in the present embodiment, being configured to outer dimension, the electrode length etc. by mode selection part based on component Part dimension selects mode, but is not limited to the structure.Mode selection part can based on alternative condition to mode into Row selection, for example, it is also possible to by name of parts alternatively condition it is corresponding to the type of component and automatically to mode progress Selection.
In addition, in the present embodiment, being configured in image processing apparatus to mode standard, the preferential mould of image quality Formula, speed-priority mode are set, but are not limited to the structure.Image processing apparatus at least can be to mode standard, picture Matter mode of priority is set.
In addition, in the present embodiment, being configured to select mode standard, image quality mode of priority by mode selection part It selects, but is not limited to the structure.Mode selection part can also be on the basis of mode standard, image quality mode of priority, to speed Mode of priority is selected.
In addition, in the present embodiment, being configured to set as forwarding condition to forwarding whether there is or not shearing, but not It is defined in the structure.Condition when forwarding condition is photographed data forwarding, such as forwarding speed can also be set etc..
In addition, in the present embodiment, being configured to correspondingly set shearing with the outer dimension of component when shearing forwarding Amount, but it is not limited to the structure.When shearing forwarding, middle section can also be sheared from photographed data with certain size.
In addition, in the present embodiment, be configured to the shooting condition as low image quality and at by merging treatment, rejecting The condition that the resolution of reason etc. reduces image quality is set, but is not limited to the structure.The shooting condition of low image quality can also To be set to the condition for reducing image quality by compression processing.
In addition, in the present embodiment, being configured to make to pass through mode compared with the mode selected by mode selection part The specified mode out of specifying part is preferential, but is not limited to the structure.Mode can also be not provided in image processing apparatus to refer to Determine portion.
In addition, in the present embodiment, exemplifying component as reference object and being illustrated, but it is not limited to this Structure.As long as the object that reference object is shot by filming apparatus, then be not limited especially.
In addition, in the present embodiment, in mounting device there is the structure of image processing apparatus to be illustrated, but scheme As processing unit can be applied to other devices with filming apparatus.For example, image processing apparatus can be applied in substrate The printing equipment of solder paste is printed, the check device that the printing state of solder is checked, makes melt solder and adheres to In the reflow soldering apparatus etc. of component.
In addition, in the present embodiment, absorption suction nozzle is exemplified as suction nozzle, but it is not limited to the structure.Suction nozzle As long as being able to maintain component, for example, it can be clamping suction nozzles.
In addition, in the present embodiment, substrate is the substrate that can install various parts, it is not limited to printing base Plate is also possible to be placed in the flexible base board on tool substrate.
In addition, the program of present embodiment is stored in storage medium.Recording medium is not limited especially, It can be non-volatile recording medium such as CD, photomagneto disk, flash memories.
In addition, embodiments of the present invention and variation are illustrated, but as other embodiments of the invention, It can also globally or locally combine above embodiment and variation.
In addition, embodiments of the present invention are not limited to above-mentioned embodiment and variation, the present invention is not being departed from Technical thought purport range various modifications may be made, displacement, deformation.And if can by the progress of technology or Derivative other technologies, realize technical thought of the invention by other means, then this method can be used and implemented.Cause This, claims cover whole embodiments in the range of may be included in technical thought of the invention.
Also, in the above-described embodiment, image processing apparatus is based on the photographed data inputted from single filming apparatus, Image recognition is carried out to reference object, which is characterized in that, comprising: mode selection part, to mode standard Or image quality mode of priority is selected;Image production part generates standard drawing according to the photographed data of common shooting condition Picture;Image transformation component carries out image transformation from standard picture to high resolution image in image quality mode of priority;And image is known Other portion carries out image recognition to reference object according to standard picture or high resolution image.According to this structure, in mode standard It is middle that image recognition is carried out to reference object according to standard picture, according to high resolution image to reference object in image quality mode of priority Carry out image recognition.Correspondingly mode standard and image quality mode of priority are distinguished with the size of reference object as a result, and used, thus Image recognition suitably can be carried out to reference object.In addition, the processing by software module side generates high draw from standard picture Matter image can reduce equipment cost there is no need to prepare multiple filming apparatus.
Industrial applicibility
As described above, the present invention has following effects, that is, is able to suppress equipment cost, and suitably to ruler Very little different reference object is shot, particularly, suitable for image used in the image recognition in the component of mounting device Processing unit, mounting device, image processing method, program.

Claims (12)

1. a kind of image processing apparatus carries out figure to reference object based on the photographed data inputted from single filming apparatus As identifying,
The image processing apparatus is characterized in that, comprising:
Mode selection part selects mode standard or image quality mode of priority;
Image production part generates standard picture according to the photographed data of common shooting condition;
Image transformation component carries out image transformation from standard picture to high resolution image in image quality mode of priority;And
Image recognizing section carries out image recognition to reference object according to standard picture or high resolution image.
2. image processing apparatus according to claim 1, which is characterized in that
The size of the mode selection part and reference object correspondingly selects mode standard or image quality mode of priority.
3. image processing apparatus according to claim 1 or 2, which is characterized in that
Described image transformation component carries out image transformation by the processing of super resolution degree.
4. image processing apparatus according to any one of claim 1 to 3, which is characterized in that
Photographed data is inputted from the filming apparatus via capture card,
With forwarding condition configuration par, which sets the forwarding item of photographed data for the capture card Part.
5. image processing apparatus according to claim 4, which is characterized in that
The forwarding condition configuration par will correspondingly be set as forwarding item whether there is or not shearing forwarding with the outer dimension of reference object Part.
6. image processing apparatus according to any one of claim 1 to 5, which is characterized in that
With shooting condition configuration part, which sets shooting condition for the filming apparatus.
7. image processing apparatus according to claim 6, which is characterized in that
The mode selection part selects any one of mode standard, image quality mode of priority, speed-priority mode,
The shooting condition configuration part sets common shooting condition in mode standard and image quality mode of priority, in speed The shooting condition of image quality low compared with common shooting condition is set in degree mode of priority,
Described image generating unit generates standard picture according to common photographed data in mode standard and image quality mode of priority, Low image quality image is generated according to the photographed data of low image quality in speed-priority mode,
Described image transformation component carries out image transformation from standard picture to high resolution image in image quality mode of priority,
Described image identification part carries out image recognition according to standard picture, high resolution image, low image quality image, to reference object.
8. image processing apparatus according to claim 7, which is characterized in that
The shooting condition configuration part, is set as low image quality for the merging treatment of the filming apparatus in speed-priority mode Shooting condition.
9. image processing apparatus according to claim 7 or 8, which is characterized in that
With mode specifying part, which receives mode standard, image quality mode of priority, speed-priority mode from user It is specified,
Compared with the mode selected by the mode selection part, make excellent by the specified mode out of the mode specifying part First.
10. image processing apparatus according to any one of claim 1 to 9, which is characterized in that
The image recognition of described image identification part and the image of described image transformation component are converted by multiprocessor or multi-core processor It is performed in parallel.
11. a kind of mounting device comprising:
Image processing apparatus described in any one of claims 1 to 10;And
Filming apparatus is input to described image processing unit using image of component as shooting image,
Image recognition is carried out to component according to image of component by described image processing unit.
12. a kind of image processing method carries out figure to reference object based on the photographed data inputted from single filming apparatus As identifying,
The image processing method is characterized in that thering is following step:
The step of mode standard or image quality mode of priority are selected;
The step of generating standard picture according to the photographed data of common shooting condition;
The step of carrying out image transformation to high resolution image from standard picture in image quality mode of priority;And
The step of image recognition is carried out to reference object according to standard picture or high resolution image.
CN201910171309.XA 2018-03-07 2019-03-07 Image processing apparatus, mounting apparatus, image processing method, and storage medium Active CN110248086B (en)

Applications Claiming Priority (2)

Application Number Priority Date Filing Date Title
JP2018-040504 2018-03-07
JP2018040504A JP2019161249A (en) 2018-03-07 2018-03-07 Image processing device, mounting device, image processing method, and program

Publications (2)

Publication Number Publication Date
CN110248086A true CN110248086A (en) 2019-09-17
CN110248086B CN110248086B (en) 2022-03-11

Family

ID=67883006

Family Applications (1)

Application Number Title Priority Date Filing Date
CN201910171309.XA Active CN110248086B (en) 2018-03-07 2019-03-07 Image processing apparatus, mounting apparatus, image processing method, and storage medium

Country Status (2)

Country Link
JP (1) JP2019161249A (en)
CN (1) CN110248086B (en)

Families Citing this family (1)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
WO2024057433A1 (en) * 2022-09-14 2024-03-21 ヤマハ発動機株式会社 Component mounter and component imaging method

Citations (8)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
JP2009246710A (en) * 2008-03-31 2009-10-22 Fujifilm Corp Image processing method and apparatus therefor
CN101626445A (en) * 2008-07-08 2010-01-13 京瓷美达株式会社 Image reading apparatus, and image forming apparatus
CN202918393U (en) * 2011-10-04 2013-05-01 富士机械制造株式会社 Camera device
WO2013187033A1 (en) * 2012-06-12 2013-12-19 日本電気株式会社 Control device, image transmission method, and control program
US20140176705A1 (en) * 2011-08-30 2014-06-26 Fujitsu Limited Photographing apparatus, information providing method, and computer product
CN104052926A (en) * 2013-03-14 2014-09-17 Juki株式会社 Image processing device and image processing method
CN105989361A (en) * 2015-03-19 2016-10-05 卡西欧计算机株式会社 Information processor and face recognition method
CN107079620A (en) * 2014-11-13 2017-08-18 富士机械制造株式会社 Fitting machine and used fitting machine electronic component absorption posture inspection method

Family Cites Families (7)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
JPH0973510A (en) * 1995-09-06 1997-03-18 Hitachi Ltd Bar code recognition processor
JP4262832B2 (en) * 1999-05-20 2009-05-13 Juki株式会社 Image input method and apparatus
JP4828741B2 (en) * 2001-08-23 2011-11-30 大日本スクリーン製造株式会社 Probe mark measuring method and probe mark measuring apparatus
JP5030261B2 (en) * 2005-11-16 2012-09-19 キヤノン株式会社 VIDEO DISTRIBUTION DEVICE, VIEWER DEVICE, VIDEO DISTRIBUTION DEVICE CONTROL METHOD, VIEWER DEVICE CONTROL METHOD, AND COMPUTER PROGRAM
JP2009206354A (en) * 2008-02-28 2009-09-10 Fuji Mach Mfg Co Ltd Image recognition apparatus and image recognition method of electronic component mounting machine
JP6655422B2 (en) * 2016-02-23 2020-02-26 Juki株式会社 Image processing apparatus, mounting apparatus, image processing method, and program
JP6751144B2 (en) * 2016-07-28 2020-09-02 株式会社Fuji Imaging device, imaging system, and imaging processing method

Patent Citations (8)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
JP2009246710A (en) * 2008-03-31 2009-10-22 Fujifilm Corp Image processing method and apparatus therefor
CN101626445A (en) * 2008-07-08 2010-01-13 京瓷美达株式会社 Image reading apparatus, and image forming apparatus
US20140176705A1 (en) * 2011-08-30 2014-06-26 Fujitsu Limited Photographing apparatus, information providing method, and computer product
CN202918393U (en) * 2011-10-04 2013-05-01 富士机械制造株式会社 Camera device
WO2013187033A1 (en) * 2012-06-12 2013-12-19 日本電気株式会社 Control device, image transmission method, and control program
CN104052926A (en) * 2013-03-14 2014-09-17 Juki株式会社 Image processing device and image processing method
CN107079620A (en) * 2014-11-13 2017-08-18 富士机械制造株式会社 Fitting machine and used fitting machine electronic component absorption posture inspection method
CN105989361A (en) * 2015-03-19 2016-10-05 卡西欧计算机株式会社 Information processor and face recognition method

Also Published As

Publication number Publication date
JP2019161249A (en) 2019-09-19
CN110248086B (en) 2022-03-11

Similar Documents

Publication Publication Date Title
JP5780712B2 (en) Imaging system and electronic circuit component mounting machine
US7488283B2 (en) Circuit-substrate-related-operation performing apparatus, and method of supplying constituent element to the apparatus
KR101005800B1 (en) Electronic parts mounting apparatus and method
CN107006147B (en) Component mounter
JP6021560B2 (en) Parts inspection method and apparatus
CN104641737A (en) Electronic circuit component mounting machine
JP6043367B2 (en) Component mounting apparatus and component mounting method
CN103196364B (en) Element camera head, surface mounting apparatus and component detection device
CN110248086A (en) Image processing apparatus, mounting device, image processing method
JP2022000926A (en) Trace method
WO2015181974A1 (en) Component-data-generating device, surface-mounting machine, and method for generating component data
JP5095378B2 (en) Component mounting method and apparatus
JP4331054B2 (en) Adsorption state inspection device, surface mounter, and component testing device
JP2008139024A (en) Ic handlers and shuttle for the same
KR102597252B1 (en) Method for mounting semiconductors provided with bumps on substrate locations of a substrate
JP2009212373A (en) Component mounting apparatus
JP6108415B2 (en) Die supply device
US20160249500A1 (en) Component mounting device
US8898893B2 (en) Method and apparatus for applying fluid during a placement cycle
JP5149147B2 (en) Component inspection device and component transfer device
JP6099359B2 (en) Deflection amount detection device and deflection amount detection method
JP6096292B2 (en) Electronic component mounting machine
JP2020009938A (en) Image processing apparatus, mounting apparatus, image processing method, and program
JP2006228905A (en) Surface component mounter
JP2014022427A (en) Component-mounting apparatus and component-mounting method

Legal Events

Date Code Title Description
PB01 Publication
PB01 Publication
SE01 Entry into force of request for substantive examination
SE01 Entry into force of request for substantive examination
GR01 Patent grant
GR01 Patent grant