EP3457113B1 - Foreign object inspection device and foreign object inspection method - Google Patents

Foreign object inspection device and foreign object inspection method Download PDF

Info

Publication number
EP3457113B1
EP3457113B1 EP18185400.1A EP18185400A EP3457113B1 EP 3457113 B1 EP3457113 B1 EP 3457113B1 EP 18185400 A EP18185400 A EP 18185400A EP 3457113 B1 EP3457113 B1 EP 3457113B1
Authority
EP
European Patent Office
Prior art keywords
foreign object
inspection
image
suction
spot
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Active
Application number
EP18185400.1A
Other languages
German (de)
French (fr)
Other versions
EP3457113A1 (en
Inventor
Toyoaki Mitsue
Tomio Sawasaki
Chieko KANAYAMA
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
Sugino Machine Ltd
Original Assignee
Sugino Machine Ltd
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Sugino Machine Ltd filed Critical Sugino Machine Ltd
Publication of EP3457113A1 publication Critical patent/EP3457113A1/en
Application granted granted Critical
Publication of EP3457113B1 publication Critical patent/EP3457113B1/en
Active legal-status Critical Current
Anticipated expiration legal-status Critical

Links

Images

Classifications

    • GPHYSICS
    • G01MEASURING; TESTING
    • G01VGEOPHYSICS; GRAVITATIONAL MEASUREMENTS; DETECTING MASSES OR OBJECTS; TAGS
    • G01V8/00Prospecting or detecting by optical means
    • G01V8/10Detecting, e.g. by using light barriers
    • BPERFORMING OPERATIONS; TRANSPORTING
    • B08CLEANING
    • B08BCLEANING IN GENERAL; PREVENTION OF FOULING IN GENERAL
    • B08B5/00Cleaning by methods involving the use of air flow or gas flow
    • B08B5/02Cleaning by the force of jets, e.g. blowing-out cavities
    • BPERFORMING OPERATIONS; TRANSPORTING
    • B08CLEANING
    • B08BCLEANING IN GENERAL; PREVENTION OF FOULING IN GENERAL
    • B08B5/00Cleaning by methods involving the use of air flow or gas flow
    • B08B5/04Cleaning by suction, with or without auxiliary action
    • BPERFORMING OPERATIONS; TRANSPORTING
    • B08CLEANING
    • B08BCLEANING IN GENERAL; PREVENTION OF FOULING IN GENERAL
    • B08B9/00Cleaning hollow articles by methods or apparatus specially adapted thereto 
    • B08B9/02Cleaning pipes or tubes or systems of pipes or tubes
    • B08B9/021Cleaning pipe ends or pipe fittings, e.g. before soldering
    • GPHYSICS
    • G01MEASURING; TESTING
    • G01BMEASURING LENGTH, THICKNESS OR SIMILAR LINEAR DIMENSIONS; MEASURING ANGLES; MEASURING AREAS; MEASURING IRREGULARITIES OF SURFACES OR CONTOURS
    • G01B11/00Measuring arrangements characterised by the use of optical techniques
    • GPHYSICS
    • G01MEASURING; TESTING
    • G01BMEASURING LENGTH, THICKNESS OR SIMILAR LINEAR DIMENSIONS; MEASURING ANGLES; MEASURING AREAS; MEASURING IRREGULARITIES OF SURFACES OR CONTOURS
    • G01B11/00Measuring arrangements characterised by the use of optical techniques
    • G01B11/24Measuring arrangements characterised by the use of optical techniques for measuring contours or curvatures
    • GPHYSICS
    • G01MEASURING; TESTING
    • G01NINVESTIGATING OR ANALYSING MATERIALS BY DETERMINING THEIR CHEMICAL OR PHYSICAL PROPERTIES
    • G01N1/00Sampling; Preparing specimens for investigation
    • G01N1/02Devices for withdrawing samples
    • GPHYSICS
    • G01MEASURING; TESTING
    • G01NINVESTIGATING OR ANALYSING MATERIALS BY DETERMINING THEIR CHEMICAL OR PHYSICAL PROPERTIES
    • G01N15/00Investigating characteristics of particles; Investigating permeability, pore-volume, or surface-area of porous materials
    • G01N15/06Investigating concentration of particle suspensions
    • G01N15/0606Investigating concentration of particle suspensions by collecting particles on a support
    • G01N15/0618Investigating concentration of particle suspensions by collecting particles on a support of the filter type
    • G01N15/0625Optical scan of the deposits
    • GPHYSICS
    • G01MEASURING; TESTING
    • G01NINVESTIGATING OR ANALYSING MATERIALS BY DETERMINING THEIR CHEMICAL OR PHYSICAL PROPERTIES
    • G01N15/00Investigating characteristics of particles; Investigating permeability, pore-volume, or surface-area of porous materials
    • G01N15/10Investigating individual particles
    • G01N15/14Electro-optical investigation, e.g. flow cytometers
    • G01N15/1456Electro-optical investigation, e.g. flow cytometers without spatial resolution of the texture or inner structure of the particle, e.g. processing of pulse signals
    • G01N15/1459Electro-optical investigation, e.g. flow cytometers without spatial resolution of the texture or inner structure of the particle, e.g. processing of pulse signals the analysis being performed on a sample stream
    • GPHYSICS
    • G01MEASURING; TESTING
    • G01NINVESTIGATING OR ANALYSING MATERIALS BY DETERMINING THEIR CHEMICAL OR PHYSICAL PROPERTIES
    • G01N15/00Investigating characteristics of particles; Investigating permeability, pore-volume, or surface-area of porous materials
    • G01N15/10Investigating individual particles
    • G01N15/14Electro-optical investigation, e.g. flow cytometers
    • G01N15/1468Electro-optical investigation, e.g. flow cytometers with spatial resolution of the texture or inner structure of the particle
    • GPHYSICS
    • G01MEASURING; TESTING
    • G01NINVESTIGATING OR ANALYSING MATERIALS BY DETERMINING THEIR CHEMICAL OR PHYSICAL PROPERTIES
    • G01N15/00Investigating characteristics of particles; Investigating permeability, pore-volume, or surface-area of porous materials
    • G01N15/10Investigating individual particles
    • G01N15/14Electro-optical investigation, e.g. flow cytometers
    • G01N15/1468Electro-optical investigation, e.g. flow cytometers with spatial resolution of the texture or inner structure of the particle
    • G01N15/147Electro-optical investigation, e.g. flow cytometers with spatial resolution of the texture or inner structure of the particle the analysis being performed on a sample stream
    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06TIMAGE DATA PROCESSING OR GENERATION, IN GENERAL
    • G06T7/00Image analysis
    • G06T7/0002Inspection of images, e.g. flaw detection
    • G06T7/0004Industrial image inspection
    • G06T7/001Industrial image inspection using an image reference approach
    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06TIMAGE DATA PROCESSING OR GENERATION, IN GENERAL
    • G06T7/00Image analysis
    • G06T7/60Analysis of geometric attributes
    • G06T7/62Analysis of geometric attributes of area, perimeter, diameter or volume
    • BPERFORMING OPERATIONS; TRANSPORTING
    • B08CLEANING
    • B08BCLEANING IN GENERAL; PREVENTION OF FOULING IN GENERAL
    • B08B2215/00Preventing escape of dirt or fumes from the area where they are produced; Collecting or removing dirt or fumes from that area
    • B08B2215/003Preventing escape of dirt or fumes from the area where they are produced; Collecting or removing dirt or fumes from that area with the assistance of blowing nozzles
    • GPHYSICS
    • G01MEASURING; TESTING
    • G01NINVESTIGATING OR ANALYSING MATERIALS BY DETERMINING THEIR CHEMICAL OR PHYSICAL PROPERTIES
    • G01N1/00Sampling; Preparing specimens for investigation
    • G01N1/02Devices for withdrawing samples
    • G01N2001/028Sampling from a surface, swabbing, vaporising
    • GPHYSICS
    • G01MEASURING; TESTING
    • G01NINVESTIGATING OR ANALYSING MATERIALS BY DETERMINING THEIR CHEMICAL OR PHYSICAL PROPERTIES
    • G01N15/00Investigating characteristics of particles; Investigating permeability, pore-volume, or surface-area of porous materials
    • G01N2015/0042Investigating dispersion of solids
    • G01N2015/0046Investigating dispersion of solids in gas, e.g. smoke
    • GPHYSICS
    • G01MEASURING; TESTING
    • G01NINVESTIGATING OR ANALYSING MATERIALS BY DETERMINING THEIR CHEMICAL OR PHYSICAL PROPERTIES
    • G01N15/00Investigating characteristics of particles; Investigating permeability, pore-volume, or surface-area of porous materials
    • G01N15/10Investigating individual particles
    • G01N15/14Electro-optical investigation, e.g. flow cytometers
    • G01N2015/1486Counting the particles
    • GPHYSICS
    • G01MEASURING; TESTING
    • G01NINVESTIGATING OR ANALYSING MATERIALS BY DETERMINING THEIR CHEMICAL OR PHYSICAL PROPERTIES
    • G01N15/00Investigating characteristics of particles; Investigating permeability, pore-volume, or surface-area of porous materials
    • G01N15/10Investigating individual particles
    • G01N15/14Electro-optical investigation, e.g. flow cytometers
    • G01N2015/1497Particle shape
    • GPHYSICS
    • G01MEASURING; TESTING
    • G01NINVESTIGATING OR ANALYSING MATERIALS BY DETERMINING THEIR CHEMICAL OR PHYSICAL PROPERTIES
    • G01N21/00Investigating or analysing materials by the use of optical means, i.e. using sub-millimetre waves, infrared, visible or ultraviolet light
    • G01N21/84Systems specially adapted for particular applications
    • G01N21/88Investigating the presence of flaws or contamination
    • G01N21/94Investigating contamination, e.g. dust
    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06TIMAGE DATA PROCESSING OR GENERATION, IN GENERAL
    • G06T2207/00Indexing scheme for image analysis or image enhancement
    • G06T2207/30Subject of image; Context of image processing
    • G06T2207/30108Industrial image inspection
    • G06T2207/30164Workpiece; Machine component

Definitions

  • the present invention relates to a foreign object inspection device and a foreign object inspection method for inspecting foreign objects remaining on a workpiece.
  • a known inspection method includes cleaning an inspection target (workpiece) such as a machine component with a cleaning liquid, filtering the liquid used, and observing the residues captured on the filter.
  • a residue measuring apparatus then images the residues on the filter, and subjects the obtained data to image processing (refer to, for example, Japanese Patent Application Publication No. 2011-179987 , or Patent Literature 1).
  • JP2008183546 A discloses a foreign object inspection device with a nozzle, suction channel and a detector installed on the suction channel, the detector being used to correlate the number of foreign objects to the inspection spot.
  • the inspection device comprises a filter for capturing and subsequent visual inspection of the captured foreign objects.
  • Patent Literature 1 The technique described in Patent Literature 1 is not intended to detect the position and the shape of foreign objects remaining on a workpiece.
  • One or more aspects of the present invention are directed to a foreign object inspection device and a foreign object inspection method that determine the position and the shape of foreign objects remaining on a workpiece.
  • a first aspect of the present invention provides a foreign object inspection device for inspecting foreign objects at inspection spots of a workpiece according to claim 1.
  • Typical workpieces to be inspected by the inspection device are machine components, including a head cylinder and a block cylinder for an automobile engine, an automobile case transaxle, a housing transaxle, a crankshaft, a construction equipment valve body, an anti-lock brake system (ABS) body, and a brake cylinder.
  • a head cylinder and a block cylinder for an automobile engine an automobile case transaxle, a housing transaxle, a crankshaft, a construction equipment valve body, an anti-lock brake system (ABS) body, and a brake cylinder.
  • ABS anti-lock brake system
  • Inspection spots refer to surface portions of a workpiece to be inspected for remaining foreign objects.
  • the inspection spots are determined for each type of workpiece.
  • the inspection spots include, for example, an internal thread, a through-hole, an oil groove hole, a spool hole, and an oil hydraulic circuit surface.
  • the inspection device has its suction port to be placed in contact with each inspection spot.
  • the inspection device sucks through the suction port. Any foreign object at an inspection spot is sucked through the suction channel into a detector.
  • the detector captures the foreign object.
  • the detector detects information (foreign object information) about either the captured or moving foreign object.
  • the foreign object information includes, for example, the length, the width, the area, the height, and an image of a foreign object, or a combination of these.
  • the foreign object information about a foreign object sucked from any inspection spot is obtained individually. The frequency at which foreign objects remain after cleaning, or the shape or the color of the remaining foreign objects is obtained.
  • the inspection device may have a permissible amount or size of foreign objects defined for each inspection spot.
  • the inspection device and the inspection method herein enable detailed inspection of the state of foreign objects remaining at each inspection spot.
  • the length of a foreign object is the maximum distance between two points on the outer periphery of the foreign object.
  • the width is the diameter of the largest circle inscribed in the foreign object. The length is evaluated using the maximum diameter of the foreign object.
  • the area is the area of the projected image of the foreign object. The image of the foreign object formed through imaging. Either the length or the width of the foreign object is selectable.
  • the length and the width of the foreign object indicate the substantial size of the foreign object placed on a flat surface.
  • the length and the width, or further the area may be combined with the height of the foreign object placed on a flat surface measured from the flat surface.
  • Foreign objects mainly include chips. Chips may have an arc or helical shape. Like the width, the height of a foreign object may be its substantial size depending on the shape of the foreign object.
  • the inspection device may include an arm that moves the nozzle relative to a workpiece.
  • the inspection device including the arm can position the nozzle at a spot on the surface of the workpiece at which a foreign object is likely to remain.
  • the inspection device may also include a numerical controller that controls the arm using the coordinates of the suction port. The numerical controller allows an operator referring to a working drawing of the object to easily program the nozzle route.
  • the inspection device may include a trigger in place of the arm.
  • the nozzle includes a grip. An operator holds the grip to place the nozzle onto each inspection spot.
  • the suction channel is flexible.
  • the suction channel is a suction duct.
  • the suction channel may be suspended.
  • the suction channel may extend along the arm.
  • the suction channel may be conductive.
  • the suction channel may be grounded.
  • the foreign object information may be stored using the coordinates of the numerical controller, and thus is associated with the spot at which a foreign object remains.
  • the spot at which a foreign object remains is stored in a manner associated with the foreign object information to later determine the state of the detected foreign object as well as the spot of the workpiece at which the foreign object has been detected. Detailed information about the state of remaining foreign objects is useful in improving cleaning using a cleaning device.
  • the numerical controller can be selected from a variety of controllers that numerically control the orientation and the position of the arm.
  • the inspection device can store the foreign object information in correspondence with an inspection spot number. An inspector can easily obtain information about the state of remaining foreign objects.
  • a controller different from the numerical controller may be used to control the arm.
  • the inspection device forms an image of a foreign object sucked from the inspection spot by photographing after waiting for a predetermined moving time.
  • the moving time herein refers to a period of time from when the suction is started to when a foreign object is detected. The moving time is measured by a timer.
  • the inspection device waits for an imaging standby time and may then take a video for a predetermined period to shorten the imaging time.
  • the imaging standby time may be slightly shorter than the moving time taken from when the suction of a foreign object is started to when the foreign object is detected. Shortening the imaging time can reduce the file size of the video, and thus the computational load in the video processing. The same applies to detection of foreign objects using photoelectric sensors.
  • the foreign object sucked into the housing flows through the suction path connection port into a capture chamber.
  • the sucked air flows through the filter and the support, and is released from the suction channel.
  • the sucked foreign object is captured on the filter.
  • the foreign object captured on the filter is imaged by an imaging device through a window.
  • the support is a flat plate.
  • the filter supported on the support extends flatly.
  • the foreign object will reside on the filter in its most natural position.
  • the filter and the window face each other.
  • the imaging device can image the foreign object in the natural position.
  • the imaging device may have a shallow depth of field.
  • the imaging device may have a depth of field of 0.002 to 0.05 mm.
  • the imaging device can combine multiple images formed at different subject distances.
  • the inspection device calculates the height of the foreign object based on the range of the combined subject distances of the resultant composite image.
  • a filter image obtained for each inspection spot is used to extract foreign object images.
  • a matching unit matches a foreign object image contained in a filter image for a target inspection spot to a foreign object image contained in a filter image for an inspection spot immediately preceding the target inspection spot.
  • the matching unit determines the foreign object image unmatching the preceding foreign object image to be a foreign object image of a foreign object remaining on the current inspection spot.
  • a foreign object captured on the filter may move or be reversed on the filter.
  • a filter image is formed for each inspection spot, and foreign object images contained in each filter image are extracted. Of these foreign object images, a newly extracted foreign object image may then be determined to be a foreign object image of a newly detected foreign object at the inspection spot.
  • the foreign object information may be a video.
  • the detector may include a transparent channel included in the suction channel, illuminators that illuminate the transparent channel with a light beam, and a high-speed camera that takes a video of a foreign object moving through the transparent channel.
  • the detector may be combined with any of the above suction devices.
  • the detector may detect a foreign object moving through the transparent channel.
  • the transparent channel may have a thinly extending rectangular section.
  • the transparent channel may include a housing and an observation window in the housing.
  • the high-speed camera may form an image of the foreign object.
  • the inspection device associates foreign object information detected when a foreign object sucked from an inspection spot is expected to move through the detector with the inspection spot.
  • the detector may include a photoelectric sensor in place of the high-speed camera.
  • the photoelectric sensor includes a projector that emits light spread across the width of the transparent channel.
  • the photoelectric sensor includes a light receiver that detects the blocked width by which the light is blocked by the foreign object.
  • the detector may include two photoelectric sensors along the flow.
  • the detector may include a photoelectric sensor and a speed sensor for measuring the speed of a foreign object.
  • the foreign object moving through the transparent channel blocks the optical path of the photoelectric sensor.
  • the width of the blocked light is used to detect the width of the foreign object.
  • the time for which the light is blocked and the moving speed of the foreign object are used to detect the length of the foreign object.
  • the photoelectric sensor detects the moving width used by a foreign object to move through the transparent channel or the moving length of the foreign object along the transparent channel.
  • the nozzle may include a suction nose holding the suction port in a manner retractable along the axis of the suction pipe.
  • the nozzle including the suction nose may be combined with either a detector that detects a foreign object captured on the filter or a detector that forms a video of a foreign object moving through the transparent channel.
  • the nozzle may include a lance with a distal end extending along the axis of the suction pipe in the suction pipe.
  • the lance jets compressed air.
  • the lance can be used together with the suction nose.
  • the lance is inserted into an inspection spot.
  • the lance at the inspection spot jets compressed air to blow a foreign object at the inspection spot upward in a reliable manner.
  • the foreign object blown upward is sucked through the suction pipe.
  • the compressed air may be jetted preferably after the suction port is placed in contact with the surface of the inspection spot.
  • the compressed air may be jetted after a predetermined time from when the suction port is placed in contact with the surface of the inspection spot. This can prevent the foreign object from jumping out of the suction pipe.
  • a second aspect of the present invention provides a method for inspecting a foreign object on a workpiece according to claim 11.
  • Storing the foreign object information in a manner associated with the inspection spot includes associating the foreign object information with the number or the coordinates of the inspection spot.
  • the suction port may be first placed near the inspection spot and then pressed against the inspection spot.
  • the suction nozzle may contain a lance.
  • the lance may be inserted into the inspection spot.
  • the lance may be inserted into the inspection spot after the suction nozzle is placed in contact with the inspection spot.
  • the lance may be inserted into the inspection spot at the same time as when the nozzle is pressed against the inspection spot. The lance then jets compressed air into the inspection spot.
  • the lance When an inspection spot is a through-hole, the lance may be placed through the inspection spot. The lance may then jet compressed air from its end opposite to the end inserted into the inspection spot. The compressed air jetted from the lance removes any foreign object adhering in the inspection spot. The jetted compressed air is sucked through the nozzle, together with the foreign object.
  • the suction port After the suction port is placed near the inspection spot, the suction port is left unmoved for the moving time.
  • the suction nozzle includes a lance, the lance may continuously or intermittently jet compressed air during the moving time.
  • the detector detects a foreign object. After the foreign object is detected, the suction port or the lance is removed from the inspection spot. The suction port is then placed near a next inspection spot. The inspection device inspects all inspection spots one by one to obtain foreign object information for each inspection spot.
  • the foreign object inspection device and the foreign object inspection method according to the above aspects of the present invention determine the position and the shape of foreign objects remaining on a workpiece.
  • a foreign object inspection device 10 (hereafter simply an inspection device) 10 according to a first embodiment will now be described.
  • the inspection device 10 inspects a foreign object as an inspection target remaining on a workpiece 17.
  • the inspection device 10 includes a base 11, an arm 13, a mount 15, a nozzle 30, a suction duct (suction channel) 21, a detector 40, an exhauster 25, and a safety fence 27.
  • the inspection device 10 may also include sealing devices 26.
  • the base 11 is a frame.
  • the base 11 may include a drain pan on its lower surface.
  • the arm 13 is located on the upper surface of the base 11.
  • the arm 13 is a robot, such as a vertically articulated robot, an orthogonal robot, or a parallel link robot.
  • the nozzle 30 is located at the distal end of the arm 13. The arm 13 moves the nozzle 30 to be in contact with inspection spots 18 (collectively for inspection spots 181 to 185 in Fig. 7 ) of the workpiece (inspection target) 17.
  • the mount 15 is located on the upper surface of the base 11.
  • the mount 15 receives the workpiece 17.
  • the safety fence 27 covers the base 11.
  • the safety fence 27 has a door (not shown) for an inspector to enter.
  • the suction duct (suction channel) 21 connects the nozzle 30 to the detector 40.
  • the suction duct 21 is suspended between the nozzle 30 and a position near the ceiling of the safety fence 27.
  • the suction duct 21 is, for example, a flexible duct hose.
  • the suction duct 21 may be contained in a cable protection pipe.
  • the suction duct 21 may be formed from a conductive material and grounded.
  • a heater may be arranged around the outer peripheral surface of the suction duct 21.
  • the grounded conductive suction duct 21 prevents a foreign object 51 (refer to Figs. 8A and 8B ) passing through and sliding along the suction duct 21 from being electrically charged and adhering to the suction duct 21.
  • An external heater heats the suction duct 21 to prevent water contained in sucked air from condensing and adhering to the inner surface of the suction duct 21.
  • the foreign object 51 refers to any substance adhering to and remaining on the workpiece 17, such as chips or lint.
  • the suction duct 21 may extend along the arm 13 instead of being suspended from near the ceiling.
  • the exhauster 25 is a vacuum pump, such as a dry rotary vane vacuum pump, a dry scroll vacuum pump, or an oil rotary vacuum pump.
  • the exhauster 25 may include an exhaust valve 251. When the exhauster 25 is activated and the exhaust valve 251 is open, the exhauster 25 starts sucking the foreign object 51 or other substances through the suction port along the suction duct 21.
  • the exhaust valve 251 eliminates repeated activation and deactivation of the exhauster 25 and thus shortens the cleaning time.
  • the nozzle 30 includes a support rod 39, a suction pipe 38, and a suction port 33.
  • the support rod 39 includes a flange 391.
  • the flange 391 is fixed to a mount surface 131 of the arm 13.
  • the support rod 39 supports the suction pipe 38.
  • the nozzle 30 may include a suction nose 32, which is located at the distal end of the suction pipe 38.
  • the suction nose 32 has a suction port 33 at its distal end.
  • the suction nose 32 holds the suction port 33, which is retractable along the axis of the suction pipe 38.
  • Fig. 2 shows the suction nose 32 being contracted in the right half, and being extended in the left half.
  • the suction pipe 38 is hollow and cylindrical.
  • the suction pipe 38 has a suction channel connection port 37 at its basal end.
  • the suction duct 21 is connected to the suction channel connection port 37.
  • the suction port 33 is circular, rectangular, or specifically shaped in conformance to the shape of the inspection spot 18.
  • the suction port 33 is slightly larger than the inspection spot 18.
  • the suction port 33 is circular and has an inner diameter (or a diameter) of 7 to 9 mm.
  • the material defining the suction port 33 is selectable from materials soft enough not to damage the workpiece 17 when the suction port 33 touches the workpiece 17.
  • the material defining the suction port 33 is selectable from conductive plastic and conductive rubber.
  • the suction pipe 38 may include a ring 314 and slide surfaces 311 and 312.
  • the suction pipe 38 includes a ring 314 located at a basal end of the suction pipe spring guide 315 and holding an end of the helical spring 325.
  • the suction pipe 38 includes cylindrical slide surfaces 311 and 312 on the inner peripheral surface of its distal end.
  • the slide surface 312 has a smaller diameter than the slide surface 311, and is located nearer the distal end than the slide surface 311.
  • the slide surface 311 and the slide surface 312 together define a step 313, which functions as a stopper for a guide tube 322.
  • the suction nose 32 includes a guide tube 322, a slide guide 323, a spring guide 324, and an elastic helical spring 325.
  • the guide tube 322 is hollow and cylindrical, and has its outer peripheral surface slidable on the slide surface 312.
  • the slide guide 323 is located at the basal end of the guide tube 322.
  • the suction port 33 is located at the distal end of the guide tube 322.
  • the slide guide 323 has a larger diameter than the guide tube 322.
  • the spring guide 324 is located on the outer surface of the guide tube 322 at its distal end.
  • the spring guide 324 has an outer diameter slightly smaller than the inner diameter of the helical spring 325.
  • the helical spring 325 is supported by the spring guide 324 and the outer surface of the suction pipe 38 at its lower end, and held between the ring 314 and the suction port 33.
  • the helical spring 325 urges the suction nose 32 toward the distal end.
  • the suction nose 32 slides in the suction pipe 38 while the slide guide 323 slides along the slide surface 311 and the guide tube 322 slides along the slide surface 312.
  • the helical spring 325 may be replaced by another elastic member, such as a disc spring, a leaf spring, or a rubber tube.
  • the inspection device 10 further includes a lance 34, a compressed air feeder 28, and an air tube (compressed air feeder tube) 29.
  • the lance 34 is installed in the nozzle 30.
  • the lance 34 is inserted from outside the suction pipe 38 into the suction pipe 38.
  • a distal end of the lance 34 extends in the direction in which the suction port 33 is retractable, or in other words concentrically with the suction pipe 38.
  • the distal end of the lance 34 is closed.
  • the lance 34 has one or more orifices 341 in the peripheral surface of the distal end.
  • the lance 34 may have multiple orifices 341 radially at circumferentially equal intervals in the peripheral surface of the distal end.
  • the lance 34 may have multiple orifices 341 in its axial direction.
  • the lance 34 may have eight orifices 341, or four arranged in the circumferential direction and two arranged in the axial direction as shown in the figures.
  • the lance 34 may have orifices 341 at its distal end in place of the orifices 341 arranged in the circumferential direction. In this case, the distal end of the lance 34 is located slightly inward from the suction port 33 without protruding outward from the suction port 33 when the suction nose 32 is extended.
  • the compressed air feeder 28 may include an air compressor and an air on-off valve.
  • the air tube 29 connects the compressed air feeder 28 to the lance 34.
  • the air tube 29 may be flexible.
  • the air tube 29 may extend along the suction duct 21.
  • the inspection device 10 may include a nozzle exchanger 35 and an electromagnetic valve 36.
  • the nozzle exchanger 35 includes a master cylinder 352 and an adapter 351.
  • the master cylinder 352 is fixed to the support rod 39.
  • the suction duct 21 is connected to the master cylinder 352.
  • the suction pipe 38 is connected to the adapter 351.
  • the adapter 351 may be detachable from the master cylinder 352 to allow mounting of an appropriate nozzle 30 onto the arm 13 in conformance to the shape of the inspection spot 18.
  • the master cylinder 352 includes a body 3520, a main protrusion 3521, a suction channel 3526, an air channel 3527, plungers 3522, a gasket 3523, a sub-protrusion 3524, and a gasket 3525.
  • the body 3520 is cylindrical.
  • the body 3520 has a cylindrical main protrusion 3521 at its center.
  • the main protrusion 3521 has the suction channel 3526 extending through its center.
  • the main protrusion 3521 includes multiple plungers 3522 radially extending in its center portion.
  • the gasket 3523 is located at the outer peripheral surface of the main protrusion 3521.
  • the body 3520 includes the cylindrical sub-protrusion 3524 parallel to the main protrusion 3521 near its peripheral surface.
  • the gasket 3525 is located at the outer peripheral surface of the sub-protrusion 3524.
  • the sub-protrusion 3524 has the air channel 3527 extending through its center.
  • a suction channel 3514, the suction channel 3526, and the suction pipe 38 have an identical inner diameter, and are coaxial.
  • the air tube 29 is connected to the air channel 3527 with a joint 291.
  • the adapter 351 includes a body 3510, a main recess 3511, a suction channel 3514, a V-groove 3512, a sub-recess 3513, and an air channel 3515.
  • the body 3510 is cylindrical.
  • the body 3510 has the main recess 3511 at its center.
  • the main recess 3511 is a cylindrical blind hole.
  • the main recess 3511 receives the main protrusion 3521 fit in it.
  • the main recess 3511 has the suction channel 3514 extending through its center.
  • the suction channel 3514 is connected to the suction pipe 38.
  • the main recess 3511 has the V-groove 3512 with a V-shaped cross-section in its vertically center portion.
  • the V-groove 3512 extends circumferentially.
  • the body 3510 has the sub-recess 3513 parallel to the main recess 3511 near its peripheral surface.
  • the sub-recess 3513 is a cylindrical blind hole, which is radially smaller than the main recess 3511.
  • the sub-recess 3513 receives the sub-protrusion 3524 fit in it.
  • the sub-recess 3513 has the air channel 3515 extending through its center.
  • the lance 34 is connected to the air channel 3515 with a joint 342.
  • the adapter 351 When the adapter 351 is attached to the master cylinder 352, the main protrusion 3521 and the sub-protrusion 3524 are respectively received in the main recess 3511 and the sub-recess 3513, and the plungers 3522 protrude into the V-groove 3512. This fixes the adapter 351 to the master cylinder 352.
  • the suction channel 3514 and the suction channel 3526 are hermetically sealed with the gasket 3523.
  • the air channel 3515 and the air channel 3527 are hermetically sealed with the gasket 3525.
  • the electromagnetic valve 36 is located between the compressed air feeder 28 and the master cylinder 352.
  • the electromagnetic valve 36 is a directional control valve.
  • the electromagnetic valve 36 is switched to the connection mode, the compressed air fed from the compressed air feeder 28 through the channel (not shown) within the master cylinder 352 pushes the plungers 3522 outward, causing the ends of the plungers 3522 to protrude into the V-groove 3512. This connects the adapter 351 to the master cylinder 352.
  • the electromagnetic valve 36 is switched to the disconnection mode, the ends of the plungers 3522 are pulled inward by the urging force of a spring (not shown). This disconnects the adapter 351 from the master cylinder 352.
  • the air channel 3515, the air channel 3527, and the gasket 3525 may be eliminated.
  • the detector 40 includes a body (housing) 41, a capture chamber 42, a window 43, a filter 44, a support body (support) 45, a buffer chamber 46, a camera (imaging device) 48, and illuminators 49.
  • the body 41 is rectangular, and includes an upstream body 411 and a downstream body 412.
  • the upstream body 411 has a capture chamber 42 at its center.
  • the capture chamber 42 is cylindrical and hollow.
  • the capture chamber 42 extends through the upstream body 411 from the outer surface into the downstream body 412.
  • the capture chamber 42 has its outer end closed with the window 43.
  • the capture chamber 42 has a filter connection port 421 at its end facing the downstream body 412.
  • the capture chamber 42 has a suction path connection port 473 in its cylindrical surface.
  • a suction channel 471 extends through the upstream body 411 from the outer surface of the upstream body 411 through the suction path connection port 473.
  • the suction duct 21 is connected to the suction channel 471.
  • the downstream body 412 includes a disc-shaped support body 45 at its center.
  • the support body 45 supports the filter 44.
  • the support body 45 allows a gas to flow through.
  • the support body 45 is, for example, a metal mesh, a porous plate, or a honeycomb plate.
  • the filter 44 is held between the support body 45 and the filter connection port 421.
  • the filter 44 and the support body 45 are slightly larger than the filter connection port 421.
  • the filter 44, the support body 45, and the filter connection port 421 are arranged concentrically.
  • a hollow buffer chamber 46 having an opening 461 is located below the support body 45.
  • the buffer chamber 46 is cylindrical.
  • a suction channel 472 is connected to the buffer chamber 46.
  • the suction channel 472 is connected to the exhauster 25.
  • the sucked air flows through the suction channel 471, the capture chamber 42, the filter 44, the support body 45, the buffer chamber 46, and the suction channel 472, and is released.
  • the sucked foreign object moves through the suction channel 471 and the capture chamber 42 and is captured on the filter 44.
  • the camera 48 is used to observe a foreign object 51 captured on the surface of the filter 44 through the window 43 and the capture chamber 42.
  • the camera 48 is, for example, an optical camera.
  • the camera 48 has a lens facing the window 43.
  • the camera 48 can have a shallow depth of field.
  • the camera 48 may have a depth of field of 0.002 to 0.05 mm.
  • the camera 48 may also include a subject distance changer that can automatically change the subject distance.
  • the camera 48 having a shallow depth of field and including a subject distance changer can form filter images 53 at several different subject distances.
  • the camera 48 may include a contrast calculation unit.
  • the camera 48 extracts a focused portion of each of the images formed at different subject distances using the calculated contrast.
  • the camera 48 forms each filter image 53 (refer to Fig. 9 ) by combining the images formed at different subject distances.
  • An extractor 63 calculates the height of the foreign object 51 (refer to Figs. 8A and 8B ) based on the focused subject distance.
  • the illuminators 49 illuminate the surface of the filter 44 through the window 43.
  • the illuminators 49 are, for example, spotlights.
  • Each sealing device 26 includes a cylinder 261, a support plate 262, and a sealer 263.
  • the cylinder 261 is a fluid cylinder, such as an air cylinder.
  • the support plate 262 is moved by the cylinder 261.
  • the support plate 262 is fixed to the cylinder rod of the cylinder 261.
  • the sealer 263 is pressed against the workpiece 17.
  • the sealer 263 separates from the workpiece 17, and moves to its retracted position.
  • the sealers 263 seal the openings 186 and 187.
  • the sealers 263 are, for example, rubber plates or O-rings. Each sealer 263 is supported by the corresponding support plate 262.
  • the sealing devices 26 seal the openings 186 and 187 other than the inspection spot 185. After the suction at the inspection spot 185 is complete, the sealing devices 26 retract the sealers 263 to unseal the openings 186 and 187.
  • the controller 60 includes a storage 61, a numerical controller 62, an extractor 63, a matching unit 64, and an output unit 65.
  • the storage 61 includes a main storage (memory) and a sub-storage (storage).
  • the storage 61 includes a coordinate storage 611, a filter image storage 615, a foreign object image storage 614, and a foreign object information storage 613.
  • the coordinate storage 611 includes an inspection coordinate storage 612.
  • the coordinate storage 611 stores, as a numerical control program, coordinates, movement commands, dwells, and tool numbers used for the numerical controller 62 to drive the arm 13.
  • the inspection coordinate storage 612 stores coordinates and movement commands used to place the nozzle 30 in contact with the inspection spot 18.
  • the inspection coordinate storage 612 may store the inspection spot members.
  • the filter image storage 615 stores the filter images 53 (refer to Fig. 9 ) in a manner associated with the inspection spot numbers or the inspection coordinates.
  • the filter image storage 615 stores multiple filter images 53 formed by the camera 48 at different focal lengths for each inspection spot number or each set of inspection coordinates.
  • the filter image storage 615 may store a composite image by combining focused portions of the filter images 53 together.
  • the foreign object image storage 614 stores foreign object images 52 (collectively for foreign object images 521 to 526 in Fig. 9 ) for each inspection spot 18.
  • Each foreign object image 52 is an image of the foreign object 51 (refer to Figs. 8A and 8B ) extracted from the filter image 53.
  • the foreign object information storage 613 stores individual information about the foreign objects 51 (foreign object information), such as a foreign object image 52, the length, the width, the area, the color, and the height of each foreign object 51 for the inspection spot 18.
  • the length of each foreign object 51 is the maximum distance between two points on the outer periphery.
  • the width of each foreign object 51 is the diameter of the largest inscribed circle.
  • the foreign object information storage 613 stores the inspection spot number or the inspection coordinate and the foreign object image 52 of each foreign object 51 for the inspection spot 18.
  • the numerical controller 62 controls the arm 13 using the coordinates and movement commands stored in the coordinate storage 611.
  • the numerical controller 62 includes a timer.
  • the numerical controller 62 may be selectable from a variety of controllers that control the arm 13 using the coordinates (e.g., controllers that store an intended destination through direct teaching).
  • the numerical controller 62 controls the compressed air feeder 28, the exhauster 25, and the detector 40.
  • the extractor 63 extracts the foreign object images 52 contained in the filter images 53.
  • the extractor 63 extracts the contour of each foreign object image 52 using the difference in color or height between the background and the foreign object 51.
  • the extractor 63 extracts, from each foreign object image 52, information about the corresponding foreign object 51 including the length, the width, the area, the color, or the height of the foreign object 51.
  • the extractor 63 may extract only foreign objects having a length equal to or greater than a specified length. The specified length is input by a user and prestored in the storage 61.
  • the extractor 63 is, for example, a known foreign object extractor (e.g., the measuring device described in Patent Literature 1).
  • the output unit 65 includes a display, such as a liquid crystal monitor.
  • the output unit 65 displays the foreign object images 52 for each inspection spot 18 and information about the foreign object images 52.
  • the matching unit 64 extracts the appearance features, calculates rotational, symmetric, and scaling transformation, and determines whether the images match each other.
  • the matching unit 64 matches the foreign object image 521 to the foreign object image 523, and the foreign object image 522 to the foreign object image 526.
  • the matching unit 64 then associates unmatching foreign object images 524 and 525 with the inspection spot number 3 as newly sucked foreign objects.
  • the arm 13 moves the suction port 33 to be in contact with a first inspection spot 18 (S2).
  • the exhaust valve 251 is open for the suction port 33 to start sucking (S3).
  • the lance 34 jets compressed air (S4).
  • the lance 34 is inserted into the inspection spot 18 (S5).
  • the foreign object 51 is sucked and captured on the filter 44 (S6).
  • the lance 34 stops jetting the compressed air (S7).
  • the exhaust valve 251 is closed to stop sucking (S8).
  • the camera 48 forms a filter image 53 (S9).
  • the extractor 63 extracts a foreign object image 52 from the filter image 53 (S10).
  • the matching unit 64 matches the foreign object image 52 extracted at the preceding inspection spot to the foreign object image 52 extracted at the current inspection spot. As a result, an image of the foreign object newly extracted at the current inspection spot is stored in a manner associated with the current inspection spot (S11).
  • the extractor 63 extracts the foreign object information from the foreign object image 52 newly extracted at the current inspection spot (S12).
  • the processing in steps S2 to S10 is repeated for each inspection spot (SI, S13, and S14).
  • Fig. 6 shows steps S1, S13, and S14 as simple repeated operations.
  • the numerical controller 62 controls the arm 13, the detector 40, and the exhauster 25 in the order specified in the numerical control program stored in the coordinate storage 611.
  • the arm 13 moves along a programed route 55 to place the nozzle 30 sequentially in contact with the inspection spots 181 to 185 of the workpiece 17 and to insert the lance 34 into each inspection spot.
  • the processing in steps S2 to S8 will be described with reference to Figs. 8A and 8B .
  • the arm 13 first moves the suction port 33 toward the inspection spot 18 to a position substantially perpendicular to a workpiece surface 171.
  • the suction port 33 is placed in contact with the inspection spot 18 (S2).
  • the numerical controller 62 activates the exhauster 25 and opens the exhaust valve 251 to release air from the inspection spot 18, the suction pipe 38, and the suction duct 21 (S3).
  • the numerical controller 62 causes the compressed air feeder 28 to feed compressed air.
  • the arm 13 further presses the nozzle 30 against the workpiece 17.
  • the helical spring 325 then contracts, and the suction nose 32 slides into the suction pipe 38.
  • the lance 34 is then inserted into the inspection spot 18 (S5).
  • the suction port 33 is still in contact with the workpiece surface 171.
  • a jet of compressed air jetted through the orifices 341 forms a swirl flow 57 along a screw thread 188.
  • the foreign object 51 adhering to the screw thread 188 is drawn into the swirl flow 57 and sucked through the suction port 33.
  • the lance 34 is inserted to a position slightly above the bottom of the inspection spot 18, and is then raised. After the lance 34 is raised, the suction port 33 is still in contact with the inspection spot 18.
  • the lance 34 may be inserted repeatedly.
  • the nozzle 30 with the suction nose 32 and the lance 34 can have the lance 34 insertable into the inspection spot 18.
  • the swirl flow 57 can thus reach a deep end of the inspection spot 18, removing the foreign object 51 from the inspection spot 18.
  • step S6 the foreign object 51 inside the inspection spot 18 is sucked through the suction port 33.
  • the sucked foreign object 51 moves through the suction duct 21 and the suction channel 471 into the capture chamber 42, and is captured on the surface of the filter 44.
  • the sucked air flows through the filter 44, the support body 45, the buffer chamber 46, and the suction channel 472, and is released by the exhauster 25.
  • the numerical controller 62 measures the moving time from when the lance 34 is raised.
  • the moving time is the time taken for the sucked foreign object 51 to move until being captured by the filter 44. While the numerical controller 62 waits for the moving time, the exhauster 25 continues to suck through the suction port 33.
  • the numerical controller 62 controls the compressed air feeder 28 to stop feeding compressed air (S7).
  • the numerical controller 62 then closes the exhaust valve 251 (S8).
  • the exhauster 25 may be stopped.
  • the sealing devices 26 seal the openings 186 and 187 before step S2. After step S8, the sealing devices 26 unseal the openings 186 and 187.
  • step S9 the numerical controller 62 lights the illuminators 49.
  • the numerical controller 62 drives the camera 48.
  • the camera 48 forms an image of the filter 44 through the window 43.
  • the camera 48 stores the obtained filter image 53 into the filter image storage 615.
  • step S10 the extractor 63 reads the filter image 53 from the filter image storage 615, and extracts foreign object images 523 to 526 from a filter image 532.
  • the extractor 63 has previously extracted foreign object images 521 and 522.
  • the extracted foreign object images 523 to 526 are stored into the foreign object image storage 614.
  • Step S11 will be described with reference to Fig. 9 .
  • the foreign object information storage 613 stores the foreign object images 524 and 525 into the foreign object information storage 613 in a manner associated with the inspection spot number or the inspection coordinates.
  • step S12 the extractor 63 extracts the foreign object information about the foreign objects 51, such as the length of the foreign object images 524 and 525 for the inspection spot 183 (refer to Fig. 7 ).
  • the foreign object information storage 613 stores the foreign object information together with the foreign object images 524 and 525.
  • the output unit 65 outputs, for each inspection spot 18, the foreign object images 52 for the inspection spot 18 and the information about the foreign object images.
  • the numerical values in Fig. 10 represent the length by the width in some examples.
  • steps S10 to S12 may be performed successively after the suction and the imaging (S2 to S9) are complete for every inspection spot 18.
  • the value Y in the flowchart is the total number of inspection spots 18.
  • the inspection device 10 obtains the foreign object images 52 of the foreign objects 51 adhering to the workpiece 17 in a manner associated with the corresponding inspection spots 18.
  • the inspection device 10 can thus determine the position or the shape of each foreign object 51.
  • the inspection device 10 may be used for inspection after cleaning, enabling quantitative evaluation of the cleaning effect for each part of the workpiece.
  • the inspection device 10 After the foreign object images 52 are extracted from the filter images 53, the inspection device 10 performs matching using the foreign object images 52 contained in the filter images 53 for each inspection spot 18. This allows the inspection device 10 to determine the correct shape or number of the foreign objects 51, although the foreign objects 51 may move or be reversed on the filter 44 during the inspection.
  • the inspection device 10 can store the filter images 53.
  • the inspection device 10 can extract data from the filter images 53 stored in, for example, a storage after the inspection is complete.
  • the inspection device 10 can compare data obtained under different data extraction conditions to improve data reliability.
  • the inspection device 70 includes a trigger 71, a detector 73, and a controller 80.
  • the detector 73 includes a high-speed camera 75.
  • the nozzle 30 may include a grip 72.
  • the other components in the present embodiments are the same as those of the inspection device 10.
  • the trigger 71 is, for example, a foot switch or a trigger attached to the nozzle 30. When activated, the trigger 71 generates a trigger signal.
  • the detector 73 includes a transparent channel 74, the high-speed camera 75, and illuminators 49.
  • the transparent channel 74 is formed from a transparent material such as polycarbonate, acrylic resin, tempered glass, or sapphire glass.
  • the transparent channel 74 is a thin channel having a rectangular cross-section.
  • the transparent channel 74 having a thin cross-section is likely to have a uniform flow inside and to have any foreign objects 51 moving at a constant speed through the transparent channel 74.
  • the transparent channel 74 may include a hard film inside.
  • the high-speed camera 75 is oriented perpendicularly to the direction in which the transparent channel 74 extends.
  • the high-speed camera 75 has the lens oriented toward the thinner side of the cross-section.
  • the high-speed camera 75 may preferably have an imaging speed of 4,000 to 10,000 fps for high-speed transfer.
  • the high-speed camera 75 preferably includes a close-up lens to form images of foreign objects with a size of 0.1 to 0.5 mm.
  • the high-speed camera 75 is controlled by a counter 83.
  • the transparent channel 74 may include an observation window, which is formed from a transparent material, and a housing, which is formed from an opaque material, to which the observation window is attached.
  • the transparent channel 74 with the above structure may have the observation window made of tempered glass or sapphire glass, and the other parts made of metal.
  • the transparent channel 74 with this structure is less costly and has intended strength.
  • the inspection device 70 may eliminate the nozzle exchanger 35 (refer to Fig. 11 ).
  • the nozzle exchanger 35 is manually detachable.
  • the controller 80 will now be described with reference to Fig. 13 .
  • the controller 80 includes a counter 83, a storage 81, and an extractor 82.
  • the counter 83 counts signals from the trigger 71.
  • the counter 83 serves as a timer.
  • the counter 83 measures the imaging standby time from when the trigger 71 is activated.
  • the imaging standby time corresponds to the time taken for the foreign object 51 sucked from the nozzle 30 to arrive at the detector 73.
  • the imaging standby time may be set to about 0.5 to 1 second shorter than the moving time taken from when suction of the foreign object 51 is started to when the foreign object 51 is detected.
  • the counter 83 also measures the moving time from when the trigger 71 is deactivated.
  • the counter 83 counts the trigger number, which is the number of times the trigger 71 is activated.
  • the counter 83 transmits the trigger number to the storage 81.
  • the counter 83 measures the standby time upon receipt of the trigger signal. Upon elapse of the standby time, the counter 83 causes the compressed air feeder 28 to feed compressed air to the nozzle 30.
  • the standby time is preset in the counter 83.
  • the extractor 82 extracts foreign object videos containing the foreign objects 51 from the entire video taken by the high-speed camera 75.
  • the extractor 82 extracts, from the entire video or from the foreign object videos, a frame containing the clearest entire image of the foreign object 51 as a foreign object image.
  • the extractor 82 extracts the contour of the foreign object 51 using, for example, the difference between the background color and the color of the foreign object 51.
  • the background color and the color of the foreign object 51 are the lightness for a monochrome camera used as the high-speed camera 75.
  • the extractor 82 extracts, from the foreign object images 52 for example, foreign object information about the foreign object 51 such as the length, the width, the area, the color, and the height of the foreign object 51.
  • the extractor 82 may extract only foreign objects having a length greater than or equal to a specified length. The specified length is input by a user in advance, and is stored in the storage 81.
  • the storage 81 includes a foreign object image storage 813 and a foreign object information storage 814.
  • the storage 81 may also include a foreign object video storage 812.
  • the foreign object video storage 812 stores the foreign object video in a manner associated with the trigger number.
  • the foreign object image storage 813 stores the foreign object image in a manner associated with the trigger number.
  • the foreign object information storage 814 stores the trigger number, the foreign object image, and the foreign object information in a manner associated with one another.
  • a method for inspecting a foreign object using the inspection device 70 will now be described with reference to Fig. 14 .
  • An operator places the suction port 33 of the nozzle 30 in contact with the inspection spot 18 (S22).
  • the exhauster 25 starts releasing air and sucking through the suction port 33 (S23).
  • the compressed air feeder 28 feeds compressed air to the nozzle 30.
  • the lance 34 then jets compressed air (S24).
  • the operator inserts the lance 34 into the inspection spot 18 (S25).
  • the high-speed camera 75 takes a video (S26).
  • the extractor 82 extracts a foreign object image from the foreign object video (S27).
  • the counter 83 waits for the moving time (S28).
  • the compressed air feeder 28 stops feeding air (S29).
  • the exhauster 25 stops releasing air and sucking through the suction port 33 (S30).
  • step S22 the operator moves the nozzle 30.
  • the other processing is the same as in step S2.
  • step S23 the operator activates the trigger 71.
  • the exhauster 25 starts releasing air upon receipt of a trigger signal from the trigger 71.
  • the nozzle 30 starts sucking.
  • step S24 the compressed air feeder 28 feeds compressed air to the nozzle 30 after the standby time elapses from when the trigger 71 is activated.
  • the inspection device 70 may also include a second trigger for feeding compressed air.
  • the compressed air feeder 28 feeds compressed air to the nozzle 30 while the second trigger is being activated.
  • step S25 the operator manually moves the nozzle 30 into the inspection spot 18.
  • the other processing is the same as in step S5.
  • step S26 the counter 83 causes the high-speed camera 75 to start taking videos upon receipt of a trigger signal or after the imaging standby time elapses from reception of a trigger signal.
  • the foreign object 51 is sucked from the inspection spot 18, moves through the suction duct 21, and reaches the transparent channel 74.
  • the foreign object 51 moves through the transparent channel 74.
  • the high-speed camera 75 takes a video of the foreign object 51 moving through the transparent channel 74.
  • the foreign object 51 moves together with the airflow through the transparent channel 74 with a thin cross-section while having its wide surface facing the high-speed camera 75.
  • the high-speed camera 75 can thus take a clear video of the foreign object 51.
  • step S27 the extractor 82 extracts the foreign object video using the difference in contrast or in color.
  • the extractor 82 stores the foreign object video into the foreign object video storage 812.
  • the extractor 82 extracts a foreign object image 52 from the foreign object video.
  • the extractor 82 stores the foreign object image 52 into the foreign object image storage 813.
  • the extractor 82 extracts the foreign object information from the foreign object image 52, and stores the foreign object information into the foreign object information storage 814.
  • the foreign object video, the foreign object image, and the foreign object information are stored together with the trigger number.
  • step S28 the counter 83 measures the time from when the trigger signal disappears to when the moving time elapses. After the moving time elapses, the counter 83 causes the high-speed camera 75 to stop taking videos.
  • the controller 80 may generate a warning.
  • the storage 81 stores the extracted foreign object image together with the warning.
  • the counter 83 may electromagnetically lock the trigger 71 to prevent an unintended activation until the moving time elapses.
  • step S29 after the moving time elapses, the compressed air feeder 28 stops compressed air fed to the nozzle 30.
  • step S30 after the moving time elapses, the exhauster 25 stops releasing air.
  • the processing in step S30 may be performed after step S29.
  • the fed compressed air is thus released by the exhauster 25. This operation prevents the foreign object adhering to the workpiece 17 from being removed by compressed air jetted through the orifices 341 when the nozzle 30 is removed from the inspection spot 18.
  • the inspection device 70 ends the inspection after the operator completes the processing in steps S22 to S30 for every inspection spot 18.
  • the output unit 65 outputs the images of the detected foreign objects 51, together with the trigger numbers and the foreign object information.
  • the inspection device 70 may include a stop button.
  • the inspection device 70 ends the inspection when the stop button is pressed.
  • the inspection device 70 may end the inspection when the trigger 71 is activated successively within a short period.
  • the nozzle 30 is manually movable by an operator. This facilitates inspection of a small number of workpieces 17.
  • a manually operable device is particularly useful to measure a foreign object remaining inside a specific inspection spot 18.
  • the inspection device 70 including the high-speed camera 75 can form a clear image of the foreign object 51 moving through the transparent channel 74.
  • the inspection device 70 may include an arm 13, a numerical controller 62, and a coordinate storage 611.
  • the numerical controller 62 controls the entire structure in place of the trigger 71 and the counter 83.
  • the inspection device 90 includes a detector 91 and a controller 99.
  • the other components of the inspection device 90 are the same as those of the inspection device 10.
  • the detector 91 includes a transparent channel 74, and photoelectric sensors 92 and 93.
  • the photoelectric sensor 92 includes a projector 921 and a light receiver 922.
  • the photoelectric sensor 93 includes a projector 931 and a light receiver 932.
  • the projector 921 emits a strip of projection light 94 spread across the width of the transparent channel 74.
  • the projection light 94 is emitted perpendicularly to the direction of the flow of the transparent channel 74 (perpendicularly to the lateral direction in the figures).
  • the projection light 94 is, for example, a laser beam or a pulse modulated light beam.
  • the light receiver 922 receives the projection light 94 transmitted through the transparent channel 74.
  • the light receiver 922 detects a blocked width H, by which the light is blocked by the foreign object 51 moving through the projection light 94.
  • the light receiver 922 detects the blocked width H with a high frequency f.
  • the frequency f is set to allow detection of the moving foreign object 51 multiple times.
  • the frequency f is 16 to 32 kHz.
  • the photoelectric sensor 93 has the same structure and functions as the photoelectric sensor 92.
  • the photoelectric sensors 92 and 93 are arranged parallel with an interval L between them.
  • the two photoelectric sensor sets may be replaced by a single photoelectric sensor set and a velocimeter that measures the velocity of the flow in the transparent channel 74.
  • the velocimeter may be a laser Doppler velocimeter.
  • the controller 99 will now be described with reference to Fig. 16 .
  • the controller 99 includes a data logger 103, an extractor 101, and a storage 105.
  • the storage 105 includes a foreign object information storage 106 and a waveform storage 107.
  • the data logger 103 obtains the blocked width H in the photoelectric sensors 92 and 93 at the frequency f.
  • the obtained waveform is stored into the waveform storage 107.
  • the extractor 101 extracts the waveform of the foreign object 51 that has moved through the detector 91 from the waveforms stored in the waveform storage 107, and calculates the size of the foreign object 51.
  • the calculated size and the waveform of the foreign object 51 are stored into the foreign object information storage 106.
  • Fig. 17 includes a graph 95 showing the amount of blocked light in the photoelectric sensor 92, and a graph 97 showing the amount of blocked light in the photoelectric sensor 93.
  • the graphs 95 and 97 have the horizontal axes indicating the time t, and the vertical axes indicating the blocked width H.
  • the time t is synchronized between the graphs 95 and 97.
  • the graphs 95 and 97 show peaks 95a1 and 95a2, and peaks 95b1 and 95b2 of substantially the same shape.
  • the extractor 101 matches the peaks 95a1 and 95b1 and other peaks in the graph 95 to the corresponding peaks 95a2 and 95b2 and other peaks in the graph 97.
  • the extractor 101 detects matching peaks based on the peak width, the peak height, the peak shape, the order of the peaks, and the difference in detection time between the peaks.
  • the extractor 101 pairs the matching peaks.
  • the extractor 101 may eliminate the unmatching peaks.
  • the difference in detection time between the peaks is a time difference between the paired peaks 95a1 and 95a2.
  • the extractor 101 calculates the length s1 and the area A of a foreign object for the larger one of the two matching peaks.
  • the extractor 101 extracts, as a foreign object for one inspection spot 18, peaks 95a (95a1 or 95a2) and 95b (95b1 or 95b2) and other peaks detected before the moving time elapses from when the arm 13 moves the nozzle 30 to be in contact with the inspection spot 18 and inserts the lance 34.
  • the foreign object information storage 106 stores the calculated foreign object information and the relevant peaks in a manner associated with the inspection spots 18.

Description

    BACKGROUND 1. Technical Field
  • The present invention relates to a foreign object inspection device and a foreign object inspection method for inspecting foreign objects remaining on a workpiece. 2. Description of the Background
  • A known inspection method includes cleaning an inspection target (workpiece) such as a machine component with a cleaning liquid, filtering the liquid used, and observing the residues captured on the filter. A residue measuring apparatus then images the residues on the filter, and subjects the obtained data to image processing (refer to, for example, Japanese Patent Application Publication No. 2011-179987 , or Patent Literature 1). JP2008183546 A discloses a foreign object inspection device with a nozzle, suction channel and a detector installed on the suction channel, the detector being used to correlate the number of foreign objects to the inspection spot. In addition the inspection device comprises a filter for capturing and subsequent visual inspection of the captured foreign objects.
  • BRIEF SUMMARY
  • The technique described in Patent Literature 1 is not intended to detect the position and the shape of foreign objects remaining on a workpiece.
  • One or more aspects of the present invention are directed to a foreign object inspection device and a foreign object inspection method that determine the position and the shape of foreign objects remaining on a workpiece.
  • A first aspect of the present invention provides a foreign object inspection device for inspecting foreign objects at inspection spots of a workpiece according to claim 1.
  • Typical workpieces to be inspected by the inspection device are machine components, including a head cylinder and a block cylinder for an automobile engine, an automobile case transaxle, a housing transaxle, a crankshaft, a construction equipment valve body, an anti-lock brake system (ABS) body, and a brake cylinder.
  • Inspection spots refer to surface portions of a workpiece to be inspected for remaining foreign objects. The inspection spots are determined for each type of workpiece. The inspection spots include, for example, an internal thread, a through-hole, an oil groove hole, a spool hole, and an oil hydraulic circuit surface.
  • The inspection device has its suction port to be placed in contact with each inspection spot. The inspection device sucks through the suction port. Any foreign object at an inspection spot is sucked through the suction channel into a detector. The detector captures the foreign object. The detector detects information (foreign object information) about either the captured or moving foreign object. The foreign object information includes, for example, the length, the width, the area, the height, and an image of a foreign object, or a combination of these. The foreign object information about a foreign object sucked from any inspection spot is obtained individually. The frequency at which foreign objects remain after cleaning, or the shape or the color of the remaining foreign objects is obtained. Information about the spots at which foreign objects remain is useful in improving a cleaning device (e.g., to change the cleaning program or the shape of the nozzles or the jigs). The inspection device may have a permissible amount or size of foreign objects defined for each inspection spot. The inspection device and the inspection method herein enable detailed inspection of the state of foreign objects remaining at each inspection spot.
  • The length of a foreign object is the maximum distance between two points on the outer periphery of the foreign object. The width is the diameter of the largest circle inscribed in the foreign object. The length is evaluated using the maximum diameter of the foreign object. The area is the area of the projected image of the foreign object. The image of the foreign object formed through imaging. Either the length or the width of the foreign object is selectable. The length and the width of the foreign object indicate the substantial size of the foreign object placed on a flat surface. The length and the width, or further the area, may be combined with the height of the foreign object placed on a flat surface measured from the flat surface. Foreign objects mainly include chips. Chips may have an arc or helical shape. Like the width, the height of a foreign object may be its substantial size depending on the shape of the foreign object.
  • The inspection device may include an arm that moves the nozzle relative to a workpiece. The inspection device including the arm can position the nozzle at a spot on the surface of the workpiece at which a foreign object is likely to remain. The inspection device may also include a numerical controller that controls the arm using the coordinates of the suction port. The numerical controller allows an operator referring to a working drawing of the object to easily program the nozzle route.
  • The inspection device may include a trigger in place of the arm. The nozzle includes a grip. An operator holds the grip to place the nozzle onto each inspection spot.
  • The suction channel is flexible. The suction channel is a suction duct. The suction channel may be suspended. The suction channel may extend along the arm. The suction channel may be conductive. The suction channel may be grounded.
  • The foreign object information may be stored using the coordinates of the numerical controller, and thus is associated with the spot at which a foreign object remains. The spot at which a foreign object remains is stored in a manner associated with the foreign object information to later determine the state of the detected foreign object as well as the spot of the workpiece at which the foreign object has been detected. Detailed information about the state of remaining foreign objects is useful in improving cleaning using a cleaning device. The numerical controller can be selected from a variety of controllers that numerically control the orientation and the position of the arm.
  • The inspection device can store the foreign object information in correspondence with an inspection spot number. An inspector can easily obtain information about the state of remaining foreign objects. When the foreign object information corresponds to the inspection spot number, a controller different from the numerical controller may be used to control the arm.
  • The inspection device forms an image of a foreign object sucked from the inspection spot by photographing after waiting for a predetermined moving time. The moving time herein refers to a period of time from when the suction is started to when a foreign object is detected. The moving time is measured by a timer. When a video of a foreign object is to be taken, the inspection device waits for an imaging standby time and may then take a video for a predetermined period to shorten the imaging time. The imaging standby time may be slightly shorter than the moving time taken from when the suction of a foreign object is started to when the foreign object is detected. Shortening the imaging time can reduce the file size of the video, and thus the computational load in the video processing. The same applies to detection of foreign objects using photoelectric sensors.
  • The foreign object sucked into the housing flows through the suction path connection port into a capture chamber. The sucked air flows through the filter and the support, and is released from the suction channel. The sucked foreign object is captured on the filter. The foreign object captured on the filter is imaged by an imaging device through a window. The support is a flat plate. The filter supported on the support extends flatly. The foreign object will reside on the filter in its most natural position. The filter and the window face each other. The imaging device can image the foreign object in the natural position.
  • The imaging device may have a shallow depth of field. For example, the imaging device may have a depth of field of 0.002 to 0.05 mm. The imaging device can combine multiple images formed at different subject distances. The inspection device calculates the height of the foreign object based on the range of the combined subject distances of the resultant composite image.
  • A filter image obtained for each inspection spot is used to extract foreign object images. A matching unit matches a foreign object image contained in a filter image for a target inspection spot to a foreign object image contained in a filter image for an inspection spot immediately preceding the target inspection spot. The matching unit determines the foreign object image unmatching the preceding foreign object image to be a foreign object image of a foreign object remaining on the current inspection spot.
  • A foreign object captured on the filter may move or be reversed on the filter. A filter image is formed for each inspection spot, and foreign object images contained in each filter image are extracted. Of these foreign object images, a newly extracted foreign object image may then be determined to be a foreign object image of a newly detected foreign object at the inspection spot.
  • The foreign object information may be a video. The detector may include a transparent channel included in the suction channel, illuminators that illuminate the transparent channel with a light beam, and a high-speed camera that takes a video of a foreign object moving through the transparent channel. The detector may be combined with any of the above suction devices.
  • In an example not part of the present invention the detector may detect a foreign object moving through the transparent channel. The transparent channel may have a thinly extending rectangular section. The transparent channel may include a housing and an observation window in the housing. The high-speed camera may form an image of the foreign object. The inspection device associates foreign object information detected when a foreign object sucked from an inspection spot is expected to move through the detector with the inspection spot.
  • In an example not part of the present invention the detector may include a photoelectric sensor in place of the high-speed camera. The photoelectric sensor includes a projector that emits light spread across the width of the transparent channel. The photoelectric sensor includes a light receiver that detects the blocked width by which the light is blocked by the foreign object. The detector may include two photoelectric sensors along the flow. The detector may include a photoelectric sensor and a speed sensor for measuring the speed of a foreign object. The foreign object moving through the transparent channel blocks the optical path of the photoelectric sensor. The width of the blocked light is used to detect the width of the foreign object. The time for which the light is blocked and the moving speed of the foreign object are used to detect the length of the foreign object. The photoelectric sensor detects the moving width used by a foreign object to move through the transparent channel or the moving length of the foreign object along the transparent channel.
  • The nozzle may include a suction nose holding the suction port in a manner retractable along the axis of the suction pipe. The nozzle including the suction nose may be combined with either a detector that detects a foreign object captured on the filter or a detector that forms a video of a foreign object moving through the transparent channel. The nozzle may include a lance with a distal end extending along the axis of the suction pipe in the suction pipe. The lance jets compressed air. The lance can be used together with the suction nose. The lance is inserted into an inspection spot. The lance at the inspection spot jets compressed air to blow a foreign object at the inspection spot upward in a reliable manner. The foreign object blown upward is sucked through the suction pipe. The compressed air may be jetted preferably after the suction port is placed in contact with the surface of the inspection spot. The compressed air may be jetted after a predetermined time from when the suction port is placed in contact with the surface of the inspection spot. This can prevent the foreign object from jumping out of the suction pipe.
  • A second aspect of the present invention provides a method for inspecting a foreign object on a workpiece according to claim 11.
  • Storing the foreign object information in a manner associated with the inspection spot includes associating the foreign object information with the number or the coordinates of the inspection spot.
  • The suction port may be first placed near the inspection spot and then pressed against the inspection spot. The suction nozzle may contain a lance. The lance may be inserted into the inspection spot. The lance may be inserted into the inspection spot after the suction nozzle is placed in contact with the inspection spot. The lance may be inserted into the inspection spot at the same time as when the nozzle is pressed against the inspection spot. The lance then jets compressed air into the inspection spot.
  • When an inspection spot is a through-hole, the lance may be placed through the inspection spot. The lance may then jet compressed air from its end opposite to the end inserted into the inspection spot. The compressed air jetted from the lance removes any foreign object adhering in the inspection spot. The jetted compressed air is sucked through the nozzle, together with the foreign object.
  • After the suction port is placed near the inspection spot, the suction port is left unmoved for the moving time. When the suction nozzle includes a lance, the lance may continuously or intermittently jet compressed air during the moving time. After the standby time elapses, the detector detects a foreign object. After the foreign object is detected, the suction port or the lance is removed from the inspection spot. The suction port is then placed near a next inspection spot. The inspection device inspects all inspection spots one by one to obtain foreign object information for each inspection spot.
  • The foreign object inspection device and the foreign object inspection method according to the above aspects of the present invention determine the position and the shape of foreign objects remaining on a workpiece.
  • BRIEF DESCRIPTION OF DRAWINGS
    • Fig. 1 is a schematic diagram of a foreign object inspection device showing its overall structure according to a first embodiment.
    • Fig. 2 is an enlarged sectional view of a nozzle according to the first embodiment.
    • Fig. 3 is an enlarged sectional view of a detector according to the first embodiment.
    • Fig. 4 is an enlarged perspective view of sealing devices according to the first embodiment.
    • Fig. 5 is a block diagram of a foreign object inspection device according to the first embodiment.
    • Fig. 6 is a flowchart of an inspection method according to the first embodiment.
    • Fig. 7 is a perspective view of a workpiece being inspected according to the first embodiment.
    • Fig. 8A is a partial sectional view illustrating a method for using the nozzle according to the first embodiment.
    • Fig. 8B is a partial sectional view illustrating a method for using the nozzle according to the first embodiment.
    • Fig. 9 is a schematic diagram of filter images according to the first embodiment.
    • Fig. 10 is a schematic diagram of foreign object images extracted for inspection spots according to the first embodiment.
    • Fig. 11 is a schematic diagram of a foreign object inspection device showing its overall structure according to a second embodiment.
    • Fig. 12 is an enlarged perspective view of a detector according to the second embodiment.
    • Fig. 13 is a block diagram of a foreign object inspection device according to the second embodiment.
    • Fig. 14 is a flowchart of an inspection method according to the second embodiment.
    • Fig. 15 is an enlarged perspective view of a detector according to an example not part of the present invention.
    • Fig. 16 is a block diagram of a foreign object inspection device according to the example not part of the present invention.
    • Fig. 17 is a graph showing detected waveforms according to the example not part of the present invention.
    DETAILED DESCRIPTION First Embodiment
  • A foreign object inspection device (hereafter simply an inspection device) 10 according to a first embodiment will now be described. The inspection device 10 inspects a foreign object as an inspection target remaining on a workpiece 17. As shown in Fig. 1, the inspection device 10 includes a base 11, an arm 13, a mount 15, a nozzle 30, a suction duct (suction channel) 21, a detector 40, an exhauster 25, and a safety fence 27. The inspection device 10 may also include sealing devices 26.
  • The base 11 is a frame. The base 11 may include a drain pan on its lower surface.
  • The arm 13 is located on the upper surface of the base 11. The arm 13 is a robot, such as a vertically articulated robot, an orthogonal robot, or a parallel link robot. The nozzle 30 is located at the distal end of the arm 13. The arm 13 moves the nozzle 30 to be in contact with inspection spots 18 (collectively for inspection spots 181 to 185 in Fig. 7) of the workpiece (inspection target) 17.
  • The mount 15 is located on the upper surface of the base 11. The mount 15 receives the workpiece 17.
  • The safety fence 27 covers the base 11. The safety fence 27 has a door (not shown) for an inspector to enter.
  • The suction duct (suction channel) 21 connects the nozzle 30 to the detector 40. The suction duct 21 is suspended between the nozzle 30 and a position near the ceiling of the safety fence 27. The suction duct 21 is, for example, a flexible duct hose. The suction duct 21 may be contained in a cable protection pipe. The suction duct 21 may be formed from a conductive material and grounded. A heater may be arranged around the outer peripheral surface of the suction duct 21.
  • The grounded conductive suction duct 21 prevents a foreign object 51 (refer to Figs. 8A and 8B) passing through and sliding along the suction duct 21 from being electrically charged and adhering to the suction duct 21. An external heater heats the suction duct 21 to prevent water contained in sucked air from condensing and adhering to the inner surface of the suction duct 21.
  • The foreign object 51 refers to any substance adhering to and remaining on the workpiece 17, such as chips or lint.
  • The suction duct 21 may extend along the arm 13 instead of being suspended from near the ceiling.
  • The exhauster 25 is a vacuum pump, such as a dry rotary vane vacuum pump, a dry scroll vacuum pump, or an oil rotary vacuum pump. The exhauster 25 may include an exhaust valve 251. When the exhauster 25 is activated and the exhaust valve 251 is open, the exhauster 25 starts sucking the foreign object 51 or other substances through the suction port along the suction duct 21. The exhaust valve 251 eliminates repeated activation and deactivation of the exhauster 25 and thus shortens the cleaning time.
  • The nozzle 30 will now be described with reference to Fig. 2. The nozzle 30 includes a support rod 39, a suction pipe 38, and a suction port 33. The support rod 39 includes a flange 391. The flange 391 is fixed to a mount surface 131 of the arm 13. The support rod 39 supports the suction pipe 38.
  • The nozzle 30 may include a suction nose 32, which is located at the distal end of the suction pipe 38. The suction nose 32 has a suction port 33 at its distal end. The suction nose 32 holds the suction port 33, which is retractable along the axis of the suction pipe 38. Fig. 2 shows the suction nose 32 being contracted in the right half, and being extended in the left half.
  • The suction pipe 38 is hollow and cylindrical. The suction pipe 38 has a suction channel connection port 37 at its basal end. The suction duct 21 is connected to the suction channel connection port 37.
  • The suction port 33 is circular, rectangular, or specifically shaped in conformance to the shape of the inspection spot 18. The suction port 33 is slightly larger than the inspection spot 18. For the inspection spot 18 including an internal thread of the nominal size of M6, for example, the suction port 33 is circular and has an inner diameter (or a diameter) of 7 to 9 mm. The material defining the suction port 33 is selectable from materials soft enough not to damage the workpiece 17 when the suction port 33 touches the workpiece 17. For an aluminum workpiece 17, the material defining the suction port 33 is selectable from conductive plastic and conductive rubber.
  • The suction pipe 38 may include a ring 314 and slide surfaces 311 and 312. The suction pipe 38 includes a ring 314 located at a basal end of the suction pipe spring guide 315 and holding an end of the helical spring 325. The suction pipe 38 includes cylindrical slide surfaces 311 and 312 on the inner peripheral surface of its distal end. The slide surface 312 has a smaller diameter than the slide surface 311, and is located nearer the distal end than the slide surface 311. The slide surface 311 and the slide surface 312 together define a step 313, which functions as a stopper for a guide tube 322.
  • The suction nose 32 includes a guide tube 322, a slide guide 323, a spring guide 324, and an elastic helical spring 325. The guide tube 322 is hollow and cylindrical, and has its outer peripheral surface slidable on the slide surface 312. The slide guide 323 is located at the basal end of the guide tube 322. The suction port 33 is located at the distal end of the guide tube 322. The slide guide 323 has a larger diameter than the guide tube 322. The spring guide 324 is located on the outer surface of the guide tube 322 at its distal end. The spring guide 324 has an outer diameter slightly smaller than the inner diameter of the helical spring 325. The helical spring 325 is supported by the spring guide 324 and the outer surface of the suction pipe 38 at its lower end, and held between the ring 314 and the suction port 33. The helical spring 325 urges the suction nose 32 toward the distal end. The suction nose 32 slides in the suction pipe 38 while the slide guide 323 slides along the slide surface 311 and the guide tube 322 slides along the slide surface 312. The helical spring 325 may be replaced by another elastic member, such as a disc spring, a leaf spring, or a rubber tube.
  • The inspection device 10 further includes a lance 34, a compressed air feeder 28, and an air tube (compressed air feeder tube) 29.
  • The lance 34 is installed in the nozzle 30. The lance 34 is inserted from outside the suction pipe 38 into the suction pipe 38. A distal end of the lance 34 extends in the direction in which the suction port 33 is retractable, or in other words concentrically with the suction pipe 38. When the suction nose 32 is extended, the distal end of the lance 34 is adjacent to the suction port 33. The distal end of the lance 34 is closed. The lance 34 has one or more orifices 341 in the peripheral surface of the distal end. The lance 34 may have multiple orifices 341 radially at circumferentially equal intervals in the peripheral surface of the distal end. The lance 34 may have multiple orifices 341 in its axial direction. For example, the lance 34 may have eight orifices 341, or four arranged in the circumferential direction and two arranged in the axial direction as shown in the figures.
  • When each inspection spot 18 as a main inspection target is a flat surface, the lance 34 may have orifices 341 at its distal end in place of the orifices 341 arranged in the circumferential direction. In this case, the distal end of the lance 34 is located slightly inward from the suction port 33 without protruding outward from the suction port 33 when the suction nose 32 is extended.
  • With reference to Fig. 2, the compressed air feeder 28 may include an air compressor and an air on-off valve.
  • The air tube 29 connects the compressed air feeder 28 to the lance 34. The air tube 29 may be flexible. The air tube 29 may extend along the suction duct 21.
  • The inspection device 10 may include a nozzle exchanger 35 and an electromagnetic valve 36. The nozzle exchanger 35 includes a master cylinder 352 and an adapter 351. The master cylinder 352 is fixed to the support rod 39. The suction duct 21 is connected to the master cylinder 352. The suction pipe 38 is connected to the adapter 351. The adapter 351 may be detachable from the master cylinder 352 to allow mounting of an appropriate nozzle 30 onto the arm 13 in conformance to the shape of the inspection spot 18.
  • The master cylinder 352 includes a body 3520, a main protrusion 3521, a suction channel 3526, an air channel 3527, plungers 3522, a gasket 3523, a sub-protrusion 3524, and a gasket 3525. The body 3520 is cylindrical. The body 3520 has a cylindrical main protrusion 3521 at its center. The main protrusion 3521 has the suction channel 3526 extending through its center. The main protrusion 3521 includes multiple plungers 3522 radially extending in its center portion. The gasket 3523 is located at the outer peripheral surface of the main protrusion 3521. The body 3520 includes the cylindrical sub-protrusion 3524 parallel to the main protrusion 3521 near its peripheral surface. The gasket 3525 is located at the outer peripheral surface of the sub-protrusion 3524. The sub-protrusion 3524 has the air channel 3527 extending through its center. In some embodiments, a suction channel 3514, the suction channel 3526, and the suction pipe 38 have an identical inner diameter, and are coaxial. The air tube 29 is connected to the air channel 3527 with a joint 291.
  • The adapter 351 includes a body 3510, a main recess 3511, a suction channel 3514, a V-groove 3512, a sub-recess 3513, and an air channel 3515. The body 3510 is cylindrical. The body 3510 has the main recess 3511 at its center. The main recess 3511 is a cylindrical blind hole. The main recess 3511 receives the main protrusion 3521 fit in it. The main recess 3511 has the suction channel 3514 extending through its center. The suction channel 3514 is connected to the suction pipe 38. The main recess 3511 has the V-groove 3512 with a V-shaped cross-section in its vertically center portion. The V-groove 3512 extends circumferentially. The body 3510 has the sub-recess 3513 parallel to the main recess 3511 near its peripheral surface. The sub-recess 3513 is a cylindrical blind hole, which is radially smaller than the main recess 3511. The sub-recess 3513 receives the sub-protrusion 3524 fit in it. The sub-recess 3513 has the air channel 3515 extending through its center. The lance 34 is connected to the air channel 3515 with a joint 342.
  • When the adapter 351 is attached to the master cylinder 352, the main protrusion 3521 and the sub-protrusion 3524 are respectively received in the main recess 3511 and the sub-recess 3513, and the plungers 3522 protrude into the V-groove 3512. This fixes the adapter 351 to the master cylinder 352. The suction channel 3514 and the suction channel 3526 are hermetically sealed with the gasket 3523. The air channel 3515 and the air channel 3527 are hermetically sealed with the gasket 3525.
  • The electromagnetic valve 36 is located between the compressed air feeder 28 and the master cylinder 352. The electromagnetic valve 36 is a directional control valve. When the electromagnetic valve 36 is switched to the connection mode, the compressed air fed from the compressed air feeder 28 through the channel (not shown) within the master cylinder 352 pushes the plungers 3522 outward, causing the ends of the plungers 3522 to protrude into the V-groove 3512. This connects the adapter 351 to the master cylinder 352. When the electromagnetic valve 36 is switched to the disconnection mode, the ends of the plungers 3522 are pulled inward by the urging force of a spring (not shown). This disconnects the adapter 351 from the master cylinder 352.
  • When the inspection device 10 does not include the lance 34, the air channel 3515, the air channel 3527, and the gasket 3525 may be eliminated.
  • The detector 40 will now be described with reference to Fig. 3. The detector 40 includes a body (housing) 41, a capture chamber 42, a window 43, a filter 44, a support body (support) 45, a buffer chamber 46, a camera (imaging device) 48, and illuminators 49. The body 41 is rectangular, and includes an upstream body 411 and a downstream body 412.
  • The upstream body 411 has a capture chamber 42 at its center. The capture chamber 42 is cylindrical and hollow. The capture chamber 42 extends through the upstream body 411 from the outer surface into the downstream body 412. The capture chamber 42 has its outer end closed with the window 43. The capture chamber 42 has a filter connection port 421 at its end facing the downstream body 412. The capture chamber 42 has a suction path connection port 473 in its cylindrical surface. A suction channel 471 extends through the upstream body 411 from the outer surface of the upstream body 411 through the suction path connection port 473. The suction duct 21 is connected to the suction channel 471.
  • The downstream body 412 includes a disc-shaped support body 45 at its center. The support body 45 supports the filter 44. The support body 45 allows a gas to flow through. The support body 45 is, for example, a metal mesh, a porous plate, or a honeycomb plate. The filter 44 is held between the support body 45 and the filter connection port 421. The filter 44 and the support body 45 are slightly larger than the filter connection port 421. The filter 44, the support body 45, and the filter connection port 421 are arranged concentrically. A hollow buffer chamber 46 having an opening 461 is located below the support body 45. The buffer chamber 46 is cylindrical. A suction channel 472 is connected to the buffer chamber 46. The suction channel 472 is connected to the exhauster 25. The sucked air flows through the suction channel 471, the capture chamber 42, the filter 44, the support body 45, the buffer chamber 46, and the suction channel 472, and is released. The sucked foreign object moves through the suction channel 471 and the capture chamber 42 and is captured on the filter 44.
  • The camera 48 is used to observe a foreign object 51 captured on the surface of the filter 44 through the window 43 and the capture chamber 42. The camera 48 is, for example, an optical camera. The camera 48 has a lens facing the window 43.
  • The camera 48 can have a shallow depth of field. For example, the camera 48 may have a depth of field of 0.002 to 0.05 mm. The camera 48 may also include a subject distance changer that can automatically change the subject distance. The camera 48 having a shallow depth of field and including a subject distance changer can form filter images 53 at several different subject distances. The camera 48 may include a contrast calculation unit. The camera 48 extracts a focused portion of each of the images formed at different subject distances using the calculated contrast. The camera 48 forms each filter image 53 (refer to Fig. 9) by combining the images formed at different subject distances. An extractor 63 (refer to Fig. 5) calculates the height of the foreign object 51 (refer to Figs. 8A and 8B) based on the focused subject distance.
  • The illuminators 49 illuminate the surface of the filter 44 through the window 43. The illuminators 49 are, for example, spotlights.
  • The sealing devices 26 will now be described with reference to Fig. 4. When an inspection spot 185 is one of the openings of a cross-hole, the sealing devices 26 seal openings 186 and 187 other than the inspection spot 185 to be in contact with the nozzle 30. Each sealing device 26 includes a cylinder 261, a support plate 262, and a sealer 263. The cylinder 261 is a fluid cylinder, such as an air cylinder. The support plate 262 is moved by the cylinder 261. For example, the support plate 262 is fixed to the cylinder rod of the cylinder 261. When the cylinder rod is extended, the sealer 263 is pressed against the workpiece 17. When the cylinder rod is contracted, the sealer 263 separates from the workpiece 17, and moves to its retracted position. The sealers 263 seal the openings 186 and 187. The sealers 263 are, for example, rubber plates or O-rings. Each sealer 263 is supported by the corresponding support plate 262. When the nozzle 30 is in contact with the inspection spot 185, the sealing devices 26 seal the openings 186 and 187 other than the inspection spot 185. After the suction at the inspection spot 185 is complete, the sealing devices 26 retract the sealers 263 to unseal the openings 186 and 187.
  • A controller 60 will now be described with reference to Fig. 5. The controller 60 includes a storage 61, a numerical controller 62, an extractor 63, a matching unit 64, and an output unit 65.
  • The storage 61 includes a main storage (memory) and a sub-storage (storage). The storage 61 includes a coordinate storage 611, a filter image storage 615, a foreign object image storage 614, and a foreign object information storage 613.
  • The coordinate storage 611 includes an inspection coordinate storage 612. The coordinate storage 611 stores, as a numerical control program, coordinates, movement commands, dwells, and tool numbers used for the numerical controller 62 to drive the arm 13. The inspection coordinate storage 612 stores coordinates and movement commands used to place the nozzle 30 in contact with the inspection spot 18. The inspection coordinate storage 612 may store the inspection spot members.
  • The filter image storage 615 stores the filter images 53 (refer to Fig. 9) in a manner associated with the inspection spot numbers or the inspection coordinates. The filter image storage 615 stores multiple filter images 53 formed by the camera 48 at different focal lengths for each inspection spot number or each set of inspection coordinates. The filter image storage 615 may store a composite image by combining focused portions of the filter images 53 together.
  • The foreign object image storage 614 stores foreign object images 52 (collectively for foreign object images 521 to 526 in Fig. 9) for each inspection spot 18. Each foreign object image 52 is an image of the foreign object 51 (refer to Figs. 8A and 8B) extracted from the filter image 53.
  • The foreign object information storage 613 stores individual information about the foreign objects 51 (foreign object information), such as a foreign object image 52, the length, the width, the area, the color, and the height of each foreign object 51 for the inspection spot 18. The length of each foreign object 51 is the maximum distance between two points on the outer periphery. The width of each foreign object 51 is the diameter of the largest inscribed circle. The foreign object information storage 613 stores the inspection spot number or the inspection coordinate and the foreign object image 52 of each foreign object 51 for the inspection spot 18.
  • The numerical controller 62 controls the arm 13 using the coordinates and movement commands stored in the coordinate storage 611. The numerical controller 62 includes a timer. The numerical controller 62 may be selectable from a variety of controllers that control the arm 13 using the coordinates (e.g., controllers that store an intended destination through direct teaching). The numerical controller 62 controls the compressed air feeder 28, the exhauster 25, and the detector 40.
  • The extractor 63 extracts the foreign object images 52 contained in the filter images 53. The extractor 63 extracts the contour of each foreign object image 52 using the difference in color or height between the background and the foreign object 51. The extractor 63 extracts, from each foreign object image 52, information about the corresponding foreign object 51 including the length, the width, the area, the color, or the height of the foreign object 51. The extractor 63 may extract only foreign objects having a length equal to or greater than a specified length. The specified length is input by a user and prestored in the storage 61. The extractor 63 is, for example, a known foreign object extractor (e.g., the measuring device described in Patent Literature 1).
  • The output unit 65 includes a display, such as a liquid crystal monitor. The output unit 65 displays the foreign object images 52 for each inspection spot 18 and information about the foreign object images 52.
  • Referring now to Fig. 9, the matching unit 64 matches foreign object images 523 to 526 extracted from a filter image 533 for the inspection spot number n (n = 3 in Fig. 9) to foreign object images 521 and 522 for the inspection spot number n-1 (n = 2 in Fig. 9). The matching unit 64 extracts the appearance features, calculates rotational, symmetric, and scaling transformation, and determines whether the images match each other. The matching unit 64 matches the foreign object image 521 to the foreign object image 523, and the foreign object image 522 to the foreign object image 526. The matching unit 64 then associates unmatching foreign object images 524 and 525 with the inspection spot number 3 as newly sucked foreign objects.
  • An inspection method will now be described with reference to Fig. 6. The arm 13 moves the suction port 33 to be in contact with a first inspection spot 18 (S2). The exhaust valve 251 is open for the suction port 33 to start sucking (S3). The lance 34 jets compressed air (S4). The lance 34 is inserted into the inspection spot 18 (S5). The foreign object 51 is sucked and captured on the filter 44 (S6). The lance 34 stops jetting the compressed air (S7). The exhaust valve 251 is closed to stop sucking (S8). The camera 48 forms a filter image 53 (S9). The extractor 63 extracts a foreign object image 52 from the filter image 53 (S10). The matching unit 64 matches the foreign object image 52 extracted at the preceding inspection spot to the foreign object image 52 extracted at the current inspection spot. As a result, an image of the foreign object newly extracted at the current inspection spot is stored in a manner associated with the current inspection spot (S11). The extractor 63 extracts the foreign object information from the foreign object image 52 newly extracted at the current inspection spot (S12). The processing in steps S2 to S10 is repeated for each inspection spot (SI, S13, and S14).
  • The steps will be described in detail.
  • For ease of explanation, Fig. 6 shows steps S1, S13, and S14 as simple repeated operations. Through steps S1 to S14, the numerical controller 62 controls the arm 13, the detector 40, and the exhauster 25 in the order specified in the numerical control program stored in the coordinate storage 611. As shown in Fig. 7, the arm 13 moves along a programed route 55 to place the nozzle 30 sequentially in contact with the inspection spots 181 to 185 of the workpiece 17 and to insert the lance 34 into each inspection spot.
  • The processing in steps S2 to S8 will be described with reference to Figs. 8A and 8B. The arm 13 first moves the suction port 33 toward the inspection spot 18 to a position substantially perpendicular to a workpiece surface 171. As shown in Fig. 8A, the suction port 33 is placed in contact with the inspection spot 18 (S2). Subsequently, the numerical controller 62 activates the exhauster 25 and opens the exhaust valve 251 to release air from the inspection spot 18, the suction pipe 38, and the suction duct 21 (S3). Subsequently, the numerical controller 62 causes the compressed air feeder 28 to feed compressed air. The compressed air jets through the orifices 341 after flowing through the nozzle exchanger 35 and the lance 34 (S4).
  • The arm 13 further presses the nozzle 30 against the workpiece 17. The helical spring 325 then contracts, and the suction nose 32 slides into the suction pipe 38. As shown in Fig. 8B, the lance 34 is then inserted into the inspection spot 18 (S5). The suction port 33 is still in contact with the workpiece surface 171. A jet of compressed air jetted through the orifices 341 forms a swirl flow 57 along a screw thread 188. The foreign object 51 adhering to the screw thread 188 is drawn into the swirl flow 57 and sucked through the suction port 33.
  • The lance 34 is inserted to a position slightly above the bottom of the inspection spot 18, and is then raised. After the lance 34 is raised, the suction port 33 is still in contact with the inspection spot 18. The lance 34 may be inserted repeatedly.
  • The nozzle 30 with the suction nose 32 and the lance 34 can have the lance 34 insertable into the inspection spot 18. The swirl flow 57 can thus reach a deep end of the inspection spot 18, removing the foreign object 51 from the inspection spot 18.
  • In step S6, the foreign object 51 inside the inspection spot 18 is sucked through the suction port 33. The sucked foreign object 51 moves through the suction duct 21 and the suction channel 471 into the capture chamber 42, and is captured on the surface of the filter 44. The sucked air flows through the filter 44, the support body 45, the buffer chamber 46, and the suction channel 472, and is released by the exhauster 25.
  • The numerical controller 62 measures the moving time from when the lance 34 is raised. The moving time is the time taken for the sucked foreign object 51 to move until being captured by the filter 44. While the numerical controller 62 waits for the moving time, the exhauster 25 continues to suck through the suction port 33.
  • Subsequently, the numerical controller 62 controls the compressed air feeder 28 to stop feeding compressed air (S7). The numerical controller 62 then closes the exhaust valve 251 (S8). In step S8, the exhauster 25 may be stopped.
  • For the inspection device 10 including the sealing devices 26, the sealing devices 26 seal the openings 186 and 187 before step S2. After step S8, the sealing devices 26 unseal the openings 186 and 187.
  • In step S9, the numerical controller 62 lights the illuminators 49. The numerical controller 62 drives the camera 48. The camera 48 forms an image of the filter 44 through the window 43. The camera 48 stores the obtained filter image 53 into the filter image storage 615.
  • In step S10, the extractor 63 reads the filter image 53 from the filter image storage 615, and extracts foreign object images 523 to 526 from a filter image 532. In this example, the extractor 63 has previously extracted foreign object images 521 and 522. The extracted foreign object images 523 to 526 are stored into the foreign object image storage 614.
  • Step S11 will be described with reference to Fig. 9. The matching unit 64 matches the foreign object images 521 and 522 contained in the previous (n = 2) filter image 532 to the foreign object images 523 to 526 contained in the current (n = 3) filter image 533 in the foreign object image storage 614. After the matching, the matching unit 64 determines the unmatching foreign object images 524 and 525 to be the foreign objects 51 for the inspection spot 183. The foreign object information storage 613 stores the foreign object images 524 and 525 into the foreign object information storage 613 in a manner associated with the inspection spot number or the inspection coordinates.
  • In step S12, the extractor 63 extracts the foreign object information about the foreign objects 51, such as the length of the foreign object images 524 and 525 for the inspection spot 183 (refer to Fig. 7). The foreign object information storage 613 stores the foreign object information together with the foreign object images 524 and 525.
  • As shown in Fig. 10, the output unit 65 outputs, for each inspection spot 18, the foreign object images 52 for the inspection spot 18 and the information about the foreign object images. The numerical values in Fig. 10 represent the length by the width in some examples.
  • The processing in steps S10 to S12 may be performed successively after the suction and the imaging (S2 to S9) are complete for every inspection spot 18. The value Y in the flowchart is the total number of inspection spots 18.
  • The inspection device 10 according to the present embodiment obtains the foreign object images 52 of the foreign objects 51 adhering to the workpiece 17 in a manner associated with the corresponding inspection spots 18. The inspection device 10 can thus determine the position or the shape of each foreign object 51. The inspection device 10 may be used for inspection after cleaning, enabling quantitative evaluation of the cleaning effect for each part of the workpiece.
  • After the foreign object images 52 are extracted from the filter images 53, the inspection device 10 performs matching using the foreign object images 52 contained in the filter images 53 for each inspection spot 18. This allows the inspection device 10 to determine the correct shape or number of the foreign objects 51, although the foreign objects 51 may move or be reversed on the filter 44 during the inspection.
  • The inspection device 10 can store the filter images 53. The inspection device 10 can extract data from the filter images 53 stored in, for example, a storage after the inspection is complete. The inspection device 10 can compare data obtained under different data extraction conditions to improve data reliability.
  • Second Embodiment
  • An inspection device 70 according to a second embodiment will now be described with reference to Figs. 11 to 13. Unlike the inspection device 10 according to the first embodiment, the inspection device 70 according to the present embodiment does not include the arm 13. The present embodiment differs from the first embodiment in the detector and the controller. The inspection device 70 includes a trigger 71, a detector 73, and a controller 80. The detector 73 includes a high-speed camera 75. The nozzle 30 may include a grip 72. The other components in the present embodiments are the same as those of the inspection device 10.
  • The trigger 71 is, for example, a foot switch or a trigger attached to the nozzle 30. When activated, the trigger 71 generates a trigger signal.
  • The detector 73 will now be described with reference to Fig. 12. The detector 73 includes a transparent channel 74, the high-speed camera 75, and illuminators 49. The transparent channel 74 is formed from a transparent material such as polycarbonate, acrylic resin, tempered glass, or sapphire glass. The transparent channel 74 is a thin channel having a rectangular cross-section. The transparent channel 74 having a thin cross-section is likely to have a uniform flow inside and to have any foreign objects 51 moving at a constant speed through the transparent channel 74. The transparent channel 74 may include a hard film inside. The high-speed camera 75 is oriented perpendicularly to the direction in which the transparent channel 74 extends. For the transparent channel 74 having a thin cross-section, the high-speed camera 75 has the lens oriented toward the thinner side of the cross-section. The high-speed camera 75 may preferably have an imaging speed of 4,000 to 10,000 fps for high-speed transfer. The high-speed camera 75 preferably includes a close-up lens to form images of foreign objects with a size of 0.1 to 0.5 mm. The high-speed camera 75 is controlled by a counter 83.
  • The transparent channel 74 may include an observation window, which is formed from a transparent material, and a housing, which is formed from an opaque material, to which the observation window is attached. The transparent channel 74 with the above structure may have the observation window made of tempered glass or sapphire glass, and the other parts made of metal. The transparent channel 74 with this structure is less costly and has intended strength.
  • The inspection device 70 may eliminate the nozzle exchanger 35 (refer to Fig. 11). The nozzle exchanger 35 is manually detachable.
  • The controller 80 will now be described with reference to Fig. 13. The controller 80 includes a counter 83, a storage 81, and an extractor 82.
  • The counter 83 counts signals from the trigger 71. The counter 83 serves as a timer. The counter 83 measures the imaging standby time from when the trigger 71 is activated. The imaging standby time corresponds to the time taken for the foreign object 51 sucked from the nozzle 30 to arrive at the detector 73. The imaging standby time may be set to about 0.5 to 1 second shorter than the moving time taken from when suction of the foreign object 51 is started to when the foreign object 51 is detected. The counter 83 also measures the moving time from when the trigger 71 is deactivated. The counter 83 counts the trigger number, which is the number of times the trigger 71 is activated. The counter 83 transmits the trigger number to the storage 81. The counter 83 measures the standby time upon receipt of the trigger signal. Upon elapse of the standby time, the counter 83 causes the compressed air feeder 28 to feed compressed air to the nozzle 30. The standby time is preset in the counter 83. The standby time is, for example, 1 to 5 seconds.
  • The extractor 82 extracts foreign object videos containing the foreign objects 51 from the entire video taken by the high-speed camera 75. The extractor 82 extracts, from the entire video or from the foreign object videos, a frame containing the clearest entire image of the foreign object 51 as a foreign object image.
  • The extractor 82 extracts the contour of the foreign object 51 using, for example, the difference between the background color and the color of the foreign object 51. The background color and the color of the foreign object 51 are the lightness for a monochrome camera used as the high-speed camera 75. The extractor 82 extracts, from the foreign object images 52 for example, foreign object information about the foreign object 51 such as the length, the width, the area, the color, and the height of the foreign object 51. The extractor 82 may extract only foreign objects having a length greater than or equal to a specified length. The specified length is input by a user in advance, and is stored in the storage 81.
  • The storage 81 includes a foreign object image storage 813 and a foreign object information storage 814. The storage 81 may also include a foreign object video storage 812. The foreign object video storage 812 stores the foreign object video in a manner associated with the trigger number. The foreign object image storage 813 stores the foreign object image in a manner associated with the trigger number. The foreign object information storage 814 stores the trigger number, the foreign object image, and the foreign object information in a manner associated with one another.
  • A method for inspecting a foreign object using the inspection device 70 will now be described with reference to Fig. 14. An operator places the suction port 33 of the nozzle 30 in contact with the inspection spot 18 (S22). When the operator activates the trigger 71, the exhauster 25 starts releasing air and sucking through the suction port 33 (S23). The compressed air feeder 28 feeds compressed air to the nozzle 30. The lance 34 then jets compressed air (S24). The operator inserts the lance 34 into the inspection spot 18 (S25). The high-speed camera 75 takes a video (S26). The extractor 82 extracts a foreign object image from the foreign object video (S27). The counter 83 waits for the moving time (S28). The compressed air feeder 28 stops feeding air (S29). The exhauster 25 stops releasing air and sucking through the suction port 33 (S30).
  • In step S22, the operator moves the nozzle 30. The other processing is the same as in step S2.
  • In step S23, the operator activates the trigger 71. The exhauster 25 starts releasing air upon receipt of a trigger signal from the trigger 71. The nozzle 30 starts sucking.
  • In step S24, the compressed air feeder 28 feeds compressed air to the nozzle 30 after the standby time elapses from when the trigger 71 is activated.
  • The inspection device 70 may also include a second trigger for feeding compressed air. The compressed air feeder 28 feeds compressed air to the nozzle 30 while the second trigger is being activated.
  • In step S25, the operator manually moves the nozzle 30 into the inspection spot 18. The other processing is the same as in step S5.
  • In step S26, the counter 83 causes the high-speed camera 75 to start taking videos upon receipt of a trigger signal or after the imaging standby time elapses from reception of a trigger signal. The foreign object 51 is sucked from the inspection spot 18, moves through the suction duct 21, and reaches the transparent channel 74. The foreign object 51 moves through the transparent channel 74. The high-speed camera 75 takes a video of the foreign object 51 moving through the transparent channel 74. The foreign object 51 moves together with the airflow through the transparent channel 74 with a thin cross-section while having its wide surface facing the high-speed camera 75. The high-speed camera 75 can thus take a clear video of the foreign object 51.
  • In step S27, the extractor 82 extracts the foreign object video using the difference in contrast or in color. The extractor 82 stores the foreign object video into the foreign object video storage 812. The extractor 82 extracts a foreign object image 52 from the foreign object video. The extractor 82 stores the foreign object image 52 into the foreign object image storage 813. The extractor 82 extracts the foreign object information from the foreign object image 52, and stores the foreign object information into the foreign object information storage 814. The foreign object video, the foreign object image, and the foreign object information are stored together with the trigger number.
  • In step S28, the counter 83 measures the time from when the trigger signal disappears to when the moving time elapses. After the moving time elapses, the counter 83 causes the high-speed camera 75 to stop taking videos.
  • When the trigger 71 is activated again before the moving time elapses, the controller 80 may generate a warning. The storage 81 stores the extracted foreign object image together with the warning.
  • In some embodiments, the counter 83 may electromagnetically lock the trigger 71 to prevent an unintended activation until the moving time elapses.
  • In step S29, after the moving time elapses, the compressed air feeder 28 stops compressed air fed to the nozzle 30.
  • In step S30, after the moving time elapses, the exhauster 25 stops releasing air. The processing in step S30 may be performed after step S29. The fed compressed air is thus released by the exhauster 25. This operation prevents the foreign object adhering to the workpiece 17 from being removed by compressed air jetted through the orifices 341 when the nozzle 30 is removed from the inspection spot 18.
  • The inspection device 70 ends the inspection after the operator completes the processing in steps S22 to S30 for every inspection spot 18. The output unit 65 outputs the images of the detected foreign objects 51, together with the trigger numbers and the foreign object information.
  • The inspection device 70 may include a stop button. The inspection device 70 ends the inspection when the stop button is pressed. In some embodiments, the inspection device 70 may end the inspection when the trigger 71 is activated successively within a short period.
  • In the present embodiment, the nozzle 30 is manually movable by an operator. This facilitates inspection of a small number of workpieces 17. A manually operable device is particularly useful to measure a foreign object remaining inside a specific inspection spot 18.
  • The inspection device 70 including the high-speed camera 75 can form a clear image of the foreign object 51 moving through the transparent channel 74.
  • The inspection device 70 may include an arm 13, a numerical controller 62, and a coordinate storage 611. The numerical controller 62 controls the entire structure in place of the trigger 71 and the counter 83.
  • Example not part of the present invention.
  • An inspection device 90 according to a example not part of the present invention will now be described with reference to Figs. 15 to 17. The example differs from the first embodiment in the detector and the controller. The inspection device 90 includes a detector 91 and a controller 99. The other components of the inspection device 90 are the same as those of the inspection device 10.
  • The detector 91 will now be described with reference to Fig. 15. The detector 91 includes a transparent channel 74, and photoelectric sensors 92 and 93. The photoelectric sensor 92 includes a projector 921 and a light receiver 922. The photoelectric sensor 93 includes a projector 931 and a light receiver 932. The projector 921 emits a strip of projection light 94 spread across the width of the transparent channel 74. The projection light 94 is emitted perpendicularly to the direction of the flow of the transparent channel 74 (perpendicularly to the lateral direction in the figures). The projection light 94 is, for example, a laser beam or a pulse modulated light beam. The light receiver 922 receives the projection light 94 transmitted through the transparent channel 74. The light receiver 922 detects a blocked width H, by which the light is blocked by the foreign object 51 moving through the projection light 94. The light receiver 922 detects the blocked width H with a high frequency f. The frequency f is set to allow detection of the moving foreign object 51 multiple times. For example, the frequency f is 16 to 32 kHz. The photoelectric sensor 93 has the same structure and functions as the photoelectric sensor 92. The photoelectric sensors 92 and 93 are arranged parallel with an interval L between them.
  • The two photoelectric sensor sets may be replaced by a single photoelectric sensor set and a velocimeter that measures the velocity of the flow in the transparent channel 74. The velocimeter may be a laser Doppler velocimeter.
  • The controller 99 will now be described with reference to Fig. 16. The controller 99 includes a data logger 103, an extractor 101, and a storage 105. The storage 105 includes a foreign object information storage 106 and a waveform storage 107.
  • The data logger 103 obtains the blocked width H in the photoelectric sensors 92 and 93 at the frequency f. The obtained waveform is stored into the waveform storage 107.
  • The extractor 101 extracts the waveform of the foreign object 51 that has moved through the detector 91 from the waveforms stored in the waveform storage 107, and calculates the size of the foreign object 51. The calculated size and the waveform of the foreign object 51 are stored into the foreign object information storage 106.
  • The function of the extractor 101 will be described with reference to Fig. 17. Fig. 17 includes a graph 95 showing the amount of blocked light in the photoelectric sensor 92, and a graph 97 showing the amount of blocked light in the photoelectric sensor 93. The graphs 95 and 97 have the horizontal axes indicating the time t, and the vertical axes indicating the blocked width H. The time t is synchronized between the graphs 95 and 97. The graphs 95 and 97 show peaks 95a1 and 95a2, and peaks 95b1 and 95b2 of substantially the same shape. The extractor 101 matches the peaks 95a1 and 95b1 and other peaks in the graph 95 to the corresponding peaks 95a2 and 95b2 and other peaks in the graph 97. The extractor 101 detects matching peaks based on the peak width, the peak height, the peak shape, the order of the peaks, and the difference in detection time between the peaks. The extractor 101 pairs the matching peaks. The extractor 101 may eliminate the unmatching peaks. The difference in detection time between the peaks is a time difference between the paired peaks 95a1 and 95a2.
    The following formula holds: s 1 = ns = n V f = nL Δ tf A = sH = LH Δ tf
    Figure imgb0001
  • In the formula,
    • Δt indicates the difference in detection start between paired peaks,
    • A indicates the area of the foreign object 51,
    • s indicates the foreign object length in the flow direction to obtain one set of data,
    • V indicates the speed at which the foreign object 51 moves,
    • f indicates the frequency at which data is obtained,
    • H indicates the blocked width for each data set,
    • L indicates the interval between the photoelectric sensors 92 and 93,
    • n indicates the number of data sets contained in each peak, and
    • s1 indicates the length of the foreign object 51.
  • For a pair of extracted peaks with different sizes detected by the photoelectric sensors 92 and 93, the extractor 101 calculates the length s1 and the area A of a foreign object for the larger one of the two matching peaks.
  • The extractor 101 extracts, as a foreign object for one inspection spot 18, peaks 95a (95a1 or 95a2) and 95b (95b1 or 95b2) and other peaks detected before the moving time elapses from when the arm 13 moves the nozzle 30 to be in contact with the inspection spot 18 and inserts the lance 34. The foreign object information storage 106 stores the calculated foreign object information and the relevant peaks in a manner associated with the inspection spots 18.
  • Reference Signs List
  • 10, 70, 90
    foreign object inspection device
    13
    arm
    17
    workpiece (inspection target)
    18, 181, 182, 185
    inspection spot
    21
    suction duct (suction channel)
    25
    exhauster
    28
    compressed air feeder
    30
    nozzle
    32
    suction nose
    33
    suction port
    34
    lance
    40, 73, 91
    detector
    42
    capture chamber
    44
    filter
    45
    support body (support)
    51
    foreign object
    52
    foreign object image
    53
    filter image
    60, 80, 99
    controller
    61, 81, 105
    storage
    62
    numerical controller
    74
    transparent channel
    75
    high-speed camera
    92, 93
    photoelectric sensor

Claims (12)

  1. A foreign object inspection device for inspecting foreign objects at inspection spots of a workpiece (17), the device comprising:
    a nozzle (30) including a suction port (33) configured to suck a foreign object;
    an exhauster (25);
    a suction channel (21) connecting the nozzle (30) to the exhauster (25);
    a detector (40, 73, 91) installed on the suction channel (21), and configured to detect foreign object information about a shape of the foreign object sucked through the suction port (33); and
    a controller (60, 80, 99) including a storage (61, 81, 105) configured to store the foreign object information in a manner associated with an inspection spot;
    wherein
    the detector (40, 73, 91) includes
    a housing (41) containing a cylindrical capture chamber (42),
    a suction path connection port (473) in a side surface of the capture chamber (42), the suction path connection port (473) connecting to the suction channel (21),
    a filter (44) configured to capture a foreign object entering the capture chamber (42),
    a support (45) supporting the filter (44), and configured to allow a gas to flow through the support,
    a window (43) in the capture chamber, and
    an imaging device (48) configured to form an image of the foreign object captured on the filter (44), and
    the storage (61) includes
    a filter image storage (615) configured to store a filter image for each inspection spot, and
    a foreign object image storage (614) configured to store a foreign object image, and the controller (60) includes
    an extractor (63) configured to extract the foreign object image from the filter image, and
    a matching unit (64) configured to match a foreign object image extracted from a filter image for a target inspection spot to a foreign object image extracted from a filter image for an inspection spot preceding the target inspection spot, and determine an unmatching foreign object image as a foreign object image for the target inspection spot.
  2. The foreign object inspection device according to claim 1, wherein
    the foreign object information includes at least one selected from the group consisting of a length, an area, and an image of the foreign object.
  3. The foreign object inspection device according to claim 1 or claim 2, further comprising:
    an arm (13) configured to move the nozzle (30) relative to the workpiece (17).
  4. The foreign object inspection device according to claim 3, further comprising:
    a numerical controller (62) configured to control the arm (13) using coordinates of the suction port (33).
  5. The foreign object inspection device according to any one of claims 1 to 4, wherein the storage (61, 81, 105) stores the foreign object information in correspondence with the coordinates.
  6. The foreign object inspection device according to any one of claims 1 to 5, wherein the storage (61, 81, 105) stores an inspection spot number for the inspection spot and stores the foreign object information in correspondence with the inspection spot number.
  7. The foreign object inspection device according to any one of claims 1 to 6, wherein the controller (60, 80, 99) includes a timer (83) configured to measure a moving time from when suction is started to when a foreign object is detected.
  8. The foreign object inspection device according to any one of claims 1 to 7, wherein the storage (61, 81, 105) stores the foreign object information detected from when the suction is started to when the moving time elapses in a manner associated with the inspection spot.
  9. The foreign object inspection device according to any one of claims 1 to 8, wherein the nozzle (30) includes
    a suction pipe (38) including the suction port (33) at a distal end thereof, and
    a suction nose (32) located at the distal end of the suction pipe (38) to hold the suction port (33) in a manner retractable along an axis of the suction pipe (38).
  10. The foreign object inspection device according to any one of claims 1 to 9, further comprising:
    a compressed air feeder (28),
    wherein the nozzle (30) includes a lance (34) having a distal end extending along the axis of the suction pipe (38) inside the suction pipe (38), and the lance has an orifice (341).
  11. A method for inspecting a foreign object on a workpiece, comprising:
    placing a suction port (33) in contact with an inspection spot (18) of a workpiece;
    sucking a foreign object through the suction port (33);
    detecting foreign object information about a shape of the foreign object;
    storing the foreign object information in a manner associated with the inspection spot (18);
    capturing the foreign object by a filter (44), the method being characterised in that it further comprises:
    forming an image of the foreign object captured on the filter (44);
    storing a filter image for each inspection spot;
    extracting a foreign object image from the filter image;
    matching, by a matching unit, a foreign object image extracted from a filter image for a target inspection spot to a foreign object image extracted from a filter image for an inspection spot preceding the target inspection spot; and
    determining, by said matching unit, an unmatching foreign object image as a foreign object image for the target inspection spot.
  12. The foreign object inspection method according to claim 11, further comprising:
    inserting a lance (34) installed in the nozzle (30) into the inspection spot (18); and
    jetting compressed air through an orifice (341) of the lance (34) to the inspection spot (18).
EP18185400.1A 2017-09-19 2018-07-25 Foreign object inspection device and foreign object inspection method Active EP3457113B1 (en)

Applications Claiming Priority (1)

Application Number Priority Date Filing Date Title
JP2017178570A JP6688268B2 (en) 2017-09-19 2017-09-19 Foreign substance inspection device and foreign substance inspection method

Publications (2)

Publication Number Publication Date
EP3457113A1 EP3457113A1 (en) 2019-03-20
EP3457113B1 true EP3457113B1 (en) 2020-10-14

Family

ID=63173928

Family Applications (1)

Application Number Title Priority Date Filing Date
EP18185400.1A Active EP3457113B1 (en) 2017-09-19 2018-07-25 Foreign object inspection device and foreign object inspection method

Country Status (4)

Country Link
US (1) US10974290B2 (en)
EP (1) EP3457113B1 (en)
JP (1) JP6688268B2 (en)
CN (1) CN109521493B (en)

Families Citing this family (5)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
IT201900003401A1 (en) * 2019-03-08 2020-09-08 Fare S R L Machine for cleaning furnace regeneration chambers, particularly for the production of glass articles.
DE102019207568B4 (en) * 2019-05-23 2021-09-23 Adolf Würth GmbH & Co. KG Wellbore cleaning apparatus, method and arrangement
CN113305098B (en) * 2021-05-25 2022-11-29 云南电网有限责任公司电力科学研究院 Detection and removal device for scale sample of voltage-sharing electrode and use method
CN114653558B (en) * 2022-05-25 2022-08-02 苏州柳溪机电工程有限公司 Water blowing system for coating production line
CN115235344B (en) * 2022-06-06 2023-08-01 苏州天准科技股份有限公司 Vortex beam-based measurement system and height measurement method

Citations (1)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
JP2008183546A (en) * 2007-01-31 2008-08-14 Aisin Aw Co Ltd Device for sensing and collecting foreign material

Family Cites Families (21)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
DE2948006A1 (en) * 1979-11-29 1981-06-04 Jürgen 4477 Welver Volkmann METHOD AND DEVICE FOR REMOVING SOLID OR LIQUID RESIDUES FROM CAVITIES LIKE HOLES OR THE LIKE.
JPH08181096A (en) * 1994-12-27 1996-07-12 Yokogawa Electric Corp Particle sampler
JP2000321180A (en) * 1999-05-12 2000-11-24 Nec Kyushu Ltd Surface contamination measuring instrument of equipment
JP2007304065A (en) 2006-05-15 2007-11-22 Omron Corp Foreign substance detector, foreign substance detecting method, foreign substance detecting program, and recording medium with the program stored
KR101529735B1 (en) * 2008-03-21 2015-06-17 노미 보사이 가부시키가이샤 Smoke sensing device
DE102008031199A1 (en) * 2008-07-03 2010-01-07 TRüTZSCHLER GMBH & CO. KG Foreign particles e.g. package thread, detecting and separating device for use during e.g. spinning mill process, has illumination device and camera differentiating radiographed and illuminated foreign particles from fiber materials
JP5727709B2 (en) 2010-03-01 2015-06-03 株式会社スギノマシン Residue measuring method and residue measuring apparatus
WO2013077282A1 (en) * 2011-11-25 2013-05-30 シャープ株式会社 Inspection method for liquid-crystal display panel
US9176028B2 (en) * 2012-10-04 2015-11-03 Ut-Battelle, Llc Ball assisted device for analytical surface sampling
JP6028919B2 (en) * 2013-01-29 2016-11-24 富士電機株式会社 Foreign matter inspection device
US9393657B2 (en) * 2013-02-22 2016-07-19 Hadley H. Caneer Debris evacuator for cleaning a masonry bore
KR101590831B1 (en) * 2013-04-02 2016-02-03 주식회사 고영테크놀러지 Method of inspecting foreign substance on a board
JP6122758B2 (en) 2013-10-18 2017-04-26 株式会社スギノマシン Adhering material for residue confirmation, and method for confirming residue remaining on cleaning object after cleaning using the same
JP2016042233A (en) * 2014-08-14 2016-03-31 日本電信電話株式会社 Flow rate measuring system for cool air from porous opening type double floor panels
DE102015106777B4 (en) 2015-04-30 2016-11-17 Marianne Zippel Method and inspection system for determining and checking the surface cleanliness of industrially cleaned workpieces or machine components
JP2017032332A (en) * 2015-07-30 2017-02-09 三共空調株式会社 Dust removal device
EP3347711B1 (en) * 2015-09-07 2023-11-01 Max-Planck-Gesellschaft zur Förderung der Wissenschaften e.V. Method and apparatus for detecting particles, like biological macromolecules or nanoparticles
CN205300515U (en) * 2015-12-01 2016-06-08 海太半导体(无锡)有限公司 Foreign matter detection device
WO2017143332A1 (en) * 2016-02-18 2017-08-24 Optofluidics, Inc. System and method for characterizing particulates in a fluid sample
DE102016203666A1 (en) 2016-03-07 2016-04-21 Carl Zeiss Smt Gmbh DEVICE AND METHOD FOR ANALYZING THE CONTAMINATION STATE OF A SURFACE
CN206366514U (en) * 2016-12-05 2017-08-01 深圳市立德通讯器材有限公司 A kind of equipment for detecting foreign matter

Patent Citations (1)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
JP2008183546A (en) * 2007-01-31 2008-08-14 Aisin Aw Co Ltd Device for sensing and collecting foreign material

Also Published As

Publication number Publication date
JP6688268B2 (en) 2020-04-28
CN109521493B (en) 2020-12-01
US20190084013A1 (en) 2019-03-21
EP3457113A1 (en) 2019-03-20
US10974290B2 (en) 2021-04-13
CN109521493A (en) 2019-03-26
JP2019052988A (en) 2019-04-04

Similar Documents

Publication Publication Date Title
EP3457113B1 (en) Foreign object inspection device and foreign object inspection method
EP3242767B1 (en) Synchronized image capture for welding machine vision
CN106607713B (en) Tool cleaning device for machine tool
US11858011B2 (en) Device, cleaning system, and method of determining whether or not to clean work area of machine tool
US20210138660A1 (en) Cleaning system and method for cleaning work area of machine tool
US20200376524A1 (en) Cleaning apparatus and cleaning method
JP2010196189A (en) Apparatus for examining spinneret with function for removing foreign matter in hole
CN103383468B (en) The detection system of sealed plastic box coating apparatus and detection method, sealed plastic box coating machine
JP6432690B2 (en) Infusion device
BR112021004773A2 (en) device for carrying out an analysis of a mass product, assembly for processing mass products and method for a non-contact analysis of a mass product
KR101672807B1 (en) a tool inspection device and the method of automatic tool changer
US10162189B2 (en) Device, system and method for the visual alignment of a pipettor tip and a reference point marker
CN207894844U (en) A kind of bearing device inside non-destructive testing imaging device
JP2005227103A (en) Dispenser
JP6007160B2 (en) Hole inspection method and apparatus
JP2001215164A (en) Apparatus utilizing misty water drop for detecting vacuum/gas leakage
CN220690814U (en) Detection device
JP2015120109A (en) Discharge break detection device for adhesive agent
KR102209408B1 (en) Automatic extinguishing apparatus and method
KR20030074829A (en) Size measuring method and device
JPH09196958A (en) Flow direction/rate meter
JPH11318783A (en) Device and method for recovering micro foreign matter in body
CN108426889A (en) Non-destructive testing imaging device and its working method inside a kind of bearing device
JPH0451768B2 (en)
JPH07222721A (en) Non-contact type ophthalmotonometer

Legal Events

Date Code Title Description
PUAI Public reference made under article 153(3) epc to a published international application that has entered the european phase

Free format text: ORIGINAL CODE: 0009012

STAA Information on the status of an ep patent application or granted ep patent

Free format text: STATUS: REQUEST FOR EXAMINATION WAS MADE

17P Request for examination filed

Effective date: 20180725

AK Designated contracting states

Kind code of ref document: A1

Designated state(s): AL AT BE BG CH CY CZ DE DK EE ES FI FR GB GR HR HU IE IS IT LI LT LU LV MC MK MT NL NO PL PT RO RS SE SI SK SM TR

AX Request for extension of the european patent

Extension state: BA ME

RIC1 Information provided on ipc code assigned before grant

Ipc: G01N 21/94 20060101ALI20200513BHEP

Ipc: B08B 5/02 20060101ALI20200513BHEP

Ipc: G01N 15/00 20060101ALN20200513BHEP

Ipc: B08B 9/02 20060101ALI20200513BHEP

Ipc: G01N 15/06 20060101ALI20200513BHEP

Ipc: B08B 5/04 20060101ALI20200513BHEP

Ipc: G01N 1/02 20060101ALN20200513BHEP

Ipc: G01N 15/14 20060101AFI20200513BHEP

GRAP Despatch of communication of intention to grant a patent

Free format text: ORIGINAL CODE: EPIDOSNIGR1

STAA Information on the status of an ep patent application or granted ep patent

Free format text: STATUS: GRANT OF PATENT IS INTENDED

INTG Intention to grant announced

Effective date: 20200624

GRAS Grant fee paid

Free format text: ORIGINAL CODE: EPIDOSNIGR3

GRAA (expected) grant

Free format text: ORIGINAL CODE: 0009210

STAA Information on the status of an ep patent application or granted ep patent

Free format text: STATUS: THE PATENT HAS BEEN GRANTED

AK Designated contracting states

Kind code of ref document: B1

Designated state(s): AL AT BE BG CH CY CZ DE DK EE ES FI FR GB GR HR HU IE IS IT LI LT LU LV MC MK MT NL NO PL PT RO RS SE SI SK SM TR

REG Reference to a national code

Ref country code: GB

Ref legal event code: FG4D

REG Reference to a national code

Ref country code: AT

Ref legal event code: REF

Ref document number: 1324050

Country of ref document: AT

Kind code of ref document: T

Effective date: 20201015

Ref country code: CH

Ref legal event code: EP

REG Reference to a national code

Ref country code: DE

Ref legal event code: R096

Ref document number: 602018008654

Country of ref document: DE

REG Reference to a national code

Ref country code: IE

Ref legal event code: FG4D

REG Reference to a national code

Ref country code: AT

Ref legal event code: MK05

Ref document number: 1324050

Country of ref document: AT

Kind code of ref document: T

Effective date: 20201014

REG Reference to a national code

Ref country code: NL

Ref legal event code: MP

Effective date: 20201014

PG25 Lapsed in a contracting state [announced via postgrant information from national office to epo]

Ref country code: NO

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20210114

Ref country code: GR

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20210115

Ref country code: FI

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20201014

Ref country code: PT

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20210215

Ref country code: RS

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20201014

REG Reference to a national code

Ref country code: LT

Ref legal event code: MG4D

PG25 Lapsed in a contracting state [announced via postgrant information from national office to epo]

Ref country code: ES

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20201014

Ref country code: AT

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20201014

Ref country code: SE

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20201014

Ref country code: PL

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20201014

Ref country code: LV

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20201014

Ref country code: IS

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20210214

Ref country code: BG

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20210114

PG25 Lapsed in a contracting state [announced via postgrant information from national office to epo]

Ref country code: HR

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20201014

Ref country code: NL

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20201014

REG Reference to a national code

Ref country code: DE

Ref legal event code: R097

Ref document number: 602018008654

Country of ref document: DE

PG25 Lapsed in a contracting state [announced via postgrant information from national office to epo]

Ref country code: SK

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20201014

Ref country code: RO

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20201014

Ref country code: LT

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20201014

Ref country code: CZ

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20201014

Ref country code: EE

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20201014

Ref country code: SM

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20201014

PLBE No opposition filed within time limit

Free format text: ORIGINAL CODE: 0009261

STAA Information on the status of an ep patent application or granted ep patent

Free format text: STATUS: NO OPPOSITION FILED WITHIN TIME LIMIT

PG25 Lapsed in a contracting state [announced via postgrant information from national office to epo]

Ref country code: DK

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20201014

26N No opposition filed

Effective date: 20210715

PG25 Lapsed in a contracting state [announced via postgrant information from national office to epo]

Ref country code: AL

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20201014

PG25 Lapsed in a contracting state [announced via postgrant information from national office to epo]

Ref country code: SI

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20201014

REG Reference to a national code

Ref country code: CH

Ref legal event code: PL

PG25 Lapsed in a contracting state [announced via postgrant information from national office to epo]

Ref country code: MC

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20201014

REG Reference to a national code

Ref country code: BE

Ref legal event code: MM

Effective date: 20210731

PG25 Lapsed in a contracting state [announced via postgrant information from national office to epo]

Ref country code: LI

Free format text: LAPSE BECAUSE OF NON-PAYMENT OF DUE FEES

Effective date: 20210731

Ref country code: CH

Free format text: LAPSE BECAUSE OF NON-PAYMENT OF DUE FEES

Effective date: 20210731

PG25 Lapsed in a contracting state [announced via postgrant information from national office to epo]

Ref country code: IS

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20210214

Ref country code: LU

Free format text: LAPSE BECAUSE OF NON-PAYMENT OF DUE FEES

Effective date: 20210725

PG25 Lapsed in a contracting state [announced via postgrant information from national office to epo]

Ref country code: IE

Free format text: LAPSE BECAUSE OF NON-PAYMENT OF DUE FEES

Effective date: 20210725

Ref country code: BE

Free format text: LAPSE BECAUSE OF NON-PAYMENT OF DUE FEES

Effective date: 20210731

GBPC Gb: european patent ceased through non-payment of renewal fee

Effective date: 20220725

PG25 Lapsed in a contracting state [announced via postgrant information from national office to epo]

Ref country code: GB

Free format text: LAPSE BECAUSE OF NON-PAYMENT OF DUE FEES

Effective date: 20220725

PG25 Lapsed in a contracting state [announced via postgrant information from national office to epo]

Ref country code: CY

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20201014

PG25 Lapsed in a contracting state [announced via postgrant information from national office to epo]

Ref country code: HU

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT; INVALID AB INITIO

Effective date: 20180725

PGFP Annual fee paid to national office [announced via postgrant information from national office to epo]

Ref country code: IT

Payment date: 20230724

Year of fee payment: 6

PGFP Annual fee paid to national office [announced via postgrant information from national office to epo]

Ref country code: FR

Payment date: 20230726

Year of fee payment: 6

Ref country code: DE

Payment date: 20230719

Year of fee payment: 6