CA2090936C - Visual inspection support system for printed-circuit board - Google Patents
Visual inspection support system for printed-circuit boardInfo
- Publication number
- CA2090936C CA2090936C CA 2090936 CA2090936A CA2090936C CA 2090936 C CA2090936 C CA 2090936C CA 2090936 CA2090936 CA 2090936 CA 2090936 A CA2090936 A CA 2090936A CA 2090936 C CA2090936 C CA 2090936C
- Authority
- CA
- Canada
- Prior art keywords
- drive
- camera
- display
- control unit
- real
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Expired - Fee Related
Links
Classifications
-
- G—PHYSICS
- G01—MEASURING; TESTING
- G01N—INVESTIGATING OR ANALYSING MATERIALS BY DETERMINING THEIR CHEMICAL OR PHYSICAL PROPERTIES
- G01N21/00—Investigating or analysing materials by the use of optical means, i.e. using sub-millimetre waves, infrared, visible or ultraviolet light
- G01N21/84—Systems specially adapted for particular applications
- G01N21/88—Investigating the presence of flaws or contamination
- G01N21/95—Investigating the presence of flaws or contamination characterised by the material or shape of the object to be examined
- G01N21/956—Inspecting patterns on the surface of objects
-
- G—PHYSICS
- G01—MEASURING; TESTING
- G01R—MEASURING ELECTRIC VARIABLES; MEASURING MAGNETIC VARIABLES
- G01R31/00—Arrangements for testing electric properties; Arrangements for locating electric faults; Arrangements for electrical testing characterised by what is being tested not provided for elsewhere
- G01R31/28—Testing of electronic circuits, e.g. by signal tracer
- G01R31/2801—Testing of printed circuits, backplanes, motherboards, hybrid circuits or carriers for multichip packages [MCP]
- G01R31/281—Specific types of tests or tests for a specific type of fault, e.g. thermal mapping, shorts testing
-
- G—PHYSICS
- G01—MEASURING; TESTING
- G01R—MEASURING ELECTRIC VARIABLES; MEASURING MAGNETIC VARIABLES
- G01R31/00—Arrangements for testing electric properties; Arrangements for locating electric faults; Arrangements for electrical testing characterised by what is being tested not provided for elsewhere
- G01R31/28—Testing of electronic circuits, e.g. by signal tracer
- G01R31/302—Contactless testing
- G01R31/308—Contactless testing using non-ionising electromagnetic radiation, e.g. optical radiation
- G01R31/309—Contactless testing using non-ionising electromagnetic radiation, e.g. optical radiation of printed or hybrid circuits or circuit substrates
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N7/00—Television systems
- H04N7/18—Closed-circuit television [CCTV] systems, i.e. systems in which the video signal is not broadcast
-
- G—PHYSICS
- G01—MEASURING; TESTING
- G01N—INVESTIGATING OR ANALYSING MATERIALS BY DETERMINING THEIR CHEMICAL OR PHYSICAL PROPERTIES
- G01N21/00—Investigating or analysing materials by the use of optical means, i.e. using sub-millimetre waves, infrared, visible or ultraviolet light
- G01N21/84—Systems specially adapted for particular applications
- G01N21/88—Investigating the presence of flaws or contamination
- G01N21/8803—Visual inspection
Landscapes
- Engineering & Computer Science (AREA)
- Physics & Mathematics (AREA)
- General Physics & Mathematics (AREA)
- General Engineering & Computer Science (AREA)
- Health & Medical Sciences (AREA)
- Analytical Chemistry (AREA)
- General Health & Medical Sciences (AREA)
- Electromagnetism (AREA)
- Life Sciences & Earth Sciences (AREA)
- Chemical & Material Sciences (AREA)
- Computer Vision & Pattern Recognition (AREA)
- Biochemistry (AREA)
- Toxicology (AREA)
- Immunology (AREA)
- Pathology (AREA)
- Multimedia (AREA)
- Signal Processing (AREA)
- Computer Hardware Design (AREA)
- Microelectronics & Electronic Packaging (AREA)
- Investigating Materials By The Use Of Optical Means Adapted For Particular Applications (AREA)
- Image Analysis (AREA)
Abstract
A visual inspection support system comprises a display for showing a real-time image of an object projected by projecting means, an input device for pointing out a spot on the real-time image, and a controller for controlling a horizontal drive for an XY table and a vertical drive for a camera focusing mechanism, the controller processing data relative to the spot pointed out by the input device.
Description
~ - 2090936 VISUAL INSPECTION SUPPORT SYSTEM FOR
PRINTED-CIRCUIT BOARD
~ACKGROUNn OF 'I H~: TNV~NTTON
The present invention relates to visual inspection support system which is used upon visual inspection of a printed-circuit board having minute parts mounted thereon, etc.
As to a conventional method of visual inspection of a printed-circuit board, etc., an operator checks predetermined inspection spots in the predetermined order through a magnifying glass. In this case, an enlarged drawing of an inspection target object and a predetermined recording sheet are prepared at hand for recording inspection results, which are entered thereon one by one. Moreover, to sum up the inspection results, it is necessary to register separately a record entered on the drawing or sheet in a database of a computer as soon as the inspection results amount to a certain quantity.
Further, there is a system for carrying out data input through an input device by displaying an image of the inspection target obJect on a display through CAD (computer-aided design), and pointing out a position of a defective spot detected based on the above inspection method, but not a system for recording one by one single inspection result data which are obtained by making the real-time image itself shown on the display visual inspection target, and pointing out a defective spot on the image and inspection information shown on the display simultaneously with the image, respectively, through the input device to combine information on the spot as previously registered with inspection information thereon.
Such conventional method has the following problems:
By way of example, when detecting a defective spot on a printed-clrcuit board and entering inspection information on the enlarged drawing, the operator should surely confirm a position of the defective spot on the drawing. Thus, if the defective spot is found in an area having very numerous parts as massed or an area having similar shape parts as centralized, considerable attention or concentration is required of the operator with an enormous increase in the number of work process. Further, the method of using the recording sheet has similar problems since, for entering inspection information on a detected defective spot on the recording sheet, a circuit symbol, etc. of the defective spot should be read from the enlarged drawing.
~ urthermore, during a work of inputting in the database of the computer the inspection resu]ts as entered on the enlarged drawing or recording sheet, there is a high probability that the operator makes an error in reading or inputting the record, decreasing the reliabilitY of a total result, resu]ting in a possible erroneous result of analysis.
On the other hand, as to a method of pointing out a defective spot by using an image of the inspection target object through CAD, the operator should a]ways verify whether or not a defective spot corresponds to an image shown on the display, and confirm the detected defective spot on the display, so that ~ considerable attention and experience are required of the operator.
It is, therefore, an obJect of the present invention is to provide visual inspection support system which contributes to an improvement of the efficiency of inspection work and the reliability of inspection results.
.~rMM~Y n~ TT~ TNV~NTT~N
~' 3 ~
According to the present invention, there is provided a system for supporting visual inspection of an objet, comprising:
a movably arranged XY table on which the object is to be placed:
a first drive arranged to drive the XY table;
a camera, disposed above the XY table, for capturing an image of the object placed on the XY table;
a second drive arranged to drive the camera with respect to the XY table:
a lens, disposed between the XY table and the camera, for magnifying the object;
a third drive arranged to drive the lens with respect to the XY table;
a display, connected to the camera, for showing a real-time image captured by the camera: and a microcomputer based control unit connected to the first, second and third drives and the display, the control unit controlling the first, second and third drives.
According to the present invention, there is also provided a system for supporting visual inspection of an object, comprising:
a movably arranged XY table on which the object is to be placed:
a first drive arranged to drive the XY table:
a camera, disposed above the XY table, for capturing an image of the object placed on the XY table;
a second drive arranged to drive the camera with respect to the XY table, a lens, disposed between the XY table and the camera, for magnifying the object:
a third drive arranged to drive the lens with respect to the XY table;
a display, connected to the camera, for showing a real-time image captured by the camera:
an input device, arranged on the display, for pointing out a spot on the real-time image shown on the display: and ~' ~.
4 7 ~ 3 ~
a microcomputer based control unit connected to the first, second and third drives, and the display, the controlling unit controlling the first second and third drives and storing first data relative to the spot pointed out by the input device.
According to the present invention, there is also provided a system for supporting visual inspection of an object, comprising:
a movably arranged XY table on which the object is to be placed;
a first drive arranged to drive the XY table;
a camera, disposed above the XY table, for capturing an image of the object placed on the XY table;
a second drive arranged to drive the camera with respect to the XY table;
a lens, disposed between the XY table and the camera, for magnifying the object;
a third drive arranged to drive the lens with respect to the XY table;
a display, connected to the camera, for showing a real-time image captured by the camera:
a microcomputer based control unit connected to the first, second and third drives, and the display, the controlling unit controlling the first, second and third drives.
BRIEF DESCRIPTION OF THE DRAWINGS
Fig. 1 is a front view showing a display with touch panel;
Fig. 2 is a view similar to Fig. 1, showing the display having a defective factor display area and image display area;
Fig 3 is a view similar to Fig. 2, showing the display with touch panel removed;
Fig. 4 is a view similar to Fig. 3, showing the touch panel with dots;
Fig. 5 is a schematic drawing showing a first preferred embodiment of visual inspection support system;
4a Fig. 6 is a side view of a second preferred embodiment of visual inspection support system:
Fig. 7 is a view similar to Fig. 4, showing guide rails with rotation shafts and movable unlts:
/
rotation shafts and movable units;
Fig. 9 is a perspective view showing the guide rail;
Fig. 10 is a plan view showing the movable unit and guide rail;
Fig. 11 is a view similar to Fig. 5, showing a third preferred embodiment of visual inspection support system;
Fig. 12 is a view similar to Fig. 10, showing an XY table and horizontal drive;
Fig. 13 is a view similar to Fig. 12, showing the XY table and horizontal drive with printed-circuit board moved;
Fig. 14 is a view similar to Fig. 8, showing a part of the visual inspection support system;
Fig. 15 is a view similar to Fig. 14, showing a part of the visual inspection support system with camera and magnifying lens moved downward;
Fig. 16 is a view similar to Fig. 7, showing the guide rails with rotation shafts and movable units;
Fig. 17 ls a view similar to Fig. 16, showing the guide rails with rotation shafts and movable units moved downward;
Fig. 18 is view similar to Fig. 11, showing a fourth preferred embodiment of visual inspection support system;
Fig. 19 is a view similar to Fig. 13, showing the XY table and horizontal drive;
Fig. 20 is a view similar to Fig. 19, showing the XY table and horizontal drive with printed-cireuit board moved downward;
Fig. 21 is a view similar to Fig. 15, showing a part of the visual inspection support system;
Fig. 22 is a view similar to Fig. 21, showing a part of the visual inspection support system with camera and magnifying lens moved downward;
Fig. 23 is a view similar to Fig. 17, showing the . 2090936 guide rails with rotation shafts and movable units;
Fig. 24 is a view similar to Fig. 23, showing the guide rails with rotation shafts and movable units moved downward;
Fig. 25 is a view similar to Fig. 24, showing the display with touch panel;
Fig. 26 is a view similar to Fig. 25, showing the display having the defective factor display area and image display area;
Fig. 27 is a view similar to Fig. 18, showing fifth preferred embodiment of visual inspection support system;
Fig. 28 is a view similar to Fig. 26, illustrating a picture of the display with recognition mark;
Fig. 29 is a view similar to Fig. 28, illustrating a picture of the display with reference portion;
Fig. 30 is a view similar to Fig. 29, showing a picture of the display with message;
Fig. 31 is a view similar to Fig. 27, showing a sixth preferred embodiment of visual inspection support system;
Fig. 32 is a view similar to Fig. 30, illustrating a picture of the display with recognition mark;
Fig. 33 is a view similar to Fig. 32, illustrating a picture of the display with reference portion; and Fig. 34 is a view similar to Fig. 33, showing a picture of the display with message;
nF.TATr.F.~ n~CRTPTTON OF TIIF TNV~NTTON
Referring first to Figs. 1-5, there is shown a first preferred embodiment of visual inspection support system embodying the present invention.
As best seen in Fig. 2, a picture of a display 1 has an upper portion for a defective factor display area 4, and a lower portion for an image display area 5 which are separately controlled by a controller 8.
Referring to Fig. 5, when a camera 12 shoots a printed-circuit board 11 on an XY table 10 which is at a standstill, its image is displayed in the image display area 5 as a real-time image as shown in Fig.
3.
Referring to Fig. 4, when a dot touch panel 2 as an input device is disposed on the picture of the display 1, a number of dots 3 as arranged in a matrix inside the touch panel 2 are located on an image of a part 6 displayed in the image display area 5, or a figure of a defective factor number 7 displayed in the defective factor display area 4 as shown in Fig. 1.
When applying a system according to the present invention, a drive condition of the XY table 10 and master data relative to parts and defective factors should previously be registered in view of a relationship between the picture of the display 1 and the dots 3 of the touch panel 2.
First, data proper to each part as an inspection target on the printed-circuit board 11 such as a part number, design number, etc. are registered in the controller 8.
Next, information on the number of divided images of one piece of printed-circuit board upon inspection, a length of a display time of each image, and an order of forward feed of images are registered in the controller 8.
Then, as shown in Fig. 1, the dots 3 of the touch panel 2 as located on an image of each part and data proper to each part are paired, and registered in the controller 8.
Additionally, with regard to each defective factor number displayed in the defective factor display area 4, the dots 3 as located thereon and the defective factor number are paired, and registered in the controller 8.
Registration of a drive condition of the XY table 10 and master data relative to parts and defective factors is carried out by execution of a master data registration program stored in the controller 8.
After registration and drive condition setting, an control program as stored in the controller 8 is executed to carry out visual inspection.
~ ith execution of the inspection program, real-time images of the printed-circuit board 11 are fed forward in sequence on the display 1 by driving of the XY table 10 produced by a drive 9. The operator carries out inspection using the real-time images themselves as a visual target.
As best seen in Fig. 1, when detecting a defective spot during inspection, the operator puts his finger on an image of the part 6 as a defective factor on the touch panel 2 to point out its position.
Then, the operator selects the defective factor number 7 of the defective spot from the defective factor display area 4, and puts his finger on its figure on the touch panel 2. Thus, the control program combines master data relative to the defective spot or part 6 with the defective factor number 7 of the defective spot so as to create single inspection data which are instantaneously registered in a database of the controller 8.
Referring to Figs. 6-10, there is shown a second preferred embodiment of the present invention.
Referring to Figs. 6 and 7, guide rails 116, 117 are fixed to a back plate 118 on its one face to be parallel in the vertical direction. The back plate 118 has another face fixed to a support 123.
Additionally, a magnifying lens movement portion comprises movable units 113, 115, and stationary plates 104, 105, whereas a camera movement portion comprises movable units 112, 114, and stationary - 20909~6 plates 106, 107.
Referring to Figs. 7 and 8, a rotation shaft 119, 120 has a peripheral face formed with a thread as cut at a fixed pitch except both ends, and is fitted into through holes formed in the movable units 112, 113;114, 115. Additionally, since the through hole of the movable unit 113, 114 has a peripheral face formed with a thread at the same pitch as that of the above thread, the rotation shaft 119, 120 is fitted into the movable unit 113, 114 in engaging with the through hole. Referring to Figs. 9 and 10, the guide rail 116, 117 has two protrusions which are engaged with two grooves formed on both side faces of the movable units 112, 113;114, 115. As best seen in Fig. 7, the rotation shaft 119, 120 has one end engaged with a through hole of a stopper 109, 111, and another end engaged with a through hole of a stopper 108, 110.
Further, outer peripheries of the stoppers 108, 109;110, 111 are engaged with both ends of the guide rail 116, 117, so that the rotation shaft 119, 120 and the movable units 11~, 113;114, 115 are in a supported state on a center line of the guide rail 116, 117.
Additionally, as best seen in Figs. 6 and 10, an upper face of the movable unit 112, 113, 114, 115 is formed with a protrusion engaged with a through hole of the stationary plate 104, 105, 106, 107, the camera 101 being fixed to the stationary plate 107, the bellows 102 being fixed to the stationary plates 105, 106, the magnifying lens 103 being fixed to the stationary plate 104, respectively.
Referring to Figs. 6 and 7, in the above state, in case that magnification is increased when shooting a subject 124, for example, the following operation is carried out: The rotation shaft 119 is rotated by rotating counterclockwise a knob 121 fixed to the another end of the rotation shaft 119. This rotational motion is transmitted to the movable unit 209~936 113 which is urged to move downward on the guide rail 116. At the same time, the movable unit 115 as connected with the movable unit 113 through the stationary plates 104, 105 is also moved together, so that the magnifying lens 103 as fixed to the stationary plate 104 is urged to move toward the subject 124, and the bellows 102 having one end connected with the stationary plate 105 extend in interlock with movement of the stationary plate 105.
At this time, the movable unit 112 is not moved since it is out of engagement with the rotation shaft 119.
As soon as rotation of the knob 121 is stopped after determining magnification by the above operation, the movable unit 113 becomes in a stationary state due to engagement relation with the rotation shaft 119, and the stationary plate 104, 105, the movable unit 115, and the magnifying lens 103 are held in a stationary state.
After determining magnification, the following operation is carried out to focusing the subject 124 at this magnification: ~eferring also to Figs. 6 and 7, the rotation shaft 120 is rotated by rotating counterclockwise a knob 122 fixed to the another end of the rotation shaft 120. This rotational motion is transmitted to the movable unit 114 which is urged to move downward on the guide rail 117. At the same time, the movable unit 112 as connected with the movable unit 114 through the stationary plates 106, 107 is also moved together, so that the camera 101 as fixed to the stationary plate 107 is urged to move toward the magnifying lens 103, and the bellows 102 having the one end fixed to the stationary plate 106 contract in interlock with movement of the stationary plate 106. At this time, the movable unit 115 is not moved since it is out of engagement with the rotation shaft 120.
As soon as rotation of the knob 122 is stopped after focusing the subject 124 by the above operation, the movable unit 114 becomes in a stationary state due to engagement relation with the rotation shaft 120, and the stationary plates 106, 107, the movable unit 112, and the camera 101 are held in a stationary state.
When focusing is carried out by decreasing magnification from one to another, clockwise rotation of the knobs 121, 122 has only to carry out for the above magnification change and subject focusing operations.
Referring to Figs. 11-17, there is shown a third preferred embodiment of the present invention. In this embodiment, visual inspection is carried out by using only a system according to the present invention. Moreover, a printed-circuit board 228 serves as an inspection target object, and a computer 202 serves as a controller, and gears 210, 212 and motors 208, 209 serve as a vertical drive for driving a camera focusing mechanism.
As best seen in Figs. 11 and 16, the computer 202 stores a control program for controlling the system, which has a function of optionally recording or modifying information on the printed-circuit board 228 and parts mounted thereon which are an inspection target, a function of optionally setting or modifying, for each printed-circuit board, projection spots on the printed-circuit board 228, magnification, order, and time duration, and a function of generating a signal for driving an XY table 204 and the camera focusing mechanism by driving of a horizontal drive 203 and the motors 208, 209 based on the above data.
In order to carry out visual inspection by using the system, the following registration or modification work of basic data and drive data is performed prior to inspection.
First, the control program is executed to - 209~936 register in the computer, as basic dada, information such as size of the printed-circuit board 228 which is an inspection target, etc., and data proper to each part mounted on the printed-circuit board 228 such as part number, coordinate data, and circuit symbol.
Next, on the control program, the XY table 204 and the camera focusing mechanism are actuated in the manual mode to register or modify projection spots on the printed-circuit board 228, and magnification, order, and time duration thereof. Specifically, referring to Fig. 11, the printed-circuit board 228 is put on the XY table 204 which is optionally moved in watching an image shown on a display 201 to determine a projection spot. Subsequently, a magnifying lens 206 is moved to determine magnification, and a camera 205 is moved to a position where focusing of the image is obtained at this magnification. Then, for each projection spot as determined, projection order and time duration are input through a keyboard, etc.
connected to the computer 202. These works are repeatedly carried out by the required number of times to prepare and register drive data for each printed-circuit board.
The control program calculates in sequence a relative displacement of the position of the XY table 204 for the proJection spot with regard to its reference point or its position for the previous projection spot in terms of projection order, and also a relative displacement of the position of the camera 205 and magnifying lens 206 with regard to its reference point or its position for the previous projection spot in terms of projection order, thus obtaining the above drive data.
After registering basic data and drive data and when starting visual inspection by actuating the system in the automatic mode on the control program, the XY table 204 and camera focusing mechanism carry - 203093~
out the following action by a signal generated in accordance with the control program based on drive data.
Referring to Figs. 11-13, when receiving the above signal, the horizontal drive 203 moves the XY
table 204 and the printed-circuit board 228 placed thereon from a position as indicated in Fig. 12 to a position as indicated in Fig. 13 so as to display an image of a first projection spot on the display 201.
Referring to Figs. 14 and 16, when also receiving the above signal, the motor 208 is rotated in the required direction and by the required number of times to move movable units 221, 223 in a position where projection magnification as set for this projection spot is obtained. The motor 209 is also rotated in the required direction and by the required number of times to move movable units 220, 222 in a position where focusing at projection magnification for this projection spot is obtained.
By way of example, referring also to Figs. 14 and 16, when feeding forward an image shown on the display 201 from an image of one projection spot to that of another projection spot where magnification is set higher than the one projection spot, the motors 208, 209 are rotated to rotate gears 211, 213 through the gears 210, 212 counterclockwise as viewed from above in Figs. 14 and 16. This rotation is transmitted to the movable plates 224, 225, 226, 227 for vertical movement through rotation shafts 218, 219 and the movable units 220, 221, 222, 223, so that the camera 205 and magnifying lens 206 connected to the movable plates 224, 225;226, 227 are urged to move downward, coming to a stop to be held at a position as shown in Figs. 15 and 17.
On the other hand, when feeding an image to that of a projection spot where magnification is set lower, the motors 208, 209 are rotated in a direction opposite to the above one, so that the camera 205 and magnifying lens 206 are urged to move upward.
During execution of the automatic mode on the control program, the system carries out the aforementioned action based on drive data to display in sequence images of determined projection spots in conditions set for each projection spot.
Finally, it is to be noted that in Figs. 11-17, reference numeral 207 designates bellows, 214 designates a support, 215 designates a back plate, 216, 217 designate guide rails, and 229-232 designate stoppers.
Referring to Figs. 18-26, there is shown a fourth preferred embodiment of the present invention.
Referring to ~ig. 18, a computer 308 serves as a controller, and a dot touch panel 302 serves as an input device. As seen from Figs. 23 and 24, a vertical drive for driving a camera focusing mechanism comprises gears 317, 319 and motors 315, 316.
Referring to Figs. 18 and 26, the computer 308 stores a control program for controlling the system, which has a function of dividing a display 301 into an image display area 305 and a defective factor display area 304 by displaying an image and a figure at the same time, a function of optionally setting or modifying projection conditions such as projection spot, magnification, order, time duration, etc., a function of generating a signal for actuating the horizontal drive 309 and vertical drive in interlock with each other in accordance with the projection conditions, a function of optionally setting or modifying corresponding data of the position of parts in the projection spot and the position of dots 303 of the touch panel 302 for each projection spot, a function of optionally recording, modifying and processing various informations on the printed-circuit board 311 and inspection information to be shown on the display 301, and a funetion of recording and processing inspection result data.
Referring to Figs. 25 and 26, the display 301 has an upper portion for the defective factor display area 304 and a lower portion for the image display area 305 which are separately controlled by the computer 308.
The dot touch panel 302 is mounted on a surface of the display 301. Additionally, each dot 303 as located in the defective factor display area 304 corresponds to each defective factor number 307, its relationship being previously registered in the computer 308.
In order to carry out visual inspection by using the system, the following registration or modification work of basic data should be carried out prior to inspection.
First, the control program is executed to register in the computer 308, as basic data, information such as size of the printed-circuit board 311 which is an inspection target, etc., and data proper to each part mounted on the printed-circuit board 311 such as part number, coordinate data, and circuit symbol.
Next, on the control program, an XY table 310 and a camera focusing mechanism are actuated in the manual mode to register or modify projection spots on the printed-circuit board 311, and magnification, order, and time duration thereof. Specifically, referring to Figs. 18 and 25, the printed-circuit board 311 is put on the XY table 310 which is optionally moved in watching an image shown on a display 301 to determine a projection spot. Subsequently, a magnifying lens 313 is moved to determine magnification, and a camera 312 is moved to a position where focusing of the image is obtained at this magnification. Then, for each projection spot as determined, projection order and time duration are input through a keyboard, etc.
connected to the computer 308. These works are repeatedly carried out by the required number of times to prepare and register drive data for each printed-circuit board.
Since the control program calculates in sequence a relative displacement of the position of the XY
table 310 for the projection spot with regard to its reference point or its position for the previous projection spot in terms of projection order, and also a relative displacement of the position of the camera 312 and magnifying lens 313 with regard to its reference point or its position for the previous projection spot in terms of projection order, it is possible to have a record in making each dot of the touch panel 302 correspond automatically to an image of a part in each projection spot, and to prepare drive data.
After registering basic data and drive data and when starting visual inspection by actuating the system in the automatic mode on the control program, the XY table 310 and camera focusing mechanism carry out the following action by a signal generated in accordance with the control program based on drive data.
Referring to Figs. 18-20, when receiving the above signal, the horizontal drive 309 is urged to move the XY table 310 and the printed-circuit board 311 placed thereon from a position as indicated in Fig. 19 to a position as indicated in Fig. 20 so as to display an image of a first projection spot on the display 301. Referring to Figs. 21 and 23, when also receiving the above signal, the motor 315 is rotated in the required direction and by the required number of times to move movable units 328, 330 to a position where projection magnification as set for this projection spot is obtained. The motor 316 is also rotated in the required direction and by the required number of times to move movable units 327, 329 to a - 20~093~
position where focusing at projection magnification for this projection spot is obtained.
By way of example, when feeding forward an image shown on the display 301 from an image of one 5projection spot to that of another projection spot where magnification is set higher than that of the one projection spot, the motors 315, 316 are rotated to rotate the gears 318, 320 through gears 317, 319 counterclockwise as viewed from above in Figs. 21 and 1023. This rotation is transmitted to movable plates 331, 332, 333, 334 through rotation shafts 325, 326 and the movable units 327, 328, 329, 330, so that the camera 312 and magnifying lens 313 connected to the movable plates 331, 332;333, 334 are urged to move 15downward, coming to a stop to be held at a position as shown in Figs. 22 and 24.
On the other hand, when feeding an image to that of a projection spot where projection magnification is set lower, the motors 315, 316 are rotated in a 20direction opposite to the above one, so that the camera 312 and magnifying lens 313 are urged to move upward.
During execution of the automatic mode on the control program, the system carries out the 25aforementioned action based on drive data to display in sequence images of determined projection spots in conditions set for each projection spot.
It is to be noted that in Figs. 18-26, reference numeral 314 designates bellows, 321 designates a 30support, 322 designates a back plate, 323, 324 designate guide rails, and 335-338 designate stoppers.
Next, an explanation will be made with regard to a procedure of preparing and recording inspection result data in the system.
35Referring to Figs. 18 and 25, when the operator finds a defective part on an image during operation of the system in the automatic mode, he presses lightly . 209093G
by finger any position in the area of the defective part on the touch panel 302. Then, the dots 303 as located in a portion as pressed sense this action to generate a signal to the computer 308. When receiving the signal, the control program determines dots of the image from which the signal is derived so as to retrieve basic data of the corresponding part.
Subsequently, the defective factor number 307 of the defective part is pointed out by also pressing the touch panel 302, which is combined with basic data to thereby prepare and record single inspection result data.
Referring to Figs. 27-30, there is shown a fifth preferred embodiment of the present invention. This embodiment is substantially the same as the third preferred embodiment except an automatic inspection function which will be described hereinafter.
A control program has a function of preparing and recording for each picture reference data of which parts to be mounted on a printed-circuit board 408 as an inspection target are normally mounted in their mounting positions by combining various informations on the printed-circuit board 408 such as size, coordinates, shape, circuit symbol, and image processing data of each part with projection conditions, and a function of carrying out automatic inspection of the printed-circuit board 408 using reference data in parallel with or independent of an inspection work of an operator.
Moreover, for further improvement in a function of carrying out the automatic inspection, the control program has a function of preparing data by supposing a dislocation of a position of the printed-circuit board 408 placed on an XY table 407 with regard to the origin, and by recognizing the magnitude of this dislocation for each printed-circuit board or each picture or the two so as to reflect this data on reference data.
Next, an explanation will be made with regard to an example of carrying out visual inspection by the operator and peculiar automatic inspection by the control program in parallel in a method of recognizing a dislocation for each printed-circuit board and recognizing also a dislocation for each picture.
Referring to Figs. 27 and 28, a picture including a recognition mark 409 indicative of a reference position of the printed-circuit board 408 as placed on the XY table 407 is shown on the display 401. When the operator commands an action, the control program calculates a difference between positional information on the recognition mark 409 in reference data corresponding to the picture and positional information on the picture. The difference as calculated is reflected on reference data for each picture which will be displayed in sequence after this.
Referring to Fig. 29, when the picture as a first inspection target is displayed subsequent to the above work, the control program carries out the following processing: It calculates a difference between positional information on a specific reference portion 410 other than parts in reference data corresponding to the picture on which the above difference is previously reflected and positional information on the picture. Then, it carries out correction by reflecting the difference on each positional information on the inspection target part in the picture. The control program carries out calculation or processing for each image of the inspection target part by using positional information as corrected, and it judges whether it is good or bad on this result.
Referring to Fig. 30, if the control program judges that the part 412 is bad (Fig. 30 shows a lack of the part), the control program displays a message 411 with a striking color or shape on the image of the part on the display 401. Even if after finishing his visual inspection the operator wishes to display a next picture without being aware of this message 411, the control program disobeys the command, and generates a warning sound. Thus, it is possible to surely call an operator's attention to the part 412 which is judged bad by the control program. The operator carries out again inspection of the part 412, and if it is bad after all in accordance with the result of inspection, a next picture cannot be displayed without carrying out input of inspection result data by using an input device. On the other hand, even if it is judged not bad in accordance with the result of inspection, a command should be given from the input device to cancel lock of the control program.
Next, an explanation will be made with regard to an example of carrying out only an automatic inspection function of the control program of the system.
A correction method of a dislocation of the recognition mark 409 of the printed-circuit board 408, and that of a dislocation of the specific reference portion other than parts in each picture are the same as the above example.
The difference is calculation or processing for discriminating a content of the defective, and a processing method after judging that it is bad. By way of example, the following processing is carried out:
For discriminating a content of the defective, a plurality of calculations or processings are carried out based on an automatic inspection function of the control program, and their results are combined to point out a content of the defective which is registered in the database. Subsequently, inspection 203~936 of a next picture can be carried out.
Finally, it is to be noted that in Figs. 27-30, reference numeral 402 designates a touch panel, 403 designates a computer, 404 designates a camera, 405 designates a magnifying lens, and 406 designates a horizontal drive.
Referring to Figs. 31-34, there is shown a sixth preferred embodiment of the present invention. This embodiment is substantially the same as the fifth preferred embodiment except that the system fails to provide the magnifying lens 405 of the fifth preferred embodiment. In view of a function, this embodiment is identical to the fifth preferred embodiment.
Having described the present invention in connection with the embodiments, it is to be noted that the present invention is not limited thereto, and various changes and modifications are possible without depart from the spirit of the present invention.
By way of example, the input device may be an ultrasonic touch panel or mouse in place of the dot touch panel.
PRINTED-CIRCUIT BOARD
~ACKGROUNn OF 'I H~: TNV~NTTON
The present invention relates to visual inspection support system which is used upon visual inspection of a printed-circuit board having minute parts mounted thereon, etc.
As to a conventional method of visual inspection of a printed-circuit board, etc., an operator checks predetermined inspection spots in the predetermined order through a magnifying glass. In this case, an enlarged drawing of an inspection target object and a predetermined recording sheet are prepared at hand for recording inspection results, which are entered thereon one by one. Moreover, to sum up the inspection results, it is necessary to register separately a record entered on the drawing or sheet in a database of a computer as soon as the inspection results amount to a certain quantity.
Further, there is a system for carrying out data input through an input device by displaying an image of the inspection target obJect on a display through CAD (computer-aided design), and pointing out a position of a defective spot detected based on the above inspection method, but not a system for recording one by one single inspection result data which are obtained by making the real-time image itself shown on the display visual inspection target, and pointing out a defective spot on the image and inspection information shown on the display simultaneously with the image, respectively, through the input device to combine information on the spot as previously registered with inspection information thereon.
Such conventional method has the following problems:
By way of example, when detecting a defective spot on a printed-clrcuit board and entering inspection information on the enlarged drawing, the operator should surely confirm a position of the defective spot on the drawing. Thus, if the defective spot is found in an area having very numerous parts as massed or an area having similar shape parts as centralized, considerable attention or concentration is required of the operator with an enormous increase in the number of work process. Further, the method of using the recording sheet has similar problems since, for entering inspection information on a detected defective spot on the recording sheet, a circuit symbol, etc. of the defective spot should be read from the enlarged drawing.
~ urthermore, during a work of inputting in the database of the computer the inspection resu]ts as entered on the enlarged drawing or recording sheet, there is a high probability that the operator makes an error in reading or inputting the record, decreasing the reliabilitY of a total result, resu]ting in a possible erroneous result of analysis.
On the other hand, as to a method of pointing out a defective spot by using an image of the inspection target object through CAD, the operator should a]ways verify whether or not a defective spot corresponds to an image shown on the display, and confirm the detected defective spot on the display, so that ~ considerable attention and experience are required of the operator.
It is, therefore, an obJect of the present invention is to provide visual inspection support system which contributes to an improvement of the efficiency of inspection work and the reliability of inspection results.
.~rMM~Y n~ TT~ TNV~NTT~N
~' 3 ~
According to the present invention, there is provided a system for supporting visual inspection of an objet, comprising:
a movably arranged XY table on which the object is to be placed:
a first drive arranged to drive the XY table;
a camera, disposed above the XY table, for capturing an image of the object placed on the XY table;
a second drive arranged to drive the camera with respect to the XY table:
a lens, disposed between the XY table and the camera, for magnifying the object;
a third drive arranged to drive the lens with respect to the XY table;
a display, connected to the camera, for showing a real-time image captured by the camera: and a microcomputer based control unit connected to the first, second and third drives and the display, the control unit controlling the first, second and third drives.
According to the present invention, there is also provided a system for supporting visual inspection of an object, comprising:
a movably arranged XY table on which the object is to be placed:
a first drive arranged to drive the XY table:
a camera, disposed above the XY table, for capturing an image of the object placed on the XY table;
a second drive arranged to drive the camera with respect to the XY table, a lens, disposed between the XY table and the camera, for magnifying the object:
a third drive arranged to drive the lens with respect to the XY table;
a display, connected to the camera, for showing a real-time image captured by the camera:
an input device, arranged on the display, for pointing out a spot on the real-time image shown on the display: and ~' ~.
4 7 ~ 3 ~
a microcomputer based control unit connected to the first, second and third drives, and the display, the controlling unit controlling the first second and third drives and storing first data relative to the spot pointed out by the input device.
According to the present invention, there is also provided a system for supporting visual inspection of an object, comprising:
a movably arranged XY table on which the object is to be placed;
a first drive arranged to drive the XY table;
a camera, disposed above the XY table, for capturing an image of the object placed on the XY table;
a second drive arranged to drive the camera with respect to the XY table;
a lens, disposed between the XY table and the camera, for magnifying the object;
a third drive arranged to drive the lens with respect to the XY table;
a display, connected to the camera, for showing a real-time image captured by the camera:
a microcomputer based control unit connected to the first, second and third drives, and the display, the controlling unit controlling the first, second and third drives.
BRIEF DESCRIPTION OF THE DRAWINGS
Fig. 1 is a front view showing a display with touch panel;
Fig. 2 is a view similar to Fig. 1, showing the display having a defective factor display area and image display area;
Fig 3 is a view similar to Fig. 2, showing the display with touch panel removed;
Fig. 4 is a view similar to Fig. 3, showing the touch panel with dots;
Fig. 5 is a schematic drawing showing a first preferred embodiment of visual inspection support system;
4a Fig. 6 is a side view of a second preferred embodiment of visual inspection support system:
Fig. 7 is a view similar to Fig. 4, showing guide rails with rotation shafts and movable unlts:
/
rotation shafts and movable units;
Fig. 9 is a perspective view showing the guide rail;
Fig. 10 is a plan view showing the movable unit and guide rail;
Fig. 11 is a view similar to Fig. 5, showing a third preferred embodiment of visual inspection support system;
Fig. 12 is a view similar to Fig. 10, showing an XY table and horizontal drive;
Fig. 13 is a view similar to Fig. 12, showing the XY table and horizontal drive with printed-circuit board moved;
Fig. 14 is a view similar to Fig. 8, showing a part of the visual inspection support system;
Fig. 15 is a view similar to Fig. 14, showing a part of the visual inspection support system with camera and magnifying lens moved downward;
Fig. 16 is a view similar to Fig. 7, showing the guide rails with rotation shafts and movable units;
Fig. 17 ls a view similar to Fig. 16, showing the guide rails with rotation shafts and movable units moved downward;
Fig. 18 is view similar to Fig. 11, showing a fourth preferred embodiment of visual inspection support system;
Fig. 19 is a view similar to Fig. 13, showing the XY table and horizontal drive;
Fig. 20 is a view similar to Fig. 19, showing the XY table and horizontal drive with printed-cireuit board moved downward;
Fig. 21 is a view similar to Fig. 15, showing a part of the visual inspection support system;
Fig. 22 is a view similar to Fig. 21, showing a part of the visual inspection support system with camera and magnifying lens moved downward;
Fig. 23 is a view similar to Fig. 17, showing the . 2090936 guide rails with rotation shafts and movable units;
Fig. 24 is a view similar to Fig. 23, showing the guide rails with rotation shafts and movable units moved downward;
Fig. 25 is a view similar to Fig. 24, showing the display with touch panel;
Fig. 26 is a view similar to Fig. 25, showing the display having the defective factor display area and image display area;
Fig. 27 is a view similar to Fig. 18, showing fifth preferred embodiment of visual inspection support system;
Fig. 28 is a view similar to Fig. 26, illustrating a picture of the display with recognition mark;
Fig. 29 is a view similar to Fig. 28, illustrating a picture of the display with reference portion;
Fig. 30 is a view similar to Fig. 29, showing a picture of the display with message;
Fig. 31 is a view similar to Fig. 27, showing a sixth preferred embodiment of visual inspection support system;
Fig. 32 is a view similar to Fig. 30, illustrating a picture of the display with recognition mark;
Fig. 33 is a view similar to Fig. 32, illustrating a picture of the display with reference portion; and Fig. 34 is a view similar to Fig. 33, showing a picture of the display with message;
nF.TATr.F.~ n~CRTPTTON OF TIIF TNV~NTTON
Referring first to Figs. 1-5, there is shown a first preferred embodiment of visual inspection support system embodying the present invention.
As best seen in Fig. 2, a picture of a display 1 has an upper portion for a defective factor display area 4, and a lower portion for an image display area 5 which are separately controlled by a controller 8.
Referring to Fig. 5, when a camera 12 shoots a printed-circuit board 11 on an XY table 10 which is at a standstill, its image is displayed in the image display area 5 as a real-time image as shown in Fig.
3.
Referring to Fig. 4, when a dot touch panel 2 as an input device is disposed on the picture of the display 1, a number of dots 3 as arranged in a matrix inside the touch panel 2 are located on an image of a part 6 displayed in the image display area 5, or a figure of a defective factor number 7 displayed in the defective factor display area 4 as shown in Fig. 1.
When applying a system according to the present invention, a drive condition of the XY table 10 and master data relative to parts and defective factors should previously be registered in view of a relationship between the picture of the display 1 and the dots 3 of the touch panel 2.
First, data proper to each part as an inspection target on the printed-circuit board 11 such as a part number, design number, etc. are registered in the controller 8.
Next, information on the number of divided images of one piece of printed-circuit board upon inspection, a length of a display time of each image, and an order of forward feed of images are registered in the controller 8.
Then, as shown in Fig. 1, the dots 3 of the touch panel 2 as located on an image of each part and data proper to each part are paired, and registered in the controller 8.
Additionally, with regard to each defective factor number displayed in the defective factor display area 4, the dots 3 as located thereon and the defective factor number are paired, and registered in the controller 8.
Registration of a drive condition of the XY table 10 and master data relative to parts and defective factors is carried out by execution of a master data registration program stored in the controller 8.
After registration and drive condition setting, an control program as stored in the controller 8 is executed to carry out visual inspection.
~ ith execution of the inspection program, real-time images of the printed-circuit board 11 are fed forward in sequence on the display 1 by driving of the XY table 10 produced by a drive 9. The operator carries out inspection using the real-time images themselves as a visual target.
As best seen in Fig. 1, when detecting a defective spot during inspection, the operator puts his finger on an image of the part 6 as a defective factor on the touch panel 2 to point out its position.
Then, the operator selects the defective factor number 7 of the defective spot from the defective factor display area 4, and puts his finger on its figure on the touch panel 2. Thus, the control program combines master data relative to the defective spot or part 6 with the defective factor number 7 of the defective spot so as to create single inspection data which are instantaneously registered in a database of the controller 8.
Referring to Figs. 6-10, there is shown a second preferred embodiment of the present invention.
Referring to Figs. 6 and 7, guide rails 116, 117 are fixed to a back plate 118 on its one face to be parallel in the vertical direction. The back plate 118 has another face fixed to a support 123.
Additionally, a magnifying lens movement portion comprises movable units 113, 115, and stationary plates 104, 105, whereas a camera movement portion comprises movable units 112, 114, and stationary - 20909~6 plates 106, 107.
Referring to Figs. 7 and 8, a rotation shaft 119, 120 has a peripheral face formed with a thread as cut at a fixed pitch except both ends, and is fitted into through holes formed in the movable units 112, 113;114, 115. Additionally, since the through hole of the movable unit 113, 114 has a peripheral face formed with a thread at the same pitch as that of the above thread, the rotation shaft 119, 120 is fitted into the movable unit 113, 114 in engaging with the through hole. Referring to Figs. 9 and 10, the guide rail 116, 117 has two protrusions which are engaged with two grooves formed on both side faces of the movable units 112, 113;114, 115. As best seen in Fig. 7, the rotation shaft 119, 120 has one end engaged with a through hole of a stopper 109, 111, and another end engaged with a through hole of a stopper 108, 110.
Further, outer peripheries of the stoppers 108, 109;110, 111 are engaged with both ends of the guide rail 116, 117, so that the rotation shaft 119, 120 and the movable units 11~, 113;114, 115 are in a supported state on a center line of the guide rail 116, 117.
Additionally, as best seen in Figs. 6 and 10, an upper face of the movable unit 112, 113, 114, 115 is formed with a protrusion engaged with a through hole of the stationary plate 104, 105, 106, 107, the camera 101 being fixed to the stationary plate 107, the bellows 102 being fixed to the stationary plates 105, 106, the magnifying lens 103 being fixed to the stationary plate 104, respectively.
Referring to Figs. 6 and 7, in the above state, in case that magnification is increased when shooting a subject 124, for example, the following operation is carried out: The rotation shaft 119 is rotated by rotating counterclockwise a knob 121 fixed to the another end of the rotation shaft 119. This rotational motion is transmitted to the movable unit 209~936 113 which is urged to move downward on the guide rail 116. At the same time, the movable unit 115 as connected with the movable unit 113 through the stationary plates 104, 105 is also moved together, so that the magnifying lens 103 as fixed to the stationary plate 104 is urged to move toward the subject 124, and the bellows 102 having one end connected with the stationary plate 105 extend in interlock with movement of the stationary plate 105.
At this time, the movable unit 112 is not moved since it is out of engagement with the rotation shaft 119.
As soon as rotation of the knob 121 is stopped after determining magnification by the above operation, the movable unit 113 becomes in a stationary state due to engagement relation with the rotation shaft 119, and the stationary plate 104, 105, the movable unit 115, and the magnifying lens 103 are held in a stationary state.
After determining magnification, the following operation is carried out to focusing the subject 124 at this magnification: ~eferring also to Figs. 6 and 7, the rotation shaft 120 is rotated by rotating counterclockwise a knob 122 fixed to the another end of the rotation shaft 120. This rotational motion is transmitted to the movable unit 114 which is urged to move downward on the guide rail 117. At the same time, the movable unit 112 as connected with the movable unit 114 through the stationary plates 106, 107 is also moved together, so that the camera 101 as fixed to the stationary plate 107 is urged to move toward the magnifying lens 103, and the bellows 102 having the one end fixed to the stationary plate 106 contract in interlock with movement of the stationary plate 106. At this time, the movable unit 115 is not moved since it is out of engagement with the rotation shaft 120.
As soon as rotation of the knob 122 is stopped after focusing the subject 124 by the above operation, the movable unit 114 becomes in a stationary state due to engagement relation with the rotation shaft 120, and the stationary plates 106, 107, the movable unit 112, and the camera 101 are held in a stationary state.
When focusing is carried out by decreasing magnification from one to another, clockwise rotation of the knobs 121, 122 has only to carry out for the above magnification change and subject focusing operations.
Referring to Figs. 11-17, there is shown a third preferred embodiment of the present invention. In this embodiment, visual inspection is carried out by using only a system according to the present invention. Moreover, a printed-circuit board 228 serves as an inspection target object, and a computer 202 serves as a controller, and gears 210, 212 and motors 208, 209 serve as a vertical drive for driving a camera focusing mechanism.
As best seen in Figs. 11 and 16, the computer 202 stores a control program for controlling the system, which has a function of optionally recording or modifying information on the printed-circuit board 228 and parts mounted thereon which are an inspection target, a function of optionally setting or modifying, for each printed-circuit board, projection spots on the printed-circuit board 228, magnification, order, and time duration, and a function of generating a signal for driving an XY table 204 and the camera focusing mechanism by driving of a horizontal drive 203 and the motors 208, 209 based on the above data.
In order to carry out visual inspection by using the system, the following registration or modification work of basic data and drive data is performed prior to inspection.
First, the control program is executed to - 209~936 register in the computer, as basic dada, information such as size of the printed-circuit board 228 which is an inspection target, etc., and data proper to each part mounted on the printed-circuit board 228 such as part number, coordinate data, and circuit symbol.
Next, on the control program, the XY table 204 and the camera focusing mechanism are actuated in the manual mode to register or modify projection spots on the printed-circuit board 228, and magnification, order, and time duration thereof. Specifically, referring to Fig. 11, the printed-circuit board 228 is put on the XY table 204 which is optionally moved in watching an image shown on a display 201 to determine a projection spot. Subsequently, a magnifying lens 206 is moved to determine magnification, and a camera 205 is moved to a position where focusing of the image is obtained at this magnification. Then, for each projection spot as determined, projection order and time duration are input through a keyboard, etc.
connected to the computer 202. These works are repeatedly carried out by the required number of times to prepare and register drive data for each printed-circuit board.
The control program calculates in sequence a relative displacement of the position of the XY table 204 for the proJection spot with regard to its reference point or its position for the previous projection spot in terms of projection order, and also a relative displacement of the position of the camera 205 and magnifying lens 206 with regard to its reference point or its position for the previous projection spot in terms of projection order, thus obtaining the above drive data.
After registering basic data and drive data and when starting visual inspection by actuating the system in the automatic mode on the control program, the XY table 204 and camera focusing mechanism carry - 203093~
out the following action by a signal generated in accordance with the control program based on drive data.
Referring to Figs. 11-13, when receiving the above signal, the horizontal drive 203 moves the XY
table 204 and the printed-circuit board 228 placed thereon from a position as indicated in Fig. 12 to a position as indicated in Fig. 13 so as to display an image of a first projection spot on the display 201.
Referring to Figs. 14 and 16, when also receiving the above signal, the motor 208 is rotated in the required direction and by the required number of times to move movable units 221, 223 in a position where projection magnification as set for this projection spot is obtained. The motor 209 is also rotated in the required direction and by the required number of times to move movable units 220, 222 in a position where focusing at projection magnification for this projection spot is obtained.
By way of example, referring also to Figs. 14 and 16, when feeding forward an image shown on the display 201 from an image of one projection spot to that of another projection spot where magnification is set higher than the one projection spot, the motors 208, 209 are rotated to rotate gears 211, 213 through the gears 210, 212 counterclockwise as viewed from above in Figs. 14 and 16. This rotation is transmitted to the movable plates 224, 225, 226, 227 for vertical movement through rotation shafts 218, 219 and the movable units 220, 221, 222, 223, so that the camera 205 and magnifying lens 206 connected to the movable plates 224, 225;226, 227 are urged to move downward, coming to a stop to be held at a position as shown in Figs. 15 and 17.
On the other hand, when feeding an image to that of a projection spot where magnification is set lower, the motors 208, 209 are rotated in a direction opposite to the above one, so that the camera 205 and magnifying lens 206 are urged to move upward.
During execution of the automatic mode on the control program, the system carries out the aforementioned action based on drive data to display in sequence images of determined projection spots in conditions set for each projection spot.
Finally, it is to be noted that in Figs. 11-17, reference numeral 207 designates bellows, 214 designates a support, 215 designates a back plate, 216, 217 designate guide rails, and 229-232 designate stoppers.
Referring to Figs. 18-26, there is shown a fourth preferred embodiment of the present invention.
Referring to ~ig. 18, a computer 308 serves as a controller, and a dot touch panel 302 serves as an input device. As seen from Figs. 23 and 24, a vertical drive for driving a camera focusing mechanism comprises gears 317, 319 and motors 315, 316.
Referring to Figs. 18 and 26, the computer 308 stores a control program for controlling the system, which has a function of dividing a display 301 into an image display area 305 and a defective factor display area 304 by displaying an image and a figure at the same time, a function of optionally setting or modifying projection conditions such as projection spot, magnification, order, time duration, etc., a function of generating a signal for actuating the horizontal drive 309 and vertical drive in interlock with each other in accordance with the projection conditions, a function of optionally setting or modifying corresponding data of the position of parts in the projection spot and the position of dots 303 of the touch panel 302 for each projection spot, a function of optionally recording, modifying and processing various informations on the printed-circuit board 311 and inspection information to be shown on the display 301, and a funetion of recording and processing inspection result data.
Referring to Figs. 25 and 26, the display 301 has an upper portion for the defective factor display area 304 and a lower portion for the image display area 305 which are separately controlled by the computer 308.
The dot touch panel 302 is mounted on a surface of the display 301. Additionally, each dot 303 as located in the defective factor display area 304 corresponds to each defective factor number 307, its relationship being previously registered in the computer 308.
In order to carry out visual inspection by using the system, the following registration or modification work of basic data should be carried out prior to inspection.
First, the control program is executed to register in the computer 308, as basic data, information such as size of the printed-circuit board 311 which is an inspection target, etc., and data proper to each part mounted on the printed-circuit board 311 such as part number, coordinate data, and circuit symbol.
Next, on the control program, an XY table 310 and a camera focusing mechanism are actuated in the manual mode to register or modify projection spots on the printed-circuit board 311, and magnification, order, and time duration thereof. Specifically, referring to Figs. 18 and 25, the printed-circuit board 311 is put on the XY table 310 which is optionally moved in watching an image shown on a display 301 to determine a projection spot. Subsequently, a magnifying lens 313 is moved to determine magnification, and a camera 312 is moved to a position where focusing of the image is obtained at this magnification. Then, for each projection spot as determined, projection order and time duration are input through a keyboard, etc.
connected to the computer 308. These works are repeatedly carried out by the required number of times to prepare and register drive data for each printed-circuit board.
Since the control program calculates in sequence a relative displacement of the position of the XY
table 310 for the projection spot with regard to its reference point or its position for the previous projection spot in terms of projection order, and also a relative displacement of the position of the camera 312 and magnifying lens 313 with regard to its reference point or its position for the previous projection spot in terms of projection order, it is possible to have a record in making each dot of the touch panel 302 correspond automatically to an image of a part in each projection spot, and to prepare drive data.
After registering basic data and drive data and when starting visual inspection by actuating the system in the automatic mode on the control program, the XY table 310 and camera focusing mechanism carry out the following action by a signal generated in accordance with the control program based on drive data.
Referring to Figs. 18-20, when receiving the above signal, the horizontal drive 309 is urged to move the XY table 310 and the printed-circuit board 311 placed thereon from a position as indicated in Fig. 19 to a position as indicated in Fig. 20 so as to display an image of a first projection spot on the display 301. Referring to Figs. 21 and 23, when also receiving the above signal, the motor 315 is rotated in the required direction and by the required number of times to move movable units 328, 330 to a position where projection magnification as set for this projection spot is obtained. The motor 316 is also rotated in the required direction and by the required number of times to move movable units 327, 329 to a - 20~093~
position where focusing at projection magnification for this projection spot is obtained.
By way of example, when feeding forward an image shown on the display 301 from an image of one 5projection spot to that of another projection spot where magnification is set higher than that of the one projection spot, the motors 315, 316 are rotated to rotate the gears 318, 320 through gears 317, 319 counterclockwise as viewed from above in Figs. 21 and 1023. This rotation is transmitted to movable plates 331, 332, 333, 334 through rotation shafts 325, 326 and the movable units 327, 328, 329, 330, so that the camera 312 and magnifying lens 313 connected to the movable plates 331, 332;333, 334 are urged to move 15downward, coming to a stop to be held at a position as shown in Figs. 22 and 24.
On the other hand, when feeding an image to that of a projection spot where projection magnification is set lower, the motors 315, 316 are rotated in a 20direction opposite to the above one, so that the camera 312 and magnifying lens 313 are urged to move upward.
During execution of the automatic mode on the control program, the system carries out the 25aforementioned action based on drive data to display in sequence images of determined projection spots in conditions set for each projection spot.
It is to be noted that in Figs. 18-26, reference numeral 314 designates bellows, 321 designates a 30support, 322 designates a back plate, 323, 324 designate guide rails, and 335-338 designate stoppers.
Next, an explanation will be made with regard to a procedure of preparing and recording inspection result data in the system.
35Referring to Figs. 18 and 25, when the operator finds a defective part on an image during operation of the system in the automatic mode, he presses lightly . 209093G
by finger any position in the area of the defective part on the touch panel 302. Then, the dots 303 as located in a portion as pressed sense this action to generate a signal to the computer 308. When receiving the signal, the control program determines dots of the image from which the signal is derived so as to retrieve basic data of the corresponding part.
Subsequently, the defective factor number 307 of the defective part is pointed out by also pressing the touch panel 302, which is combined with basic data to thereby prepare and record single inspection result data.
Referring to Figs. 27-30, there is shown a fifth preferred embodiment of the present invention. This embodiment is substantially the same as the third preferred embodiment except an automatic inspection function which will be described hereinafter.
A control program has a function of preparing and recording for each picture reference data of which parts to be mounted on a printed-circuit board 408 as an inspection target are normally mounted in their mounting positions by combining various informations on the printed-circuit board 408 such as size, coordinates, shape, circuit symbol, and image processing data of each part with projection conditions, and a function of carrying out automatic inspection of the printed-circuit board 408 using reference data in parallel with or independent of an inspection work of an operator.
Moreover, for further improvement in a function of carrying out the automatic inspection, the control program has a function of preparing data by supposing a dislocation of a position of the printed-circuit board 408 placed on an XY table 407 with regard to the origin, and by recognizing the magnitude of this dislocation for each printed-circuit board or each picture or the two so as to reflect this data on reference data.
Next, an explanation will be made with regard to an example of carrying out visual inspection by the operator and peculiar automatic inspection by the control program in parallel in a method of recognizing a dislocation for each printed-circuit board and recognizing also a dislocation for each picture.
Referring to Figs. 27 and 28, a picture including a recognition mark 409 indicative of a reference position of the printed-circuit board 408 as placed on the XY table 407 is shown on the display 401. When the operator commands an action, the control program calculates a difference between positional information on the recognition mark 409 in reference data corresponding to the picture and positional information on the picture. The difference as calculated is reflected on reference data for each picture which will be displayed in sequence after this.
Referring to Fig. 29, when the picture as a first inspection target is displayed subsequent to the above work, the control program carries out the following processing: It calculates a difference between positional information on a specific reference portion 410 other than parts in reference data corresponding to the picture on which the above difference is previously reflected and positional information on the picture. Then, it carries out correction by reflecting the difference on each positional information on the inspection target part in the picture. The control program carries out calculation or processing for each image of the inspection target part by using positional information as corrected, and it judges whether it is good or bad on this result.
Referring to Fig. 30, if the control program judges that the part 412 is bad (Fig. 30 shows a lack of the part), the control program displays a message 411 with a striking color or shape on the image of the part on the display 401. Even if after finishing his visual inspection the operator wishes to display a next picture without being aware of this message 411, the control program disobeys the command, and generates a warning sound. Thus, it is possible to surely call an operator's attention to the part 412 which is judged bad by the control program. The operator carries out again inspection of the part 412, and if it is bad after all in accordance with the result of inspection, a next picture cannot be displayed without carrying out input of inspection result data by using an input device. On the other hand, even if it is judged not bad in accordance with the result of inspection, a command should be given from the input device to cancel lock of the control program.
Next, an explanation will be made with regard to an example of carrying out only an automatic inspection function of the control program of the system.
A correction method of a dislocation of the recognition mark 409 of the printed-circuit board 408, and that of a dislocation of the specific reference portion other than parts in each picture are the same as the above example.
The difference is calculation or processing for discriminating a content of the defective, and a processing method after judging that it is bad. By way of example, the following processing is carried out:
For discriminating a content of the defective, a plurality of calculations or processings are carried out based on an automatic inspection function of the control program, and their results are combined to point out a content of the defective which is registered in the database. Subsequently, inspection 203~936 of a next picture can be carried out.
Finally, it is to be noted that in Figs. 27-30, reference numeral 402 designates a touch panel, 403 designates a computer, 404 designates a camera, 405 designates a magnifying lens, and 406 designates a horizontal drive.
Referring to Figs. 31-34, there is shown a sixth preferred embodiment of the present invention. This embodiment is substantially the same as the fifth preferred embodiment except that the system fails to provide the magnifying lens 405 of the fifth preferred embodiment. In view of a function, this embodiment is identical to the fifth preferred embodiment.
Having described the present invention in connection with the embodiments, it is to be noted that the present invention is not limited thereto, and various changes and modifications are possible without depart from the spirit of the present invention.
By way of example, the input device may be an ultrasonic touch panel or mouse in place of the dot touch panel.
Claims (22)
1 A system for supporting visual inspection of an objet, comprising:
a movably arranged XY table on which the object is to be placed:
a first drive arranged to drive the XY table:
a camera, disposed above the XY table, for capturing an image of the object placed on the XY table:
a second drive arranged to drive the camera with respect to the XY table:
a lens, disposed between the XY table and the camera, for magnifying the object;
a third drive arranged to drive the lens with respect to the XY table:
a display, connected to the camera, for showing a real-time image captured by the camera: and a microcomputer based control unit connected to the first, second and third drives and the display, the control unit controlling the first, second and third drives.
a movably arranged XY table on which the object is to be placed:
a first drive arranged to drive the XY table:
a camera, disposed above the XY table, for capturing an image of the object placed on the XY table:
a second drive arranged to drive the camera with respect to the XY table:
a lens, disposed between the XY table and the camera, for magnifying the object;
a third drive arranged to drive the lens with respect to the XY table:
a display, connected to the camera, for showing a real-time image captured by the camera: and a microcomputer based control unit connected to the first, second and third drives and the display, the control unit controlling the first, second and third drives.
2. A system as claimed in claim 1, wherein said microcomputer based control unit includes a control program for optionally setting projection conditions of said object on which said first drive is driven.
3. A system as claimed in claim 1, including an input device, arranged on the display, for pointing out a spot on the real-time image shown on the display.
4. A system as claimed in claim 2, wherein said microcomputer based control unit processing first data relative to said spot pointed out by said input device.
5. A system as claimed in claim 3 or 4, wherein the microcomputer based control unit stores first data relative to the spot pointed out by the input device.
6. A system as claimed in claim 5, wherein the microcomputer based control unit stores in sequence inspection data obtained by combining the first data with second data relative to the object, a drive condition of the XY table, and a defective factor.
7. A system as claimed in claim 6, wherein said first drive and said second drive are automatically driven ininterlock with each other.
8. A system as claimed in claim 1, wherein the second and third drives include a rotation shaft, a movable unit, a guide rail, and a knob, respectively.
9. A system as claimed in claim 5, wherein said focusing mechanism includes a rotation shaft, a movable unit, a guide rail, and a stopper.
10. A system as claimed in claim 2, wherein the projection conditions include the number of real-time images to be shown on the display, and the magnification, order, and time duration thereof.
11. A system as claimed in claim 10, wherein said microcomputer based control unit carries out an inspection of said real-time image of said object independent of said visual inspection.
12. A system as claimed in claim 1, wherein said projecting means include a camera and a magnifying lens.
13. A system as claimed in claim 6, wherein said projection conditions include the number of said real-time image to be shown on said display, and magnification, order, and time duration thereof.
14. A system as claimed in claim 3, wherein said input device includes a dot touch panel.
15. A system for supporting visual inspection of an object, comprising:
a movably arranged XY table on which the object is to be placed;
a first drive arranged to drive the XY table;
a camera, disposed above the XY table, for capturing an image of the object placed on the XY table:
a second drive arranged to drive the camera with respect to the XY table;
a lens, disposed between the XY table and the camera, for magnifying the object;
a third drive arranged to drive the lens with respect to the XY table;
a display, connected to the camera, for showing a real-time image captured by the camera;
an input device, arranged on the display, for pointing out a spot on the real-time image shown on the display; and a microcomputer based control unit connected to the first, second and third drives, and the display, the controlling unit controlling the first second and third drives and storing first data relative to the spot pointed out by the input device.
a movably arranged XY table on which the object is to be placed;
a first drive arranged to drive the XY table;
a camera, disposed above the XY table, for capturing an image of the object placed on the XY table:
a second drive arranged to drive the camera with respect to the XY table;
a lens, disposed between the XY table and the camera, for magnifying the object;
a third drive arranged to drive the lens with respect to the XY table;
a display, connected to the camera, for showing a real-time image captured by the camera;
an input device, arranged on the display, for pointing out a spot on the real-time image shown on the display; and a microcomputer based control unit connected to the first, second and third drives, and the display, the controlling unit controlling the first second and third drives and storing first data relative to the spot pointed out by the input device.
16. A system as claimed in claim 15, wherein said microcomputer based control unit includes a control program for optionally setting projection conditions of said object on which said first drive and second drive are driven.
17. A system as claimed in claim 16, wherein said first drive and said second drive are automatically driven ininterlock with each other.
18. A system as claimed in claim 16, wherein said microcomputer based control unit includes a database for storing in sequence inspection data obtained by combining said first data with second data relative to a drive condition of said XY table, said object, and a defective factor.
19. A system as claimed in any of claims 15 to 17, wherein the microcomputer based control unit stores in sequence inspection data obtained by combining the first data with second data relative to the object, a drive condition of the XY table, and a defective factor.
20. A system as claimed in claim 16, wherein said projection conditions include the number of said real-time image to be shown on said display, and magnification, order, and time duration thereof.
21. A system as claimed in any one of claims 15 to 17 and 19, wherein the input device includes a dot touch panel.
22. A system for supporting visual inspection of an object, comprising:
a movably arranged XY table on which the object is to be placed:
a first drive arranged to drive the XY table;
a camera, disposed above the XY table, for capturing an image of the object placed on the XY table;
a second drive arranged to drive the camera with respect to the XY table;
a lens, disposed between the XY table and the camera, for magnifying the object;
a third drive arranged to drive the lens with respect to the XY table;
a display, connected to the camera, for showing a real-time image captured by the camera;
a microcomputer based control unit connected to the first, second and third drives, and the display, the controlling unit controlling the first, second and third drives.
a movably arranged XY table on which the object is to be placed:
a first drive arranged to drive the XY table;
a camera, disposed above the XY table, for capturing an image of the object placed on the XY table;
a second drive arranged to drive the camera with respect to the XY table;
a lens, disposed between the XY table and the camera, for magnifying the object;
a third drive arranged to drive the lens with respect to the XY table;
a display, connected to the camera, for showing a real-time image captured by the camera;
a microcomputer based control unit connected to the first, second and third drives, and the display, the controlling unit controlling the first, second and third drives.
Applications Claiming Priority (12)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| JPU4-24234 | 1992-03-04 | ||
| JP024234U JPH0573565U (en) | 1992-03-04 | 1992-03-04 | Visual inspection system |
| JP1992039696U JP2573219Y2 (en) | 1992-04-27 | 1992-04-27 | Camera focusing mechanism |
| JPU4-39696 | 1992-04-27 | ||
| JP4188525A JP2944827B2 (en) | 1992-06-08 | 1992-06-08 | Visual inspection system |
| JP04188524A JP3076451B2 (en) | 1992-06-08 | 1992-06-08 | Automatic video display system |
| JPP4-188525 | 1992-06-08 | ||
| JPP4-188524 | 1992-06-08 | ||
| JPU4-77988 | 1992-10-02 | ||
| JPP4-302805 | 1992-10-02 | ||
| JP04302805A JP3105365B2 (en) | 1992-10-02 | 1992-10-02 | Visual inspection system with automatic inspection function |
| JP7798892U JPH0633060U (en) | 1992-10-02 | 1992-10-02 | Visual inspection system with automatic inspection function |
Publications (2)
| Publication Number | Publication Date |
|---|---|
| CA2090936A1 CA2090936A1 (en) | 1993-09-05 |
| CA2090936C true CA2090936C (en) | 1998-12-01 |
Family
ID=27549159
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CA 2090936 Expired - Fee Related CA2090936C (en) | 1992-03-04 | 1993-03-03 | Visual inspection support system for printed-circuit board |
Country Status (3)
| Country | Link |
|---|---|
| AU (1) | AU648458B2 (en) |
| CA (1) | CA2090936C (en) |
| GB (1) | GB2271683B (en) |
Families Citing this family (12)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| DE19650234C1 (en) * | 1996-12-04 | 1998-04-30 | Duerkopp Adler Ag | Object for marking a selection area in a work piece, in particular an animal skin |
| WO1999017102A1 (en) * | 1997-09-30 | 1999-04-08 | Siemens Aktiengesellschaft | A method of and apparatus for inspecting printed information |
| US8894259B2 (en) | 2009-09-22 | 2014-11-25 | Cyberoptics Corporation | Dark field illuminator with large working area |
| US8872912B2 (en) | 2009-09-22 | 2014-10-28 | Cyberoptics Corporation | High speed distributed optical sensor inspection system |
| US8670031B2 (en) | 2009-09-22 | 2014-03-11 | Cyberoptics Corporation | High speed optical inspection system with camera array and compact, integrated illuminator |
| US8681211B2 (en) | 2009-09-22 | 2014-03-25 | Cyberoptics Corporation | High speed optical inspection system with adaptive focusing |
| US8388204B2 (en) | 2009-09-22 | 2013-03-05 | Cyberoptics Corporation | High speed, high resolution, three dimensional solar cell inspection system |
| WO2011056976A1 (en) * | 2009-11-06 | 2011-05-12 | Cyberoptics Corporation | High speed optical inspection system with adaptive focusing |
| CN102879395A (en) * | 2011-07-11 | 2013-01-16 | 昆山华扬电子有限公司 | PCB auxiliary contraposition inspection device |
| JP5948797B2 (en) * | 2011-11-07 | 2016-07-06 | オムロン株式会社 | System, apparatus and method for supporting visual confirmation of inspection results |
| DE102016201803A1 (en) * | 2016-02-05 | 2017-08-10 | Baum Retec Ag | Screen reader |
| CN110567988A (en) * | 2019-10-16 | 2019-12-13 | 东莞市科纯电子有限公司 | Method and device for visually detecting quality of circuit board |
Family Cites Families (5)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| US4672437A (en) * | 1985-07-08 | 1987-06-09 | Honeywell Inc. | Fiber optic inspection system |
| JPH0737892B2 (en) * | 1988-01-12 | 1995-04-26 | 大日本スクリーン製造株式会社 | Pattern defect inspection method |
| WO1991007683A1 (en) * | 1989-11-09 | 1991-05-30 | Insystems, Inc. | Specimen review station |
| DE69112272T2 (en) * | 1990-05-21 | 1996-02-01 | Ntn Toyo Bearing Co Ltd | Method and device for laser processing. |
| WO1992011541A1 (en) * | 1990-12-21 | 1992-07-09 | Huntron Instruments, Inc. | Image acquisition system for use with a printed circuit board test apparatus |
-
1993
- 1993-03-03 GB GB9304354A patent/GB2271683B/en not_active Expired - Fee Related
- 1993-03-03 CA CA 2090936 patent/CA2090936C/en not_active Expired - Fee Related
- 1993-03-04 AU AU33992/93A patent/AU648458B2/en not_active Ceased
Also Published As
| Publication number | Publication date |
|---|---|
| CA2090936A1 (en) | 1993-09-05 |
| GB2271683B (en) | 1996-09-18 |
| GB9304354D0 (en) | 1993-04-21 |
| AU648458B2 (en) | 1994-04-21 |
| GB2271683A (en) | 1994-04-20 |
| AU3399293A (en) | 1993-09-23 |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| CA2090936C (en) | Visual inspection support system for printed-circuit board | |
| US7176881B2 (en) | Presentation system, material presenting device, and photographing device for presentation | |
| KR100963460B1 (en) | Automatic cutting device and production method for beveled product | |
| US5234665A (en) | Apparatus for measuring aggregation patterns on a microplate | |
| US4978224A (en) | Method of and apparatus for inspecting mounting of chip components | |
| EP0979431B1 (en) | Laser scanned menu | |
| US7149342B2 (en) | Device and method for investigating predetermined areas of printed circuit boards | |
| US20040245227A1 (en) | System and method for delivering an energy beam to selected impinge points on a work piece | |
| US20090090782A1 (en) | Alignment and non-alignment assist images | |
| JP3078668B2 (en) | Automatic glass scriber | |
| JP4901009B2 (en) | Perimeter | |
| JPS6118358B2 (en) | ||
| GB2169074A (en) | Line following system | |
| KR0129784B1 (en) | Apparatus for fire extinguishing utilizing spray wvisual inspection supporting system for printed circuit board ater | |
| US20030036808A1 (en) | Board work system having provision for establishing operating environment suitable for operator, and process of establishing the suitable operating environment | |
| JP2000321025A (en) | Device and method for detecting movement error of processor | |
| JP2944827B2 (en) | Visual inspection system | |
| JPH10135686A (en) | Data processing device and electronic components mounting apparatus | |
| JPH0786722A (en) | Automatic pattern corrector | |
| JP2983089B2 (en) | Enlargement confirmation device | |
| JPH08162799A (en) | Electronic part mounter | |
| JP4320149B2 (en) | Method for manufacturing a gaming machine | |
| JP2686129B2 (en) | Component mounting device | |
| JPH05190639A (en) | Method and device for focusing | |
| JP2000213921A (en) | Device and method for recognising image |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| EEER | Examination request | ||
| MKLA | Lapsed |