GB2317690A - Image processing in optical measuring apparatus - Google Patents

Image processing in optical measuring apparatus Download PDF

Info

Publication number
GB2317690A
GB2317690A GB9726124A GB9726124A GB2317690A GB 2317690 A GB2317690 A GB 2317690A GB 9726124 A GB9726124 A GB 9726124A GB 9726124 A GB9726124 A GB 9726124A GB 2317690 A GB2317690 A GB 2317690A
Authority
GB
United Kingdom
Prior art keywords
image
windows
point
gravity
side portion
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Granted
Application number
GB9726124A
Other versions
GB2317690B (en
GB9726124D0 (en
Inventor
Naoji Yamaoka
Koji Oda
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
Honda Motor Co Ltd
Original Assignee
Honda Motor Co Ltd
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Priority claimed from JP5337619A external-priority patent/JP2724961B2/en
Priority claimed from JP5337618A external-priority patent/JP2691683B2/en
Priority claimed from JP5337616A external-priority patent/JP2691681B2/en
Priority claimed from JP5337617A external-priority patent/JP2691682B2/en
Application filed by Honda Motor Co Ltd filed Critical Honda Motor Co Ltd
Priority claimed from GB9426222A external-priority patent/GB2285312B/en
Publication of GB9726124D0 publication Critical patent/GB9726124D0/en
Publication of GB2317690A publication Critical patent/GB2317690A/en
Application granted granted Critical
Publication of GB2317690B publication Critical patent/GB2317690B/en
Anticipated expiration legal-status Critical
Expired - Fee Related legal-status Critical Current

Links

Classifications

    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06TIMAGE DATA PROCESSING OR GENERATION, IN GENERAL
    • G06T7/00Image analysis
    • G06T7/0002Inspection of images, e.g. flaw detection
    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06TIMAGE DATA PROCESSING OR GENERATION, IN GENERAL
    • G06T7/00Image analysis
    • G06T7/70Determining position or orientation of objects or cameras
    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06TIMAGE DATA PROCESSING OR GENERATION, IN GENERAL
    • G06T2207/00Indexing scheme for image analysis or image enhancement
    • G06T2207/30Subject of image; Context of image processing
    • G06T2207/30108Industrial image inspection
    • G06T2207/30164Workpiece; Machine component

Landscapes

  • Engineering & Computer Science (AREA)
  • Computer Vision & Pattern Recognition (AREA)
  • Physics & Mathematics (AREA)
  • General Physics & Mathematics (AREA)
  • Theoretical Computer Science (AREA)
  • Quality & Reliability (AREA)
  • Length Measuring Devices By Optical Means (AREA)
  • Image Analysis (AREA)

Abstract

To determine the position of a bend in a workpiece, a flat beam of light is projected onto the workpiece, the resulting line S on the workpiece is imaged, windows W4-W7 are set on the straight portions S1,S2 of the line, equations of lines L1,L2 through the centres of gravity of the portions in the windows are determined, and their crossing point Q identifies the position of the bend. To overcome halation H, a reference point M used for setting the positions of windows is determined by first setting a window extending in the Y direction on each line portions S1,S2 at a predetermined distance behind the front endmost point of the line image. M is the point centrally between the centres of gravity of the imaged portions in these windows. To overcome unwanted reflections R, the area furthest in the X-direction is chosen to set the position of the Y-directed windows and to determine the centre of gravity in each windows W4-W7.

Description

METHOD OF IMAGE PROCESSING IN OPTICAL MEASURING APPARATUS The present invention relates to a method of image processing in an optical measuring apparatus using an optical cutting method.
The present application has been divided from UK Patent Application No. 9426222.7.
This kind of optical measuring apparatus comprises, as shown in Fig. 1A, a projector 1 which is made up of a slit laser or the like for radiating a slit light on a workpiece A and an image sensing device 2 which is made up of a CCD camera or the like for picturing that optical cutting image or optical cross-sectional image s of the workpiece A which is the image of the slit light formed on the surface of the workpiece A. The projector 1 and the image sensing device 2 are arranged in such a positional relationship that an optical axis of the projector 2 slantingly crosses a light plane of the slit light.
When the workpiece A is of a doglegged shape (i.e., is bent at an angle) in cross section as shown in Fig. 1A, there will appear on a screen of the image sensing device 2 a pictured optical cutting image which has a maximum portion in the direction of one of the coordinate axes on the screen, e.g., in the X-axis direction.
In this case, if the maximum portion is provided with a corner so that a maximum point (or a tip) can be clearly recognized, the shape and the position of the workpiece can be measured based on this maximum point.
However, if the maximum portion is round in shape, it is difficult to unambiguously determine the maximum point. In such a case, the following procedure has been considered. Namely, equations of lines to represent those portions of the pictured optical cutting image which are positioned on both sides, in the Y-axis direction, of the maximum portion are calculated. The position of the crossing point of the line on one side and the line on the other side, in the Y-axis direction, of the optical cutting image relative to the maximum portion is obtained from both the equations. The measurement of the workpiece is carried out by making this crossing point to serve as an alternative to the maximum point.
By the way, the pictured optical cutting image becomes a band-like image which has a certain width.
Therefore, when the equations of the line on one side and of the line on the other side, in the Y-axis direction, of the image portion are calculated, the following procedure will be followed. Namely, a plurality of windows are set on the image portion, and the position of center of gravity of image in each of these windows is measured to thereby calculate an equation of a curved line or a straight line which passes through these centers of gravity of image. This procedure has, however, the following disadvantage.
Namely, when the position of the workpiece changes relative to the optical measuring apparatus, the position of the pictured optical cutting image on the screen also changes. Therefore, if the windows are set in a certain fixed position of the screen, the windows may be placed away from the pictured optical cutting image, or the positions of setting the windows relative to the pictured optical cutting image may deviate from workpiece to workpiece. It is therefore necessary to displace also the position of setting the windows depending on the displacement of the pictured optical cutting image.
As a method of image processing to cope with this kind of requirement, there has hitherto been known one as described in Japanese Published Unexamined Patent Application No. 67200/1993 (corresponding to USP 5,311,289).
An explanation will now be made about the method of image processing as described in the above Patent Application based on an example in which a pictured optical cutting image has a maximum portion in the X-axis direction which is one of the coordinate axes of the screen. In this method, before setting predetermined windows respectively in one side portion and in the other side portion in the Y-axis direction relative to the maximum portion of the pictured optical cutting image, the position of a tip, in the X-axis direction, of the pictured optical cutting image is first measured. Then, at a position which is a predetermined length backwardly away from the tip in the X-axis direction, there are set two windows which are elongated in the Y-axis direction. According to this method, each of the windows falls in, or rests on, a predetermined portion of the pictured optical cutting image which extends towards one side and the other side in the Y-axis direction, while moving backwards away from the maximum portion in the X-axis direction.
Then, the positions of the centers of gravity in both the windows are measured. A point which has a correlation with both the centers of gravity, e.g., a middle point of a line segment connecting both the centers of gravity is obtained as a reference Point. A predetermined window is set respectively in one side portion and in the other side portion, in the Y-axis direction, of the pictured optical cutting image in a predetermined positional relationship with the reference point.
Here, the X-axis and the Y-axis coordinate values of the reference point come to almost accurately represent the displacements in the X-axis direction and in the Y-axis direction on the screen of the pictured optical cutting image. Therefore, even if the pictured optical cutting image may displace on the screen, each of the predetermined windows can be set in the one side portion and in the other side portion, in the Y-axis direction, of the pictured optical cutting image, in a constant positional relationship with these image portions based on the reference point. As a result, it becomes possible to calculate the equation of the image line on each side in the Y-axis direction at a higher accuracy based on the center of gravity in each of the predetermined windows. Based on that crossing point of both the image lines which is obtained by both the equations, the shape and the position of the workpiece can be accurately measured.
In case the workpiece A is a press-formed product (i.e., a product formed by pressing) which is doglegged in cross section as shown in Fig. 1A, the ridgeline of the workpiece A will be subjected to friction or rubbing by metallic molds and will therefore become mirror-finished or become as smooth as a mirror surface. As a result, there sometimes appears a pictured halation image H (or an image formed by halation) which is due to the reflected light from the ridgeline of the workpiece and which extends in the X-axis direction, in addition to the pictured doglegged optical cutting image S which has a maximum portion in the X-axis direction.
In case the workpiece A is S-shaped in cross section as shown in Fig. 2A, there will appear, as shown in Fig. 2B, not only an S-shaped pictured optical cutting image S having a maximum portion and a minimum portion in the X-axis direction, but also pictured reflected images R due to reflected images r of the optical cutting image S as reflected on the crossing planes on the bottom side of the workpiece A. Further, in case the workpiece A is a pressformed product, there may sometimes appear, as shown in Fig. 2C, a pictured halation image H in addition pictured reflected images R.
In the above-described conventional method of image processing, when this kind of pictured halation images or pictured reflected images appear, there are cases where the windows can no longer be set appropriately or where the centers of gravity of the pictured reflected images are detected as the centers of gravity of the images inside the windows. As a consequence, the image lines on both sides of the maximum portion of the pictured optical cutting image cannot be correctly calculated.
In view of the above-described points, the present invention has an object of providing a method of image processing in which the image lines on both sides of the maximum portion of the pictured optical cutting image can be correctly calculated even if there appear a halation image or reflected images.
According to the present invention, there is provided a method of image processing in an optical measuring apparatus which comprises a projector for radiating a slit light on a workpiece and an image sensing device for picturing an optical cutting image drawn by the slit light radiated on the workpiece and having a screen defining first and second coordinate axes, the optical cutting image on the screen of the image sensing device having a relative maximum portion and a relative minimum portion in the direction of the first coordinate axis of the screen of the image sensing device, the method comprising: setting predetermined windows in a plurality of positions on a first side portion of the optical cutting image which first side portion extends in the direction of the second coordinate axis of the screen, and away from said relative maximum portion in the direction of said first coordinate axis; calculating an equation of an image line which represents said first side portion from that position of center of gravity of image inside each of said windows which are set on said first side portion of the optical cutting image; setting predetermined windows in a plurality of positions on a second side portion of the optical cutting image, which second side portion extends in the direction of the second coordinate axis opposite to the direction of the first side portion, and away from the relative maximum portion in the direction of said first coordinate axis; calculating an equation of an image line which represents said second side portion from positions of centers of gravity of images inside said windows which are set on said second side portion of the optical cutting image; obtaining from both equations a position of a crossing point of the image line representing the first side portion and the image line representing the second side portion; wherein said method further comprises: selecting images above a predetermined area among independent images which appear on the screen of the image sensing device; measuring a front end point, which has a maximum coordinate value in the direction of said first coordinate axis, of each of the selected images; setting two windows which are oblong in the direction of said second coordinate axis at a position which is backwardly away by a predetermined length from a front endmost point which is defined as a point, among said front end points, that is positioned at a front endmost point in the direction of said first coordinate axis and measuring a position of a center of gravity of the image inside each of said two windows; obtaining a reference point which has a predetermined correlation with said center of gravity of image inside each of said two windows, said predetermined windows being set in a predetermined positional relationship with said reference point; selecting, in each of said predetermined windows, images which are above a predetermined area out of images inside each of said predetermined windows, said calculation of said equations being made by making the center of gravity of image, among the selected images, whose center of gravity is positioned in the front endmost point in the direction of said first coordinate axis, as the center of gravity of image inside each of said predetermined windows.
In case the reflected images appear on the screen, the reflected images sometimes become larger in area than the optical cutting image. It follows that, if the image processing is carried out by selected the image of the largest area in order to remove minute images which appear on the screen due to noises or the like, the reflected images may be selected, resulting in the wrong image processing.
Among the reflected images which are reflected to the crossing (or opposite) surface on the valley side of the workpiece, those which are positioned on the side opposite to the image sensing device will not be pictured by the image sensing device due to the angle of reflection and, therefore, the reflected images will appear in a position which is backwardly away in the X-axis direction relative to the pictured optical cutting image. It follows that, if the images above the predetermined area are selected in order to remove the images due to the noises and if the positions of the front end points, in the X-axis direction, of the selected images are measured, the front endmost point that is positioned in the X-axis direction among these front end points will coincide with the maximum portion of the pictured optical cutting image.
Therefore, if the two windows which are oblong in the Y-axis direction are set at a position which is backwardly away by a predetermined length in the X-axis direction from the front endmost point, each of the windows will rest on that predetermined portion of the pictured optical. cutting image which extends in the one direction and in the other direction respectively in the Y-axis direction while moving backwards away from the maximum portion. The X-axis and the Y-axis coordinate values of the reference point which has a predetermined correlation with the center of gravity of image inside the two windows almost accurately represent the displacement in the X-axis and the Y-axis directions of the pictured optical cutting image on the screen.
If each of the predetermined windows for the purpose of calculating the image lines is set based on this reference point, each of the windows rests accurately on the one side portion and the other side portion of the pictured optical cutting image while keeping a predetermined correlation.
In this case, there are cases where, aside from the pictured optical cutting image, reflected images may sometimes be contained as independent images inside each of the windows, Among the images above the predetermined area inside the windows, i.e., among the images except for the images due to noises, the image whose center of gravity of image is positioned in the front endmost point in the X-axis direction will be the pictured optical cutting image. It follows that, according to the present invention, it is possible to select the pictured optical cutting image, among the images inside the windows, and to accurately measure its center of gravity of image.
In this manner, even if there appear reflected images, the equations of the image lines on both side portions in the Y-axis direction of the pictured optical cutting image can accurately be calculated, and the measurement of the workpiece can be carried out at a higher accuracy based on the crossing point of both the image lines.
If the equations of the image lines on both sides in the Y-axis direction of the pictured optical cutting image are correctly calculated, the crossing point of both the image lines should be positioned in the neighborhood of the above-described front endmost point. Therefore, it is preferable to judge whether the image processing is acceptable or not by comparing the position of the crossing point and the position of the front endmost point.
For better understanding of the present invention and to show how it may be carried into effect, reference will now be made by way of example to the accompanying drawings in which: Fig. 1A is a perspective view showing the relationship between an optical measuring apparatus and a workpiece in measuring a doglegged sectional portion of the workpiece; Fig. 1B is a diagram showing the screen of an image sensing device; Fig. 2A is a perspective view showing the relationship between the optical measuring apparatus and a workpiece in measuring an S-shaped sectional portion of the workpiece; Fig. 2B is a diagram showing that screen of the image sensing device on which appear reflected images; Fig. 2C is a diagram showing that screen of the image sensing device on which appear reflected images and a halation image; Figs. 3A through 3E are diagrams showing the procedure of image processing of the screen shown in Fig.
lB; Fig. 4 is a diagram showing the method of setting remaining windows among predetermined windows; Fig. 5 is a diagram showing the method of setting a window for the other side portion of the image based on the selected window for the one side portion of the image; and Figs. 6A through 6D are diagrams showing the procedure of image processing the screen shown in Fig. 2C.
An explanation will now be made about an embodying example in which the present invention is applied to the image processing in the above-described optical measuring apparatus as shown in Fig. 1A.
On the screen of the image sensing device 2, there appear as shown in Fig. 1B a pictured optical cutting image S which has a maximum portion in the X-axis direction and a halation image H which crosses the maximum portion and extends in the X-axis direction. The image data of the image sensing device 2 are transmitted to an unillustrated image processing device in order to carry out the image processing in the following manner.
First, as shown in Fig. 3A, there is set a stationary window NO which covers substantially the entire region of the screen. A tip or a front end point (left end point) a' in the X-axis direction of the image inside the window WO is measured. This point a' is to coincide with the tip of the halation image H.
Then, based on the point a', there is set a first window W1 which is oblong in the X-axis direction so as to cover the point a'. Inside the window Wl there is contained the halation image H. Here, since the halation image H extends to both sides, in the X-axis direction, of the maximum portion such that the area on one side and the area on the other side, in the X-axis direction, of the halation image H become substantially equal to each other.
Therefore, the center of gravity Gl of image inside the first window W1 approximately coincides with the maximum portion of the pictured optical cutting image S. The position of the center of gravity G1 of image is then measured as an end point "a" coinciding with the maximum portion.
Next, a vertical pair of second and third windows W2, W3 which are oblong in the Y-axis direction are set, as shown in Fig. 3B, at a position which is backwardly away from the front end point "a" in the X-axis direction, i.e., at a position away to the right by a predetermined length. The position of gravity G2, G3 of image in each of the windows W2, W3 is measured, and there is obtained the position of a reference point M which has a predetermined correlation with both the centers of gravity G2, G3 of the images, e.g., a middle point of a line segment to connect both the centers of gravity G2, G3 of image. Here, the above-described second and the third windows W2, W3 will have been set in a predetermined positional relationship with the maximum portion.
Therefore, each of the second and the third windows W2, W3 will rest, in a predetermined relationship, on an upper portion or an upper side portion S1 and a lower portion or a lower side portion S2 of the pictured optical cutting image S which extends upwards and downwards in the Y-axis direction while moving away from, or going backwards to the right from, the maximum portion. It follows that, even if the pictured optical cutting image S may displace in the X-axis direction or the Y-axis direction on the screen due to the change in the relative positional relationship between the optical measuring apparatus and the workpiece A, the relative positional relationship between the reference point M that has a predetermined positional relationship with the centers of gravity G2, G3 of image inside both the windows W2, W3, and the pictured optical cutting image S is maintained constant.
Then, as shown in Fig. 3C, there are set fourth and sixth windows W4, W6 respectively on the upper side portion S1 and on the lower side portion S2 of the pictured optical cutting image S based on the reference point M. In concrete, a distance in the X-axis direction and a distance in the Y-axis direction of a left upper corner of the fourth window W4 and a lower left corner of the sixth window W6 relative to the reference point M are set in advance. The windows W4, W6 are then set according to these set values on the basis of the reference point M.
If each of the windows W4, W6 is set in this manner, each of them W4, W6 accurately rests on the upper side portion S1 and on the lower side portion S2 of the pictured optical cutting image S even if the pictured optical cutting image S may displace on the screen.
Thereafter, as shown in Fig. 3D, a fifth window W5 is set at a position which has a predetermined positional relationship with the position of the fourth window W4 and the position of the end point "a". In concrete, the fifth window W5 is set such that the left upper corner of the fifth window W5 coincides with such a position in which the ratio of distance in the Y-axis direction to the end point "a" to the distance in the Y-axis direction to the left upper corner of the fourth window W4 becomes a predetermined value, e.g., 1:1 and also in which the ratio of the distance in the X-axis direction to the end point "a" to the distance in the X-axis direction to the left upper corner of the fourth window W4 becomes a predetermined value, e.g., 1:2. A seventh window W7 is set at a position which has a similar correlation as that described above, relative to the position of the sixth window W6 and the position of the above-described end point "a". According to this arrangement, the fifth window W5 and the seventh window W7 rest on the upper side portion S1 and the lower side portion S2 of the pictured optical cutting image S, while maintaining a relative positional accuracy.
Then, as shown in Fig. 3E, the positions of the centers of gravity G4, G5 of image of the fourth and the fifth windows W4, W5 are measured to calculate the equation of an image line Ll on the upper side portion passing through both the centers of gravity G4, G5 of image. Also, the positions of centers of gravity G6, G7 of image of the sixth and the seventh windows W6, W7 are measured to calculate the equation of an image line L2 on the lower side portion passing through both the centers of gravity G6, G7 of image. From both the equations the position of the crossing point 9 is obtained.
In this case, if the equations for the image lines Ll, L2 are correctly calculated, the crossing point 0 is to be positioned in the neighborhood of the abovedescribed end point "a". Therefore, a determination is made as to whether the crossing point Q falls within a predetermined range which is set based on the end point "a". If it is outside the range, the image processing is judged to be unacceptable and a display is made to that effect.
Finally, coordinate values of the crossing point Q on the slit light plane is calculated according to the analytic principle of optical cutting from the coordinate values of the crossing point Q on the screen. Further, in order to correct the error due to the distortion of the lens system of the image sensing device 2, the deviation in relative positional relationship between the projector 1 and the image sensing device 2, or the like, the coordinate values of the crossing point Q on the slit light plane are corrected according to a correction formula to be obtained in advance by a calibration work of the optical measuring apparatus, and the shape and the position of the workpiece A are then measured.
If the workpiece A displaces in the direction of the optical axis of the slit light, the pictured optical cutting image S comes to displace on the screen in the Xaxis direction and, also, the rate of magnification of the image S comes to vary. Therefore, it is desired to change the positions and the sizes of the fourth through the seventh windows W4 - W7 depending on the rate of magnification of the image S so that the windows can be set at predetermined positions of the image S even if the image S is magnified or reduced. Here, let us define the rate of magnification to be K, the distance between the image sensing device 2 and the crossing point of the optical axis of the image sensing device 2 with the slit light plane to be D, the angle of the optical axis of the image sensing device 2 to the slit light plane to be 8, and the amount of X-axis displacement relative to the regular or ordinary position of the image S to be dx.
Then, the following formula can be established.
K = 1 + (dX / D) cote Therefore, the rate of magnification K can be calculated from the above formula by obtaining the amount of X-axis displacement of the pictured optical cutting image S from the position of the above-described end point "a", The distances of the fourth and the sixth windows W4, W6 in the Y-axis direction relative to the reference point M can be made to be the ones obtained by multiplying the set values by the value K. If the sizes of the fourth through the seventh windows W4 - W7 are also changed according to the rate of magnification K, it becomes possible to set each of the windows at a predetermined position of the pictured optical cutting image S even if the rate of magnification may vary.
In the above-described example, the fifth window W5 and the seventh window W7 are set at positions which have a predetermined correlation with the positions of the fourth window W4 and the sixth window. W6 as well as with the position of the end point "a". They may also be set, as shown in Fig. 4, at positions which have a predetermined correlation with the positions of the centers of gravity G4, G6 of image inside the fourth and the sixth windows W4, W6 as well as the end point "a". In the example shown in Fig. 4, the fifth window W5 is set such that the left upper corner of the fifth window W5 coincides with a middle point of a parallel line segment B' which is formed by a parallel movement forwards (to the left), in the X-axis direction, of a line segment B which connects the center of gravity G4 inside the fourth window W4 and the end point "a". Further, the seventh window W7 is set such that the left lower corner of the seventh window W7 coincides with a middle point of a parallel line segment C' which is formed by a parallel movement forwards, in the X-axis direction, of a line segment C which connects the center of gravity G6 of image inside the sixth window W6 and the end point "a".
Furthermore, in the above example, an arrangement has been made such that the fourth window W4 and the sixth window W6 are set according to positional data, which are determined in advance, based on the reference point M. It is however also possible to determine in advance only the positional data of one of the fourth and the sixth windows W4, W6 and to set the other of the windows based on the positions of the three items, i.e., one of the windows, the end point "a" and the reference point M.
This will now be explained in more detail with reference to Fig. 5. In this example, the positional data of the fourth window W4 are determined in advance. After the fourth window W4 has been set based on the reference point M, the sixth window W6 is set such that the left lower corner thereof coincides with a position in which the X-axis distance from the end point "a" becomes equal to the X-axis distance from the end point "a" in the left upper corner of the fourth window W4 and, also, in which the Y-axis distance from the reference point M downwards becomes equal to the Y-axis distance from the left upper corner of the fourth window W4. Here, since the reference point M is positioned in the middle, in the Y-axis direction, between the upper side portion S1 and the lower side portion S2 of the pictured optical cutting image S, even if the sixth window W6 is set as described above, the sixth window W6 rests on the lower side portion S2 while maintaining a relative positional accuracy.
The fifth and the seventh windows W5, W7 may be set according to the procedure as shown in Figs. 3C and 4.
Next, an explanation will be made about the image processing when the workpiece A of S-shape in cross section as shown in Fig. 2A is measured in the optical measuring apparatus.
It is assumed that there appear on the screen of the image sensing device 2, as shown in Fig. 2C, an S-shaped pictured optical cutting image S which has a maximum portion and a minimum portion in the X-axis direction, a halation image H which extends in the X-axis direction by crossing the maximum portion, two pieces of upper and lower reflected images R in a position which is backwardly away in the X-ax the noise images N are selected. In this case, the selected images are a combined image of the pictured optical cutting image S and the halation image H, and two pieces of reflected images R. Then, the positions of the front end points al, a2, a3 in the X-axis direction of each of these images are measured. Among the front end points the one that is located in the front endmost position in the X-axis direction is determined as the front endmost point a'. Here, since the reflected images R appear only on the right side, in the X-axis direction, of the optical cutting image S, this front endmost point a' coincides with the front end point of the halation image H.
Then, on the basis of this front endmost point a', a first window W1 which is oblong in the X-axis direction is set as shown in Fig. 6B such that the front endmost point a' is contained therein. The position of the center of gravity G1 inside the first window W1 is measured as an end point "a" which coincides with the maximum portion.
Next, a pair of upper and lower second and third windows W2, W3 which are oblong in the Y-axis direction are set as shown in Fig. 6C at a position which is backwardly away from the end point "a" by a predetermined length, i.e., at a position away to the right by a predetermined length. Then, the positions of the centers of gravity G2, G3 of image of both the windows W2, W3 are measured, and there is obtained the position of a reference point M which has a predetermined correlation with both the centers of gravity G2, G3 of image, e.g., a middle point of a line segment connecting both the centers of gravity G2, G3 of image.
Thereafter, based on the reference point M, there are set, as shown in Fig. 6D, fourth and fifth windows W4, W5 as well as sixth and seventh windows W6, W7 respectively on the upper side portion S1 and the lower side portion S2 of the pictured optical cutting image S.
In concrete, there are set in advance a distance in the Xaxis direction and a distance in the Y-axis direction between, e.g., the left upper corner of the each of the windows Wn (n = 4 through 7) and the reference point M, as well as the length in the X-axis direction and in the Yaxis direction of each of the windows Wn. Based on the reference point M each of the windows Wn is set in accordance with the set values or each of the windows Wn is set in a similar procedure as is used in the windows W4 through W7 shown in Figs. 3 through 5. If each of the windows Wn is set in this manner, each of the windows Wn accurately rests on the upper side portion S1 and the lower side portion S2 of the pictured optical cutting image S while maintaining a predetermined correlation, even if the pictured optical cutting image S may displace on the screen.
There are cases where reflected images R or noise images N appear inside the windows Wn. In order to avoid the possibility of wrongly measuring the center of gravity of an image which is different from the pictured optical cutting image S, which shall be made the object of measurement, as the center of gravity of the image of the pictured optical cutting image S, the center of gravity of image within each of the windows Wn is measured in the following manner. First, among the independent images inside the window, those images above a predetermined area are selected. This predetermined area is set to 1/2, preferably 2/3, of the average value of the pictured optical cutting images S inside the windows Wn. The noise images N contained inside the windows Wn can thus be surely removed. However, at this stage, reflected images R may sometimes be left by being selected together with the pictured optical cutting images S in the sixth and the seventh windows W6, W7. Therefore, by taking advantage of the characteristics that the pictured optical cutting image S is positioned in the forward (left) direction in the X-axis direction as compared with the reflected images R, a judgement is made that, among the selected images, the one that is present at the front endmost point in the X-axis direction is the pictured optical cutting image S.
The position of the center of gravity Gn of image is thus measured. It is also acceptable to respectively measure the center of gravity of image of each selected image and then to judge, among the centers of gravity, that the one at the front endmost point in the X-axis direction is the center of gravity Gn of the pictured optical cutting image. Anyway, it is acceptable as long as that position of center of gravity of image which is positioned in the front endmost point in the X-axis direction can be measured, among the selected images, as the position of center of gravity Gn of the image.
Then, an equation of that image line L1 on the upper side portion S1 which passes through the centers of gravity G4, G5 of image in both the fourth and the fifth windows W4, W5 is calculated. Also, an equation of that image line L2 on the lower side portion S2 which passes through the centers of gravity G6, G7 of image in both thesixth and the seventh windows W6, W7 is calculated. From both the equations the position of the crossing point Q of both the image lines Ll, L2 is obtained.
In this case, if the equations of both the lines L1, L2 are correctly calculated, the crossing point Q will be positioned in the neighborhood of that center of gravity G1 of image which is the above-described end point "a".
Therefore, a determination is made as to whether the crossing point Q falls within a predetermined range which is based on the center of gravity Gl of image. If it is outside the range, a judgement is made that the image processing is unacceptable and a display is made to that effect.
Finally, coordinate values of the crossing point 0 on the slit light plane are calculated from the coordinate values on the screen of the crossing point 9 according to the analytic principle of the optical cutting. Further, in order to correct an error due to the distortion of the lens system of the image sensing device 2, the deviation in the relative positional relationship between the projector 1 and the image sensing device 2, or the like, the coordinate values of the crossing point Q are corrected according to a correction equation to be obtained in advance by a calibration work of the optical measuring apparatus, and then the shape and the position of the workpiece A are measured.
In case, as shown in Fig. 2B, where a halation image does not appear, among those front end points of each of the images in the X-axis direction which are selected in the stationary window WO and which have an area above a predetermined area, the position of the front endmost point that is positioned in the front endmost point in the X-axis direction is measured as an end point "a".
Thereafter, the coordinates of the crossing point Q can be obtained in the similar procedure as shown in Figs. 6C and 6D.

Claims (2)

1. A method of image processing in an optical measuring apparatus which comprises a projector for radiating a slit light on a workpiece and an image sensing device for picturing an optical cutting image drawn by the slit light radiated on the workpiece and having a screen defining first and second coordinate axes, the optical cutting image on the screen of the image sensing device having a relative maximum portion and a relative minimum portion in the direction of the first coordinate axis of the screen of the image sensing device, the method comprising: setting predetermined windows in a plurality of positions on a first side portion of the optical cutting image, which first side portion extends in the direction of the second coordinate axis of the screen, and away from said relative maximum portion in the direction of said first coordinate axis; calculating an equation of an image line which represents said first side portion from that position of center of gravity of image inside each of said windows which are set on said first side portion of the optical cutting image; setting predetermined windows in a plurality of positions on a second side portion of the optical cutting image which second side portion extends in the direction of the second coordinate axis opposite to the direction of the first side portion, and away from the relative maximum portion in the direction of said first coordinate axis; calculating an equation of an image line which represents said second side portion from positions of centers of gravity of images inside said windows which are set on said second side portion of the optical cutting image; obtaining from both equations a position of a crossing point of the image line representing the first side portion and the image line representing the second side portion; wherein said method further comprises: selecting images above a predetermined area among independent images which appear on the screen of the image sensing device; measuring a front end point, which has a maximum coordinate value in the direction of said first coordinate axis, of each of the selected images; setting two windows which are oblong in the direction of said second coordinate axis at a position which is backwardly away by a predetermined length from a front endmost point which is defined as a point, among said front end points, that is positioned at a front endmost point in the direction of said first coordinate axis and measuring a position of a center of gravity of the image inside each of said two windows; obtaining a reference point which has a predetermined correlation with said center of gravity of image inside each of said two windows, said predetermined windows being set in a predetermined positional relationship with said reference point; selecting, in each of said predetermined windows, images which are above a predetermined area out of images inside each of said predetermined windows, said calculation of said equations being made by making the center of gravity of image, among the selected images, whose center of gravity is positioned in the front endmost point in the direction of said first coordinate axis, as the center of gravity of image inside each of said predetermined windows.
2. A method of image processing in an optical measuring apparatus according to claim 1, wherein a determination is made as to whether the image processing is acceptable or not by comparing the position of said crossing point and the position of said front endmost point.
GB9726124A 1993-12-28 1994-12-23 Method of image processing in optical measuring apparatus Expired - Fee Related GB2317690B (en)

Applications Claiming Priority (5)

Application Number Priority Date Filing Date Title
JP5337619A JP2724961B2 (en) 1993-12-28 1993-12-28 Image processing method in optical measuring device
JP5337618A JP2691683B2 (en) 1993-12-28 1993-12-28 Image processing method in optical measuring device
JP5337616A JP2691681B2 (en) 1993-12-28 1993-12-28 Image processing method in optical measuring device
JP5337617A JP2691682B2 (en) 1993-12-28 1993-12-28 Image processing method in optical measuring device
GB9426222A GB2285312B (en) 1993-12-28 1994-12-23 Method of image processing in optical measuring apparatus

Publications (3)

Publication Number Publication Date
GB9726124D0 GB9726124D0 (en) 1998-02-11
GB2317690A true GB2317690A (en) 1998-04-01
GB2317690B GB2317690B (en) 1998-05-20

Family

ID=27517274

Family Applications (2)

Application Number Title Priority Date Filing Date
GB9726124A Expired - Fee Related GB2317690B (en) 1993-12-28 1994-12-23 Method of image processing in optical measuring apparatus
GB9726129A Expired - Fee Related GB2317691B (en) 1993-12-28 1994-12-23 Method of image processing in optical measuring apparatus

Family Applications After (1)

Application Number Title Priority Date Filing Date
GB9726129A Expired - Fee Related GB2317691B (en) 1993-12-28 1994-12-23 Method of image processing in optical measuring apparatus

Country Status (1)

Country Link
GB (2) GB2317690B (en)

Families Citing this family (2)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US6693292B1 (en) * 1999-06-30 2004-02-17 Vishay Infrared Components, Inc. Optical spot sensor
GB2401678B (en) * 2003-01-14 2005-08-17 Qti Presstech Ltd Improvements to scanning heads

Also Published As

Publication number Publication date
GB2317691A (en) 1998-04-01
GB2317690B (en) 1998-05-20
GB9726129D0 (en) 1998-02-11
GB2317691B (en) 1998-05-20
GB9726124D0 (en) 1998-02-11

Similar Documents

Publication Publication Date Title
US5249035A (en) Method of measuring three dimensional shape
US7321839B2 (en) Method and apparatus for calibration of camera system, and method of manufacturing camera system
US5311289A (en) Picture processing method in optical measuring apparatus
KR100686889B1 (en) Method for measuring diameter of cylindrical object in noncontact way
US5633950A (en) Method of image processing in optical measuring apparatus
US5608817A (en) Optical measuring method
JP6838225B2 (en) Stereo camera
GB2317690A (en) Image processing in optical measuring apparatus
JP2002099902A (en) Image processing device for measuring three-dimensional information of object through binocular stereoscopic vision, its method, and storage medium with measurement program stored therein
CN116105600B (en) Aiming target method based on binocular camera, processing device and laser tracker
KR101995344B1 (en) A dual depth camera module without blind spot
JP2691683B2 (en) Image processing method in optical measuring device
JP2691682B2 (en) Image processing method in optical measuring device
JP2724961B2 (en) Image processing method in optical measuring device
JP2691681B2 (en) Image processing method in optical measuring device
JP2523420B2 (en) Image processing method in optical measuring device
JP2552966B2 (en) Correction method of error in optical measuring device
JP2520804B2 (en) Image processing method in optical measuring device
JP2932083B2 (en) Shape measurement method
KR19990023868A (en) Distance measuring method
JP7083014B2 (en) Stereo camera
JP2737045B2 (en) How to measure gaps and steps
JP2559646B2 (en) Image processing method in optical measuring device
JP2694504B2 (en) Position measurement method of stepped work
JP3068884B2 (en) Multi-point distance measuring device

Legal Events

Date Code Title Description
PCNP Patent ceased through non-payment of renewal fee

Effective date: 20031223