JP2003141511A - Method, apparatus and program for recognizing three- dimensional configuration - Google Patents

Abstract

PROBLEM TO BE SOLVED: To provide a means for recognizing a three-dimensional configuration capable of quickly calculating the position and attitude of a three-dimensional object and easily obtaining items of a standard object to be collated with the object of interest. SOLUTION: The coordinate system of the standard object is formed from the three- dimensional coordinates and normal vector of a reference point determined on the standard object in a map image and from the three-dimensional coordinates of each of a plurality of teaching points, and the normal vector of the object surface is determined (S3) as the plane coordinates of the map image of the object of interest are scanned. The axis of the coordinate system of the standard object is aligned with the normal vector (S4), and each time the coordinate system is rotated a predetermined angle about the normal vector (S5), errors in height relative to the surface of the object of interest are determined for each teaching point and integrated for each rotational angle (S9). If a minimal integrated value of the errors is smaller than a predetermined threshold throughout the scans, the object of interest is determined to be the same as the standard object, and the position and attitude of the object of interest are determined from the three-dimensional coordinates, normal, and rotational angle of the reference point which provides the minimal integrated value of the errors.

Description

Detailed Description of the Invention

[0001]

BACKGROUND OF THE INVENTION 1. Field of the Invention The present invention relates to a reference object teaching method and a target object position / orientation detection method in a three-dimensional object recognition apparatus using a range image.

[0002]

2. Description of the Related Art A recognition technique for knowing the position and orientation of an object using an image of the object is essential for automated work, especially for automatic work by a robot. It is necessary to recognize an object accurately and quickly. For more practical use,
It would be desirable to be able to do this with inexpensive equipment. As a method of detecting a three-dimensional pattern in a three-dimensional image, recognizing it as an object and determining its position and orientation, there is a method of comparing the object in the image with a predetermined reference object for determination.
Conventionally, there has been no method that has been put to practical use to the point where it can be used by being attached to a robot device or the like. This is because a three-dimensional object has six degrees of freedom, the actual object shape is diverse, and the appearance in the image is also diverse. This is because a huge amount of processing time is required unless only the object that has the object is handled or the position and orientation of the object are not restricted.

[0003] Japanese Patent Laid-Open No. 10-899603 discloses a method of determining the position and orientation by collating an image with three-dimensional CAD data. According to the disclosed method, a C image is captured in the same image with respect to a captured image of an object manufactured by CAD.
The position and orientation of the CAD data image virtually drawn from the AD data is changed, and the position and orientation of the target object is estimated from the position and orientation data when the CAD data image overlaps with the imaged object image. This disclosed method does not try to detect an object that matches the model from the captured screen, and
In order to match the posture of the AD data image with the actual image, CA
The processing time of the parallel movement and the rotation movement applied to the D data image becomes enormous. Furthermore, in order to obtain an accurate three-dimensional position, it is necessary to use two or more captured images acquired from different directions, so it is difficult to simplify and reduce the cost of the device.

[0004]

Therefore, the problem to be solved by the present invention is a new three-dimensional shape recognition method and apparatus capable of quickly calculating the position and orientation of a target object, which is a reference object to be collated with the target object. It is also to provide the specifications of can be easily obtained.

[0005]

In order to solve the above-mentioned problems, a three-dimensional shape recognition method of the present invention is a three-dimensional coordinate of a reference point determined on a reference object based on a distance image of the reference object and the reference point. A standard object coordinate system is formed by obtaining the three-dimensional coordinates of the normal vector set up to the above and a plurality of appropriately defined teaching points. Further, a distance image is acquired for the target object. While scanning on the plane coordinates of the acquired target object distance image, the normal vector on the surface of the target object is obtained, and the normal vector of the reference object is matched with the normal vector, and the reference object coordinate system is set around the normal vector. After rotating by a predetermined angle, a height error with respect to the surface of the target object is obtained for each teaching point and integrated for each rotation angle. When the required scan is completed, the minimum error integrated value is extracted through the scan. If the error accumulated value is smaller than a predetermined threshold value, it is determined that the target object is the same as the reference object, and the position of the target object is determined by the three-dimensional coordinates of the reference point, the normal line, and the rotation angle that give the minimum error accumulated value. It is characterized by determining the posture.

Here, the distance image refers to a stereoscopic display drawing in which the height Z from the reference surface to the object surface is given as a value of XY coordinates. The range image corresponds to a quadratic plane image in which the brightness display on the imaging screen is changed to the height display, and is similar to the topographic map. The distance image can be formed by developing the height information of the object surface measured from the XY plane based on the distance data obtained by measuring the distance from one viewpoint to the object surface. As a device for measuring the distance from one viewpoint, a laser spot scanning device for calculating the reflection position of the laser spot by triangulation and calculating the distance, or irradiating the laser in a slit shape to determine the distance from the shape of the reflection line to the target all at once. Any desired laser slit scanner can be used.

The measuring device for generating the range image is
In addition to this, there is a three-dimensional shape measuring device using the spatial coded pattern projection. In addition, the reference object coordinate system uses a reference point that is appropriately determined on the object as an origin, and a normal line that stands at the reference point is 1
A relative coordinate system having individual coordinate axes is preferable. This is because if the teaching points appropriately determined on the surface of the reference object are plotted in such a reference object coordinate system, the superposition processing can be performed more easily in the range image of the target object.

According to the three-dimensional shape recognition method of the present invention, the image of the target object acquired as the range image is scanned on the screen, and the mechanical and simple procedure is repeated, so that the reference object image is extremely fast. Collate with
It is possible to detect the target object and estimate the position and orientation.
In addition, although the reference object is collated with the target object while performing coordinate conversion, in order to perform the search processing by matching the normal line set at the calculated position of the target object with the axis of the reference object coordinate system, Since the search operation can be limited to the rotation with the axis fixed, high speed processing is possible.

That is, for example, while moving the calculation position by the raster scan in which the main scanning is performed in the X direction and the sub scanning is performed in the Y direction on the screen, the normal line is obtained based on the shape of the neighborhood at each position. Next, superimpose the coordinate axis of the reference object coordinate system on this normal line and rotate the reference object image around the coordinate axis by a predetermined angle, and calculate the error from the target object image for each teaching point on the reference object coordinates. When the angle at which the error integrated value becomes the minimum is detected by integrating over all the taught points and the error integrated value at this angle becomes smaller than a predetermined threshold value, the calculated position and its normal line, angle, error integrated value And so on.

Such an error integrated value calculating procedure is repeatedly executed for each calculation position, and when the scanning is completed for the entire area or an appropriate area, the calculated error integrated values are compared and the minimum or XY plane is set. The calculation position showing the minimum value is calculated with. Then, the calculated position indicating the minimum (minimum) error integrated value is the reference point position of the target object, and the orientation of the target object is given from the normal direction and the rotation angle. The error integrated value may be an integrated value of absolute differences between the height of the teaching point and the height of the object surface in the distance image coordinate system. Since the absolute value of the difference can be easily obtained, the calculation time can be saved. Of course, other evaluation methods such as a value obtained by squaring an error and integrating the values may be used.

Further, the calculation position is limited to a position where the height value at the coordinate position is larger than a predetermined threshold value, and the calculation is executed only for the position in the range image where the target object may exist. You may do it. By omitting the calculation in this way, the calculation time can be greatly saved. The distance image of the reference object used to determine the reference object coordinate system may be, for example, a mathematical plot using CAD data. It can be obtained by designating a reference point or a teaching point using the acquired distance image.

As described above, if the actual object is used as a distance image as it is, the reference object coordinate system can be easily formed even if the computer does not have the design data. If there is no surface height data of the target object at the position corresponding to the teaching point, the error data about the teaching point may be ignored. This is because the distance data measured from one viewpoint lacks a distance image at a position that cannot be seen from that viewpoint, and thus may become a large disturbance factor if appropriate processing is not performed.

Further, in order to solve the above problems, the three-dimensional shape recognition apparatus of the present invention comprises a range image acquisition device and an image processing device, and the range image acquisition device acquires a range image of a target object and performs image processing. The device is provided with a storage device for storing a reference object coordinate system having a reference point of the reference object as an origin and a normal line set up at the reference point as one coordinate axis, and for the range image of the target object input from the range image acquisition device, While scanning the screen, calculate the normal vector of the surface of the target object that stands at the coordinate points, match the origin of the reference object coordinate system and the coordinate axis with the normal vector, and make the reference object coordinate system a predetermined angle around the normal vector. The target object surface is the same as the reference object when the height error of the target object surface is calculated for each teaching point and integrated for each rotation angle, and the minimum error integrated value during scanning is smaller than the threshold value. It recognized, that with a rotation angle and its minimum error integrated value plane coordinates and normals gave characterized by determining the position and orientation of the target object.

The distance image acquiring device is a device for converting the height information from the reference plane using the distance information from the measuring device measured by the laser slit scan to the surface of the object to generate the distance image. Good. The reference object coordinate system may be obtained by the image processing device based on the distance image of the reference object obtained by the distance image acquisition device. Further, the image processing device, in the vicinity of the position and orientation of the target object once obtained, changes the reference object coordinate system at a finer rotation angle to obtain a rotation angle at which the error integrated value becomes the minimum, and a more precise position is obtained. The attitude may be determined.

The three-dimensional shape confirmation device of the present invention can be constructed using a computer device. The computer device operates a three-dimensional shape recognition program to obtain three-dimensional coordinates of a reference point of the reference object, a normal vector, and three-dimensional coordinates of a plurality of teaching points based on the distance image of the reference object, and then performs the reference. A means for forming an object coordinate system, a means for acquiring a distance image of a target object by a distance image acquisition device, and a means for capturing the generated image signal, and a surface of the target object while scanning on a plane coordinate related to the image signal of the target object distance image. The normal vector of the target object is matched with the normal vector of the target object surface, and the normal object coordinate system is rotated by a predetermined angle around the normal vector. A means for calculating the height error of the object surface and integrating it for each rotation angle, a means for comparing the minimum error integrated value through scanning with a predetermined threshold, and an error integrated value When it is smaller than the threshold, it recognizes that the target object is the same as the reference object, and it can function as a means to determine the position and orientation of the target object based on the coordinates of the reference point, the normal, and the rotation angle that gave the integrated value. it can.

The above three-dimensional shape recognition program is
By storing in a computer-readable recording medium such as a CD-ROM, a DVD disc, a memory stick, and a storage device in the computer main body, a novel computer can be used as the three-dimensional shape recognition device of the present invention. Further, it can be stored in a portable recording medium and distributed.

[0017]

BEST MODE FOR CARRYING OUT THE INVENTION The present invention will be described below in detail based on embodiments with reference to the drawings. The three-dimensional shape recognition apparatus of the present embodiment is for recognizing a target object and determining the position and orientation by aligning using a standard object coordinate system which is a relative coordinate system for displaying a standard object. Then, while scanning the distance image plane, the normal line of the object surface is obtained for each scanning point, the axis of the reference object coordinate system is aligned with this normal line, and rotation processing is performed, and the position where the reference object and the target object match By recognizing that the target object is the same as the reference object, the position and orientation of the target object are determined based on the position and orientation of the reference object coordinate system when the target object is the same as the reference object.

FIG. 1 is a flow chart showing a procedure for determining the position and orientation of a target object in this embodiment, FIG. 2 is a flow chart showing a procedure for calculating a reference object coordinate system in this embodiment, and FIG. 3 is a configuration of this embodiment. 4 is a block diagram showing an example of creating a distance image, FIG. 5 is a diagram explaining a procedure for obtaining a coordinate system for a reference object, FIG. 6 is a diagram showing an example of a reference object coordinate system, and FIG. FIG. 8 is a conceptual diagram illustrating a procedure of fitting a reference object, FIG. 8 is a drawing showing a distance image of a target object, and FIG. 9 is a drawing showing a scanning method of observation points.

As shown in FIG. 3, the three-dimensional shape recognition apparatus of this embodiment comprises an image acquisition apparatus 1 and an image processing apparatus 2. The image processing device 2 includes an image capturing unit 21, a storage device 22 including a frame memory, and an arithmetic unit MPU 23. The image processing apparatus 2 can be configured by a simple computer system such as a personal computer.

As shown in FIG. 4A, the image acquisition device 1 is equipped with a laser spot scanner 11 to measure the shape of the target object 3. The laser spot scanner 11 irradiates a target with laser light that scans in a plane, and calculates the distance to the target by the triangulation method based on the position where the reflected light from the surface enters a photodetector such as a linear sensor. To do. When a laser slit scanner is used, a flat-plate laser is emitted all at once, so that the optical system can be simplified and the manufacturing cost can be reduced. The distance data from one viewpoint thus collected is fetched into the image processing device 2 through the image fetching unit 22, developed by the arithmetic unit 23 in the direction perpendicular to the reference plane, and converted into height data of the object surface. Then, it is recorded in the frame memory in the storage device 22.

The data in the frame memory represents the height from the reference plane for each point on the XY plane as Z, and corresponds to the topographic map of an object placed on the reference plane. If the value stored in the frame memory is converted into luminance and displayed on the display, the higher the portion, the stronger the luminance is expressed, and the object image can be obtained as a stereoscopic image that is easily visually recognized. Further, as shown in FIG. 4B, it can be obtained as a plane image in which the height is represented by contour lines.

When measuring the object surface 31 from one viewpoint, the shaded portion 32 where the light ray does not reach becomes the portion 33 lacking the distance data when the distance image is formed. In order to supplement such a data missing portion 33, the distance image may be created in consideration of the data measured from another viewpoint.
However, when it is applied to a robot hand or the like, it is possible to recognize an object or the like with a required accuracy even if such a missing portion exists in a part, and therefore, one laser spot scanner 11 is used. It is possible to generate and use a distance image based on distance data from one viewpoint.

In order for the three-dimensional shape recognition apparatus of the present embodiment to recognize the target object, it is necessary to store the shape model of the reference object in advance. Therefore, a reference object representing an object to be recognized is measured by an image acquisition device, a distance image of the reference object is acquired, and the distance model is directly used to teach a standard model. The coordinate system fixed relatively to the reference object is called the reference object coordinate system.

FIG. 2 is a flow chart showing a procedure for calculating the reference object coordinate system, and FIG. 5 is a drawing showing a distance image of the reference object for a T-shaped pipe joint. In FIG. 5, the height from the surface is represented by contour lines for monochrome expression. The reference object is measured using the image acquisition device 1, a distance image of the reference object is created by the image processing device 2, and this data is represented in the Cartesian coordinate system XYZ and stored in the frame memory (S21). Here, the Z axis represents the height from the reference plane. In addition, this XYZ
Since the coordinate system is a coordinate system fixed to the range image, it may be referred to as a range image coordinate system below.

The operator designates the recognition reference point O at an appropriate position on the reference object by using a pointing device such as a mouse while observing the distance image on the display. The distance image may represent height by brightness or color, or may represent height by contour lines. When the reference point O is designated, the image processing device 2 uses the surface position data in the vicinity of the reference point O and the normal line No.
Is calculated (S22). In addition, the reference point O is the origin, the normal number standing at the reference point is the W axis, and the appropriate direction perpendicular to the W axis is U.
An orthogonal coordinate system UVW having a V axis in a direction perpendicular to the axes, the U axis and the W axis is configured (S23).

The normal No standing at the recognition reference point O determines the axial direction of the UVW coordinate system, so the direction needs to be stable. However, the position of the surface of the object is uneven, if at all. Since the direction of the normal changes greatly if deviated, it is preferable to set the reference point O by selecting a smooth surface of the reference object. Further, since the U axis serves as a rotation reference of the coordinate system, it is preferable to select a direction that is easy to understand in relation to the shape of the reference object.

Next, an appropriate number of appropriate positions on the surface of the reference object are designated as teaching points. When each teaching point J is designated, the XYZ coordinate values (xj, yj, zj) of the teaching point are calculated (S24). The teaching point J is appropriately representative of the shape of the reference object, and an appropriate position is selected so as not to be confused with other shapes. The teaching point J is subjected to coordinate conversion and expressed as a coordinate point (uj, vj, wj) on the UVW coordinate system (S25). Figure 6
[Fig. 6] is a drawing showing an example of a reference object coordinate system created for a pipe joint. The teaching point J is fixed to the coordinate system by the relative positional relationship with respect to the reference point O. The specifications of the reference object coordinate system thus configured are stored in the storage device 22.

In this way, the reference object coordinate system UVW having the teaching points, which should be the characteristic points of the reference object, can be constructed. The UVW coordinate system is a relative coordinate system that can be relatively moved on a range image coordinate system XYZ fixed to a range image of an object to be recognized. The reference object coordinate system of this embodiment can be configured by measuring an actual object that can be identified as a target object, and does not require sophisticated processing using design data such as CAD. Further, the amount of information carried by the reference object coordinate system is extremely small. Therefore, a simpler device can be utilized.

The three-dimensional shape recognition apparatus of this embodiment identifies the target object and determines the position and orientation by the procedure shown in FIGS. Measure the target object and create a range image,
This data is represented in the distance image coordinate system XYZ and stored in the frame memory (S1). When the T-joint placed in a random manner is measured, for example, a distance image as shown in FIG. 8 can be obtained. In FIG. 8, the height is represented by contour lines as in FIG. 5, but it may be represented by luminance. Since the identification of the target object and the determination of the position and orientation are automatically performed, it is not necessary to display it on the display. Of course, it is useful for the operator to display a distance image or the like for the purpose of monitoring.

Next, as shown in FIG. 9, in the XY plane on the frame memory, as in the raster scan, the X
By performing main scanning in the Y direction and sub scanning in the Y direction, the entire target area is uniformly scanned. Each time the scanning point I is moved (S2), the Z coordinate value zi at the scanning point I is read out, and the observation point Mi (xi, yi, zi) is determined.
Further, the normal vector Ni standing at the observation point Mi is obtained from the distance image in the vicinity thereof (S3). Since it is useless to perform the calculation for obtaining the normal line in a place where the surface of the object is not present, when the Z coordinate zi at the scanning point I is smaller than a predetermined threshold value, it is considered that there is no object and the calculation is omitted. You may make it move to the position of.

Once the normal vector Ni has been obtained, FIG.
As shown in (a), the reference object coordinate system UVW is called, and its origin O is superimposed on the observation point Mi. Furthermore, FIG.
As shown in (b), the UVW coordinate system is tilted with the origin O as a fulcrum so that the W axis overlaps the normal vector Ni (S4). The UVW coordinate system in which the W axis and the normal vector Ni coincide with each other is represented by (Ut, Vt, Wt). UtV
The position error with respect to the object surface is calculated while rotating the tWt coordinate system around the Wt axis by a predetermined angle (S5). At this time, it is necessary to define the rotation angle in association with the distance image coordinate system, for example, determining the rotation angle with reference to the direction in which the Ut axis is parallel to the X axis of the distance image coordinate system.

Teaching point J on the rotated UtVtWt coordinate system
The position of (uj, vj, wj) is XYZ which is an absolute coordinate system.
Represented by coordinate values (xj, yj, zj) on the coordinate system (S
6). In this embodiment, for simplification, the deviation between the teaching point J and the surface of the target object is grasped by the difference in the Z-axis direction. For this reason,
The object surface height zoj at XY coordinates (xj, yj) is read from the range image data stored in the frame memory. That is, the corresponding point M on the object surface corresponding to the teaching point J
The coordinates of j are (xj, yj, zoj) (S7). From this result, the Z-direction distance between the teaching point J and the corresponding point Mj is calculated to obtain the error distance absolute value | zj-zoj | (S
8).

This method is simple in calculation because the deviation between the target object and the reference object is evaluated not by the corresponding points on the shape but by the deviation in the Z-axis direction. In addition,
Depending on the orientation of the target object, the data of corresponding points may be missing due to shadows at the time of measurement, but when using many teaching points, matching with the reference object is ignored even if the corresponding points lacking data are ignored. It is not a serious error in judging.
Further, the deviation in the Wt-axis direction may be used as the index of the deviation, but the calculation becomes more complicated, so the deviation in the Z-axis direction is used in this embodiment.

The absolute values of the error distances obtained by repeating the above method for all the teaching points J on the UtVtWt coordinate system are integrated to obtain the residual absolute value sum SAD (S9). If the target object exactly matches the reference object, the SAD becomes zero, and the larger the deviation, the larger the SAD. Therefore, the SAD is a good evaluation function for determining the match with the reference object. It goes without saying that other evaluation functions such as those based on the square value may be used instead of the absolute value of the error. SAD is calculated for each rotation angle.

Among the SADs for each angle collected by rotating once around the Wt axis, the condition at the angle where the SAD is the minimum is recorded in the storage device (S10). The conditions to be recorded are the coordinates (xi, yi, zi) of the observation point Mi, the normal vector Ni, the rotation angle at which the SAD is minimized, and the SA at that time.
D and so on. At this time, in order to exclude cases in which there is no need to consider the possibility of matching with the reference object, an appropriate threshold value may be used and recording may be performed only when SAD is smaller than the threshold value.

When the above calculation is completed for one scanning point I, the next scanning point I is moved to and the same calculation is repeated to scan the entire screen. If the target is limited, the area to be scanned may be limited in advance. When the scanning of the required area is completed, the observation point where SAD is smaller than a predetermined threshold value is detected. As shown in FIG. 7C, the target object having such an observation point has the same shape as the reference object, and the orientation of the target object is determined by the orientation of the normal vector at the observation point and the rotation angle of the reference object coordinate system. Can be determined (S11).

When the observation points satisfying the conditions are aggregated, the most appropriate position and orientation can be determined by extracting the observation points that are the minimum. When there are multiple observation points that satisfy the conditions at distant positions, there are multiple objects that can be identified as the reference object in the target range image. The position and orientation can be determined by the line vector and the rotation angle.

Further, in order to accurately measure the posture of the target object, the observation points that meet the conditions are extracted from the SAD results obtained by the above-mentioned scanning, and the notches are made finer in the vicinity of the rotation angle. SAD is calculated as
It suffices to find the rotation angle having AD and determine the corresponding posture. In addition, in order to obtain the position of the target object more precisely, the above operation is performed by further reducing the interval between the operation positions in the vicinity of the scanning point corresponding to the observation point obtained above.
The position may be determined by obtaining the minimum value of SAD.

When a plurality of reference objects having different shapes are targeted, one range image is acquired and the above procedure is repeated for each reference object to identify the target object and determine the position and orientation. You can make a decision. Further, it goes without saying that the target reference object does not need to be an independent article and may be a part of the article. When assisting the grasping of the robot, it suffices to extract and detect the portion to be grasped and determine the posture and the like. In addition, the position and orientation of a person's face can be detected by using the nose as a reference object, for example.

When the image processing apparatus is composed of an electronic computer system, a computer program for imparting a function of executing each of the above procedures may be loaded and used in the computer apparatus. The computer program is a CD
-It can be stored in a portable recording medium such as a ROM, a DVD, or a memory card and distributed. It can also be recorded in an EEPROM or the like set in the apparatus and used.

[0041]

As described above, according to the three-dimensional shape recognition method and apparatus of the present invention, a range image is used,
The reference object can be taught easily by designating one reference point and an appropriate number of teaching points. In addition, the distance image of the target object is automatically scanned and calculated to obtain the normal vector, and the target object is identified and the position and orientation are determined by a simple and high-speed calculation process using rotation around one axis of the reference object coordinate system. Since it is performed, it can be processed in a sufficiently practical time even when applied to picking by a robot.

[Brief description of drawings]

FIG. 1 is a flowchart showing a procedure for determining the position and orientation of a target object in one embodiment of a three-dimensional shape recognition device of the present invention.

FIG. 2 is a flowchart showing a procedure for calculating a reference object coordinate system in the present embodiment.

FIG. 3 is a block diagram showing the configuration of this embodiment.

FIG. 4 is a diagram illustrating an example of creating a range image according to the present embodiment.

FIG. 5 is a diagram illustrating a procedure for obtaining a coordinate system of a reference object in this embodiment.

FIG. 6 is a diagram showing an example of a reference object coordinate system of the present embodiment.

FIG. 7 is a conceptual diagram illustrating a procedure of fitting a reference object in the present embodiment.

FIG. 8 is a drawing showing an example of a distance image of a target object in the present embodiment.

FIG. 9 is a drawing showing a method of scanning an observation point in the present embodiment.

[Explanation of symbols]

1 Image acquisition device 11 Laser spot scanner 2 Image processing device 21 Image capture unit 22 Memory 23 Arithmetic unit 3 target object 31 Object surface 32 shade 33 Data missing part

Continued front page    F term (reference) 2F069 AA66 GG07 GG71                 5B047 AA07 BB01 BC11 BC14 BC23                       CB22 DC09                 5B057 AA05 BA02 BA15 BA23 DA07                       DB03 DB08 DC08                 5L096 AA07 AA09 BA05 CA18 CA25                       DA02 FA66 FA67 FA69

Claims (12)

[Claims] 1. A reference object coordinate system is obtained by obtaining three-dimensional coordinates of a reference point of the reference object, a normal vector set at the reference point, and three-dimensional coordinates of a plurality of teaching points based on a distance image of the reference object. Form the target object, obtain a distance image about the target object, obtain the normal vector on the surface of the target object while scanning the plane coordinates of the target object distance image, and use the normal vector of the reference object as the normal vector on the surface of the target object. The reference object coordinate system is made to coincide with each other by rotating the reference vector by a predetermined angle, and the height error of the surface of the target object is obtained for each teaching point and integrated for each rotation angle. , When the error integrated value, which has been minimized through scanning, is smaller than a predetermined threshold value, it is recognized that the target object is the same as the reference object, and the coordinates, normal line, and rotation of the reference point giving the integrated value are recognized. Position and shape of the target object with a corner A three-dimensional shape recognition method characterized by determining a force. 2. The distance image is developed as height information of the object on plane coordinates based on distance data obtained by measuring the distance from one viewpoint to the surface of the object. The three-dimensional shape recognition method described in 1. 3. The teaching point coordinates of the reference object are plotted on a three-dimensional reference object coordinate system having the reference point as an origin and a normal line standing at the reference point as one coordinate axis. The three-dimensional shape recognition method according to claim 1 or 2. 4. The accumulated error value is a sum of absolute values of a difference between a height of a teaching point of a reference object coordinate system and a height of an object surface in a distance image coordinate system. The three-dimensional shape recognition method according to any one of 1 to 3. 5. The scanning on the range image plane coordinates is characterized in that the fitting operation of the reference object coordinate system is omitted when the height value is smaller than a predetermined threshold value.
The three-dimensional shape recognition method according to any one of 1. 6. A three-dimensional shape recognition device comprising a distance image acquisition device and an image processing device, wherein the distance image acquisition device acquires a distance image of a target object, and the image processing device has a reference point of a reference object. Input from the distance image acquisition device, which is provided with a storage device for storing a reference object coordinate system in which the coordinates of a plurality of teaching points are plotted in three-dimensional coordinates with one normal axis that is the origin and a normal line set as a reference point. For the range image of the target object, the normal vector of the target object standing at the coordinate point while scanning the screen is calculated, and the normal vector of the target object is made coincident with the origin of the reference object coordinate system and the coordinate axis. The reference object coordinate system is rotated by a predetermined angle around the normal vector, the height error of the target object surface is obtained for each teaching point, and the error is integrated for each rotation angle. Predetermined value When the error integrated value is smaller than the threshold value, it is recognized that the target object is the same as the reference object, and the plane coordinates, the normal line, and the rotation angle that give the minimum error integrated value A three-dimensional shape recognition device including an image processing device that determines the position and orientation of a target object. 7. The distance image acquiring device generates a distance image by converting the height information from the reference plane using the distance information from the measuring device to the surface of the object measured by the laser slit scan. The three-dimensional shape recognition device according to claim 6. 8. The three-dimensional shape according to claim 6, wherein the reference object coordinate system is obtained by the image processing device based on a distance image of the reference object obtained by the distance image acquisition device. Recognition device. 9. The rotation angle at which the error integrated value is minimized by changing the reference object coordinate system by a finer rotation angle in the vicinity of the position and orientation of the target object once obtained by the image processing apparatus. 9. The three-dimensional shape recognition device according to claim 6, wherein the three-dimensional shape recognition device is configured to determine and more accurately determine the position and orientation. 10. A computer for determining a three-dimensional shape of an object is provided with a plurality of three-dimensional coordinates of a reference point of the reference object, a normal vector set at the reference point, and a plurality of normal vectors based on a distance image of the reference object. Regarding the means for obtaining the three-dimensional coordinates of the teaching point to form the reference object coordinate system, the means for capturing the image signal generated and generated by the distance image acquisition device for the target object, and the image signal for the target object distance image. Means for obtaining a normal vector on the surface of the target object while scanning on the plane coordinates, and matching the normal vector of the reference object with the normal vector of the surface of the target object to set the reference object coordinate system to the normal vector of the normal vector. A means for calculating a height error of the surface of the target object for each teaching point by rotating around a predetermined angle and integrating for each rotation angle, and comparing the minimum error integrated value through scanning with a predetermined threshold value Means for recognizing that the target object is the same as the reference object when the error integrated value is smaller than the threshold value, and the object with the coordinates, the normal line and the rotation angle of the reference point giving the integrated value. A three-dimensional shape recognition program that functions as a means for determining the position and orientation of an object. 11. The distance image is developed as height information of the object on plane coordinates based on distance data obtained by measuring the distance from one viewpoint to the surface of the object. 10. The three-dimensional shape recognition program described in 10. 12. A computer-readable recording medium in which the three-dimensional shape recognition program according to claim 10 or 11 is recorded.