JP2000065533A - Method for gripping ring-shaped object and its aligning device - Google Patents

Method for gripping ring-shaped object and its aligning device

Info

Publication number
JP2000065533A
JP2000065533A JP10251878A JP25187898A JP2000065533A JP 2000065533 A JP2000065533 A JP 2000065533A JP 10251878 A JP10251878 A JP 10251878A JP 25187898 A JP25187898 A JP 25187898A JP 2000065533 A JP2000065533 A JP 2000065533A
Authority
JP
Japan
Prior art keywords
ring
shaped object
gripping
image
state
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Granted
Application number
JP10251878A
Other languages
Japanese (ja)
Other versions
JP3611457B2 (en
Inventor
Satoshi Miyazaki
聡 宮崎
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
Uchiyama Manufacturing Corp
Original Assignee
Uchiyama Manufacturing Corp
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Uchiyama Manufacturing Corp filed Critical Uchiyama Manufacturing Corp
Priority to JP25187898A priority Critical patent/JP3611457B2/en
Publication of JP2000065533A publication Critical patent/JP2000065533A/en
Application granted granted Critical
Publication of JP3611457B2 publication Critical patent/JP3611457B2/en
Anticipated expiration legal-status Critical
Expired - Fee Related legal-status Critical Current

Links

Landscapes

  • Length Measuring Devices By Optical Means (AREA)
  • Manipulator (AREA)
  • Control Of Position Or Direction (AREA)

Abstract

PROBLEM TO BE SOLVED: To securely grip a flexible ring-shaped object by picking up and capturing its image, binarizing it, performing the labeling processing for recognizing its state, and determining the gripping position for gripping. SOLUTION: A camera C1 is arranged on a ring-shaped object for capturing the entire object, and cameras C2 and C3 are mounted to a robot band 1 and the ring-shaped object can be partially captured obliquely. The ring-shaped object is captured by the camera C1, and an image is binarized for labeling. The overlapped state is recognized according to the area and distribution of the label, a gripping position where the robot hand 1 can be inserted is determined, and the height there is detected by the cameras C2 and C3, thus determining the gripping height. In this case, the ring-shaped object is lifted to cancel overlapping. In this manner, by recognizing the height of the ring-shaped object in each state, overlapping can be canceled by gripping only the highest part even if the ring-shaped object overlaps for alignment.

Description

【発明の詳細な説明】DETAILED DESCRIPTION OF THE INVENTION

【0001】[0001]

【発明の属する技術分野】本発明は、柔軟性を有する弾
性体例からなるリング状弾性物の把持整列用装置とその
把持方法に関する。
BACKGROUND OF THE INVENTION 1. Field of the Invention The present invention relates to an apparatus and a method for gripping and aligning a ring-shaped elastic member made of an example of a flexible elastic body.

【0002】[0002]

【従来の技術】従来、柔軟性のあるリング状対象物、例
えば合成ゴムからなるシーリングなどの取付作業や検査
をする際には、対象物の重なりやもつれなどを解く作業
が必要になってくる。これらの作業を自動化して行くこ
とは多くの柔軟な対象物の取扱手法の開発と共に、シス
テムの自動化にとって有効な手法となる。
2. Description of the Related Art Conventionally, when mounting or inspecting a flexible ring-shaped object, for example, a sealing made of synthetic rubber, it is necessary to remove the overlap or entanglement of the objects. . Automating these operations will be an effective method for the automation of the system as well as the development of many flexible object handling methods.

【0003】[0003]

【発明が解決しようとする課題】しかしながら、このよ
うな柔軟性に富み形状が不確定なリング状対象物の載置
状態を認知するシステムは未だ確立されていない。その
形状の確定した対象物においては、予めティーチングさ
れた良品の画像とのパターンマッチングを行ない、その
対象物の形状認知を行なっていたものであり、不確定な
形状の対象物においては全く採用することができないシ
ステムとなっている。本発明では、帯状対象物を含むリ
ング状対象物をロボット及び画像処理を用いて、例えば
図6に示す事例の如き原形状をなす対象物を整列するた
めの装置と手法を提案するものである。
However, a system for recognizing the mounting state of such a ring-shaped object which is rich in flexibility and whose shape is uncertain has not yet been established. For an object whose shape is determined, pattern matching is performed with a pre-teached image of a non-defective product, and shape recognition of the object is performed. It is a system that cannot do it. The present invention proposes an apparatus and a method for aligning a ring-shaped object including a band-shaped object by using a robot and image processing, for example, an object having an original shape as shown in FIG. .

【0004】[0004]

【課題を解決しようとする手段】本発明は、柔軟性に富
み形状が不確定なリング状対象物の状態を認識して把持
せしめる把持方法であって、前記リング状対象物を撮像
装置にて画像として取り込み、前記画像を2値化処理せ
しめると共に、ラベリング処理を行なって前記リング状
対象物の状態を認知せしめ、認知したリング状対象物の
把持位置を決定して把持せしめることを特徴としてい
る。
SUMMARY OF THE INVENTION The present invention relates to a gripping method for recognizing and holding a state of a ring-shaped object having a high flexibility and an uncertain shape. Captured as an image, binarizing the image, performing labeling to recognize the state of the ring-shaped object, determining the gripping position of the recognized ring-shaped object, and causing the ring-shaped object to be gripped. .

【0005】また、柔軟性に富み形状が不確定なリング
状対象物の状態を認識して整列する整列装置であって、
前記リング状対象物を撮像装置にて画像として取り込
み、前記画像を2値化し、前記2値化された画像のラベ
リングを行なって前記リング状対象物の状態を認知せし
め、認知したリング状対象物の把持位置を決定して把持
し一定方向へ整列せしめることを特徴としている。
[0005] Further, there is provided an alignment apparatus which recognizes and aligns a state of a ring-shaped object which is rich in flexibility and whose shape is uncertain,
The ring-shaped object is captured as an image by an imaging device, the image is binarized, the binarized image is labeled, the state of the ring-shaped object is recognized, and the recognized ring-shaped object is recognized. Is characterized in that the gripping position is determined, gripped and aligned in a certain direction.

【0006】[0006]

【発明の実施の形態】本発明を実施する前提条件を以下
に図示しながら説明する。図1に示す装置は画像処理装
置であり、1台の6軸多関節ロボット及び3台のカメラ
によって構成されている。カメラC1はリング状対象物
の上方に配置してあり、該リング状対象物の全体を取り
込むことができる。カメラC2、C3はロボットハンド
1に取り付けられており、斜めからリング状対象物を部
分的に取り込むことができる。
DESCRIPTION OF THE PREFERRED EMBODIMENTS The prerequisites for implementing the present invention will be described below with reference to the drawings. The apparatus shown in FIG. 1 is an image processing apparatus, and includes one 6-axis articulated robot and three cameras. The camera C1 is disposed above the ring-shaped object, and can capture the entire ring-shaped object. The cameras C2 and C3 are attached to the robot hand 1, and can partially capture the ring-shaped object from an oblique direction.

【0007】[0007]

【実施例】測定方法 まず、カメラC1の画像よりラベルの面積と分布から重
なりの状態を認識し、ロボットハンド1の挿入可能な把
持位置を決定する。その位置での高さをロボットハンド
1に取り付けた2台のカメラC2、C3によって検出
し、把持高さを決定する。ここでリング状対象物を持ち
上げることで重なりを解消する。 重なりパターンの認知 リング状対象物をカメラC1によって取り込み、該画像
を2値化し、ラベリングを行なう。画素数がTU以上の
ラベルLU1 の数をNU、フェレ径の左上の座標を(F
SXi、FSYi)、フェレ径の右下の座標を(FEX
i、FEYi)、(i=1,2,3,…、NU)とする。
NU=1のとき、リング状対象物は重なり合っていない
ので、次工程であるリング状対象物の整列を行なう。N
U≧2のとき、リング状対象物が重なり合っているの
で、この重なりを解消する必要が生じる。ラベルLU1
の中で面積が最大のLUMAXとする。ロボットハンド1
の挿入位置を決定するために、重なりのパターン分けを
行なう。
DESCRIPTION OF THE PREFERRED EMBODIMENTS Measuring Method First, the overlapping state is recognized from the label area and distribution from the image of the camera C1, and the gripping position where the robot hand 1 can be inserted is determined. The height at that position is detected by the two cameras C2 and C3 attached to the robot hand 1, and the gripping height is determined. Here, the ring-shaped object is lifted to eliminate the overlap. Recognition of overlap pattern A ring-shaped object is captured by the camera C1, the image is binarized, and labeling is performed. NU is the number of labels LU1 whose number of pixels is TU or more, and (F
SXi, FSYi) and the coordinates at the lower right
i, FEYi), (i = 1, 2, 3,..., NU).
When NU = 1, since the ring-shaped objects do not overlap, the ring-shaped objects are aligned in the next step. N
When U ≧ 2, the ring-shaped objects overlap, and it is necessary to eliminate the overlap. Label LU1
Let LUMAX be the largest in the area. Robot hand 1
In order to determine the insertion position, the overlapping pattern is divided.

【0008】パターン1 ラベルLUmaxがそれ以外のラベルLU1 によって周り
を囲まれていない時を図2で示すようなパターン1と
し、式(1)の条件を満たす場合である。
Pattern 1 A case where the label LUmax is not surrounded by other labels LU1 is a pattern 1 as shown in FIG. 2 and satisfies the condition of equation (1).

【0009】[0009]

【数1】 (Equation 1)

【0010】パターン2 パターン1以外のとき、ラベルLUmaxがそれ以外のラ
ベルLU1 によって周りを囲まれているときを図3で示
すようなパターン2とし、式(2)の条件を満たす場合で
ある。
Pattern 2 In the case other than the pattern 1, the case where the label LUmax is surrounded by the other label LU1 is the pattern 2 as shown in FIG. 3 and the condition of the expression (2) is satisfied.

【0011】[0011]

【数2】 (Equation 2)

【0012】リング状対象物の把持位置の決定法 パターン1の場合 ロボットハンド1の挿入可能な位置を検出するため以下
の処理を行なう。ラベルLUmaxに対して輪郭線追跡処
理を行なう。輪郭線上の各点の座標を(DXk、DY
k)、(k=1,2,3,…、NC)とする。リング状対
象物の重心(GX、GY)から最も遠い輪郭線上の点
(DXmax、DYmax )を式3により算出する。
Method for Determining the Position of Holding the Ring-shaped Object In the case of Pattern 1 The following processing is performed to detect the position where the robot hand 1 can be inserted. Contour tracking processing is performed on the label LUmax. The coordinates of each point on the contour are represented by (DXk, DY
k), (k = 1, 2, 3,..., NC). A point (DXmax, DYmax) on the contour line farthest from the center of gravity (GX, GY) of the ring-shaped object is calculated by Expression 3.

【0013】[0013]

【数3】 (Equation 3)

【0014】ロボットハンド1と取り込んだ画像との大
きさを対応させたとき、前記ロボットハンド1の中心か
ら開き幅をPA画素、ロボットハンド1の縦・横の大き
さをPB画素、PC画素とする。点(DXmax、DYmax
)における輪郭線の法線を求める。法線の内方向、P
A画素の地点から、縦PB画素、横PC画素の四角形の
内部における対象物の有無を調べる。もし、中心より左
側で対象物を確認したら、輪郭線上を右に1画素移動し
て、その地点での法線を求め探索する。同様に法線の外
方向に対しても探索する。内側と外側、両方において対
象物が検出されなかった輪郭線上の点を把持位置とす
る。法線方向を把持方向とする。(図4参照)
When the sizes of the robot hand 1 and the captured image are made to correspond to each other, the opening width from the center of the robot hand 1 is PA pixels, the vertical and horizontal sizes of the robot hand 1 are PB pixels and PC pixels. I do. Points (DXmax, DYmax
The normal line of the contour line in ()) is obtained. Inward of normal, P
From the point of the A pixel, the presence or absence of the target inside the rectangle of the vertical PB pixel and the horizontal PC pixel is checked. If the object is confirmed on the left side of the center, the pixel is moved one pixel to the right on the contour line, and the normal at that point is searched for. Similarly, the search is performed in the outward direction of the normal. Points on the contour line where no object is detected on both the inside and the outside are defined as gripping positions. The normal direction is the gripping direction. (See Fig. 4)

【0015】パターン2の場合 ラベルLUmax及びリング状対象物の外周に対して輪郭
線追跡を行なう。それぞれ座標を(DIXm、DIY
m)、(DOXn 、DOYn)、 全画素数をNI、NOと
し、2点の最も近づく点(DOXmin、DOYmin )を
式4より算出し、この点を把持位置とする。
In the case of pattern 2, contour tracing is performed on the label LUmax and the outer periphery of the ring-shaped object. Each coordinate is (DIXm, DIY
m), (DOXn, DOYn), the total number of pixels is set to NI and NO, and the closest point (DOXmin, DOYmin) of the two points is calculated by equation 4, and this point is set as the gripping position.

【0016】[0016]

【数4】 (Equation 4)

【0017】点(DOXmin、DOYmin)における輪郭
線の法線を求め、これを把持方向とする。
The normal of the contour line at the point (DOXmin, DOYmin) is determined, and this is set as the gripping direction.

【0018】把持位置の高さの算出 カメラC2、C3を用いて決定された把持位置でのリン
グ状対象物の高さを算出し、リング状対象物が重なって
も上に重なっている部分だけを把持できるよう把持高さ
を決定する。図5に示すようにカメラC2の画像がリン
グ状対象物を真上から見たときよりもD2だけずれてみ
えるとき、リング状対象物の高さをH、幅をWとする
と、式5のようになる。
Calculation of the height of the gripping position The height of the ring-shaped object at the gripping position determined using the cameras C2 and C3 is calculated. The gripping height is determined so that can be gripped. As shown in FIG. 5, when the image of the camera C2 appears to be shifted by D2 from when the ring-shaped object is viewed from directly above, assuming that the height of the ring-shaped object is H and the width of the ring-shaped object is W, Become like

【0019】[0019]

【数5】H=CH・D2/(CW+D2) カメラC2から見たリング状対象物の右端及び左端の座
標をR2、L2とし、同様にカメラC3から見たものを
R3、L3とするとD2は式6のように表わせる。
H = CH · D2 / (CW + D2) If the coordinates of the right and left ends of the ring-shaped object viewed from the camera C2 are R2 and L2, and the views from the camera C3 are R3 and L3, D2 is Equation 6 can be expressed.

【0020】[0020]

【数6】D2=R3−R2 式6を式5に代入すると式7となる。D2 = R3-R2 Equation 7 is obtained by substituting Equation 6 into Equation 5.

【0021】[0021]

【数7】 H=CH・(R3−R2)/(CW+R3−R2)H = CH · (R3-R2) / (CW + R3-R2)

【0022】把持及び重なりの解消 算出された把持位置及び把持高さにおいて、ロボットハ
ンド1でリング状対象物を把持し、リング状対象物が作
業台から離れるまで上方へ持ち上げ、図6で示すように
該リング状対象物の重なりを解消し原形状に戻すことが
可能となる。この状態からリング状対象物を降ろす際、
再び重なり合わないように斜め下方平面へ降ろして整列
せしめる。
At the calculated gripping position and gripping height, the robotic hand 1 grips the ring-shaped object, and lifts the ring-shaped object upward until it separates from the worktable, as shown in FIG. Thus, it is possible to eliminate the overlap of the ring-shaped objects and return to the original shape. When lowering the ring-shaped object from this state,
Lower and align the diagonally lower plane so that it does not overlap again.

【0023】このリング状対象物を正確に整列せしめる
のに、把持位置を正確に指定してリング状対象物の特徴
部を決定する方法が可能であり、この方法では、特徴部
情報の抽出、特徴部のデータベース化、特徴部のマッチ
ングなどを行なって把持位置を決定し整列を行なう。
In order to accurately align the ring-shaped objects, a method of accurately specifying a gripping position and determining a characteristic portion of the ring-shaped object is possible. In this method, extraction of characteristic portion information, A database of the characteristic portions, matching of the characteristic portions, and the like are performed to determine a gripping position and perform alignment.

【0024】[0024]

【発明の効果】本発明では、柔軟性を有するリング状対
象物の確実な把持をなさしめることができる。ラベルの
面積及び配置を利用しリング状対象物の重なりの状態を
認識できる。それぞれの状態におけるリング状対象物の
高さを認識することで、リング状対象物が重なった状態
でも最上部のみを把持することができ重なりを解消して
整列せしめることができる。
According to the present invention, it is possible to reliably hold a flexible ring-shaped object. The overlapping state of the ring-shaped objects can be recognized using the area and arrangement of the labels. By recognizing the height of the ring-shaped objects in each state, even when the ring-shaped objects are overlapped, only the uppermost part can be gripped, and the overlap can be eliminated and aligned.

【図面の簡単な説明】[Brief description of the drawings]

【図1】本発明の画像処理装置を示す略図である。FIG. 1 is a schematic diagram showing an image processing apparatus of the present invention.

【図2】パターン1の平面図である。FIG. 2 is a plan view of a pattern 1;

【図3】パターン2の平面図である。FIG. 3 is a plan view of a pattern 2;

【図4】パターン1の把持位置を示す平面図である。FIG. 4 is a plan view showing a gripping position of a pattern 1;

【図5】高さの算出をなす位置関係を示す説明図であ
る。
FIG. 5 is an explanatory diagram showing a positional relationship for calculating a height.

【図6】リング状対象物の原形状(すなわち整列済の形
状)を示す平面図である。
FIG. 6 is a plan view showing an original shape (that is, an aligned shape) of a ring-shaped object.

【符号の説明】[Explanation of symbols]

1 ロボットハンド C1 カメラ C2 カメラ C3 カメラ 1 Robot hand C1 camera C2 camera C3 camera

Claims (2)

【特許請求の範囲】[Claims] 【請求項1】 柔軟性に富み形状が不確定なリング状対
象物の状態を認識して把持せしめる把持方法において、 前記リング状対象物を撮像装置にて画像として取り込
み、 前記画像を2値化処理せしめると共に、ラベリング処理
を行なって前記リング状対象物の状態を認知せしめ、 認知したリング状対象物の把持位置を決定して把持せし
めることを特徴としたリング状対象物の把持方法。
1. A gripping method for recognizing and holding a state of a ring-shaped object having a high flexibility and an uncertain shape, wherein the ring-shaped object is captured as an image by an imaging device, and the image is binarized. A method for gripping a ring-shaped object, comprising performing processing and performing labeling processing to recognize the state of the ring-shaped object, determining a gripping position of the recognized ring-shaped object, and causing the object to be gripped.
【請求項2】 柔軟性に富み形状が不確定なリング状対
象物の状態を認識して把持し整列する整列装置におい
て、 前記リング状対象物を撮像装置にて画像として取り込
み、 前記画像を2値化せしめ、 前記2値化された画像のラベリングを行なって前記リン
グ状対象物の状態を認知せしめ、 認知したリング状対象物の把持位置を決定して把持し一
定方向へ整列せしめることを特徴としたリング状対象物
の整列装置。
2. An aligning apparatus for recognizing, grasping and aligning a state of a ring-shaped object having a high flexibility and an uncertain shape, wherein the ring-shaped object is captured as an image by an imaging device, and Labeling the binarized image to recognize the state of the ring-shaped object, determining a gripping position of the recognized ring-shaped object, gripping and aligning in a certain direction. Ring alignment device.
JP25187898A 1998-08-20 1998-08-20 Ring-shaped object gripping method and alignment apparatus therefor Expired - Fee Related JP3611457B2 (en)

Priority Applications (1)

Application Number Priority Date Filing Date Title
JP25187898A JP3611457B2 (en) 1998-08-20 1998-08-20 Ring-shaped object gripping method and alignment apparatus therefor

Applications Claiming Priority (1)

Application Number Priority Date Filing Date Title
JP25187898A JP3611457B2 (en) 1998-08-20 1998-08-20 Ring-shaped object gripping method and alignment apparatus therefor

Publications (2)

Publication Number Publication Date
JP2000065533A true JP2000065533A (en) 2000-03-03
JP3611457B2 JP3611457B2 (en) 2005-01-19

Family

ID=17229290

Family Applications (1)

Application Number Title Priority Date Filing Date
JP25187898A Expired - Fee Related JP3611457B2 (en) 1998-08-20 1998-08-20 Ring-shaped object gripping method and alignment apparatus therefor

Country Status (1)

Country Link
JP (1) JP3611457B2 (en)

Cited By (2)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN104772760A (en) * 2014-01-15 2015-07-15 精工爱普生株式会社 Robert, Robert system, robot control device and robot control method
CN108453743A (en) * 2018-05-14 2018-08-28 清华大学深圳研究生院 Mechanical arm grasping means

Cited By (2)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN104772760A (en) * 2014-01-15 2015-07-15 精工爱普生株式会社 Robert, Robert system, robot control device and robot control method
CN108453743A (en) * 2018-05-14 2018-08-28 清华大学深圳研究生院 Mechanical arm grasping means

Also Published As

Publication number Publication date
JP3611457B2 (en) 2005-01-19

Similar Documents

Publication Publication Date Title
US11780101B2 (en) Automated package registration systems, devices, and methods
US11797926B2 (en) Robotic system with automated object detection mechanism and methods of operating the same
US6845296B2 (en) Object taking out apparatus
CN109955222B (en) Article transfer device, robot system, and article transfer method
KR920004956B1 (en) Drawing figure recognition apparatus
US10410172B2 (en) Object detection apparatus, depalletization automating apparatus, and object detection method
US20150224650A1 (en) Vision-guided electromagnetic robotic system
JPH03228591A (en) Work holding device, work and storing case thereof
CN109215075B (en) Positioning and identifying system and method for workpiece in material grabbing of industrial robot
CN114332622A (en) Label detection method based on machine vision
CN109658388B (en) Method for detecting and correcting packaging box segmentation errors based on vision and active interaction
JP2000065533A (en) Method for gripping ring-shaped object and its aligning device
JP3684799B2 (en) Device for detecting displacement amount of stop position of moving object
JPH0953915A (en) Method for recognizing overlapping state
WO2004052596A1 (en) Method and arrangement to avoid collision between a robot and its surroundings while picking details including a sensorsystem
JP2562047B2 (en) Position and orientation recognition method of target object
JPH073990U (en) Mobile robot
JP2708621B2 (en) Substrate position detection method and component mounting device on substrate
JP3870526B2 (en) Device for detecting displacement amount of stop position of moving body
CN112010021B (en) Workpiece conveying system, workpiece positioning system and positioning method thereof
Abdallah et al. Automatic inspection of aeronautical mechanical assemblies using 2D and 3D computer vision
JPH0341577A (en) Discriminating method for circular body
Liu et al. Research on Accurate Grasping Method of Steel Shaft Parts Based on Depth Camera
JPH05237782A (en) Work holding position setting method and device thereof
CN113111712A (en) AI identification positioning method, system and device for bagged product

Legal Events

Date Code Title Description
TRDD Decision of grant or rejection written
A01 Written decision to grant a patent or to grant a registration (utility model)

Free format text: JAPANESE INTERMEDIATE CODE: A01

Effective date: 20041005

A61 First payment of annual fees (during grant procedure)

Free format text: JAPANESE INTERMEDIATE CODE: A61

Effective date: 20041019

R150 Certificate of patent or registration of utility model

Free format text: JAPANESE INTERMEDIATE CODE: R150

LAPS Cancellation because of no payment of annual fees