JP2783493B2 - Optical gap detection method - Google Patents

Optical gap detection method

Info

Publication number
JP2783493B2
JP2783493B2 JP13323693A JP13323693A JP2783493B2 JP 2783493 B2 JP2783493 B2 JP 2783493B2 JP 13323693 A JP13323693 A JP 13323693A JP 13323693 A JP13323693 A JP 13323693A JP 2783493 B2 JP2783493 B2 JP 2783493B2
Authority
JP
Japan
Prior art keywords
gap
work
optical sensor
measurement
detecting
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Expired - Fee Related
Application number
JP13323693A
Other languages
Japanese (ja)
Other versions
JPH06341815A (en
Inventor
高太郎 永井
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
Sekisui Chemical Co Ltd
Original Assignee
Sekisui Chemical Co Ltd
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Sekisui Chemical Co Ltd filed Critical Sekisui Chemical Co Ltd
Priority to JP13323693A priority Critical patent/JP2783493B2/en
Publication of JPH06341815A publication Critical patent/JPH06341815A/en
Application granted granted Critical
Publication of JP2783493B2 publication Critical patent/JP2783493B2/en
Anticipated expiration legal-status Critical
Expired - Fee Related legal-status Critical Current

Links

Landscapes

  • Length Measuring Devices By Optical Means (AREA)

Description

【発明の詳細な説明】DETAILED DESCRIPTION OF THE INVENTION

【0001】[0001]

【産業上の利用分野】本発明は、光学式センサを用いて
測定対象物の表面形状を求め、測定対象物相互間に形成
されたギャップを検出するための光学式ギャップ検出方
法に関する。
BACKGROUND OF THE INVENTION 1. Field of the Invention The present invention relates to an optical gap detecting method for determining a surface shape of a measuring object using an optical sensor and detecting a gap formed between the measuring objects.

【0002】[0002]

【従来の技術】一般に、自動溶接機や溶接ロボット等に
おいては、精密な溶接作業を行なうために、その作業対
象である被溶接物(ワ−ク)の形状を認識し、相互に溶接
されるべき一対の被溶接物の間のギャップを正確に検出
・決定する必要がある。
2. Description of the Related Art Generally, in an automatic welding machine, a welding robot, or the like, in order to perform a precise welding operation, the shape of a workpiece (work) to be processed is recognized and the objects are welded to each other. It is necessary to accurately detect and determine the gap between a pair of workpieces to be welded.

【0003】そこで、従来、特開平3−32469号公
報,特開平3−32470号公報および特開平3−52
774号公報などに開示されている技術が提案されてい
る。具体的には、図2に示すように、光学式センサ1か
ら作業対象ワ−ク(測定対象物)2,3に対してレ−ザ光
等の光を照射し、その反射光の光学式センサ1への入射
位置に基づいて、センサコントロ−ラ4において三角法
により作業対象ワ−ク2,3の表面位置を算出してセン
サデ−タとして得てから、そのセンサデ−タを画像デ−
タとしてモニタ5上に表示するとともに、そのセンサデ
−タに基づいて、作業対象ワ−ク2,3相互間のギャッ
プ長Aを検出している。
Therefore, conventionally, JP-A-3-32469, JP-A-3-32470 and JP-A-3-52.
A technology disclosed in, for example, Japanese Patent No. 774 is proposed. Specifically, as shown in FIG. 2, light such as laser light is radiated from the optical sensor 1 to the work (workpiece to be measured) 2 or 3, and an optical system of the reflected light is applied. Based on the position of incidence on the sensor 1, the sensor controller 4 calculates the surface positions of the work-pieces 2 and 3 by trigonometry in the sensor controller 4 and obtains them as sensor data.
The data is displayed on the monitor 5 as data, and the gap length A between the work workpieces 2 and 3 is detected based on the sensor data.

【0004】[0004]

【発明が解決しようとする課題】しかしながら、従来の
ギャップ検出方法では、レ−ザ等による光学式センサ1
を用いることから、図2において、作業対象ワ−ク2,
3相互間のギャップが小さく、かつ、作業対象ワ−ク2
のギャップ部に湾曲面が存在すると、作業対象ワ−ク
2,3表面に照射される光学式センサ1からの光によっ
て生ずる乱反射が多く発生し、これら乱反射を光学式セ
ンサ1が受光することから、作業対象ワ−ク2,3相互
間のギャップ部分では、その反射光を正確に得ることが
できなくなり、作業対象ワ−ク2,3の正確な表面形状
をセンサデ−タ、画像デ−タとして得ることが困難とな
り、作業対象ワ−ク2,3相互間のギャップ部分におけ
るギャップ長Aを正確に検出することができないという
問題があった。
However, in the conventional gap detecting method, the optical sensor 1 using a laser or the like is used.
Therefore, in FIG. 2, the work
3. The work gap is small, and the work
If there is a curved surface in the gap portion, irregular reflections caused by light from the optical sensor 1 illuminated on the surfaces of the workpieces 2 and 3 are generated, and the optical sensor 1 receives these irregular reflections. The reflected light cannot be accurately obtained in the gap between the work workpieces 2 and 3, and the accurate surface shapes of the work workpieces 2 and 3 can be obtained by sensor data and image data. Therefore, there is a problem that the gap length A in the gap between the work workpieces 2 and 3 cannot be accurately detected.

【0005】本発明は、この問題を解決するためになさ
れたもので、測定対象物相互のギャップが小さく、か
つ、測定対象物のギャップ部に湾曲面が存在する場合に
おいても、測定対象物の表面形状を検出可能にして、ギ
ャップを正確に検出することができる光学式ギャップ検
出方法を提供することを目的とする。
SUMMARY OF THE INVENTION The present invention has been made to solve this problem. Even when the gap between the measurement objects is small and a curved surface exists in the gap portion of the measurement object, the object of the measurement object can be improved. It is an object of the present invention to provide an optical gap detection method capable of detecting a surface shape and accurately detecting a gap.

【0006】[0006]

【課題を解決するための手段】上記目的を達成するため
に、本発明の光学式ギャップ検出方法は、請求項1にお
いては、相互間にギャップを形成した状態で配設された
一対の測定対象物に対して光学式センサからの光を照射
し、その反射光に基づいて前記光学式センサにより前記
一対の測定対象物の各表面位置を検出して、この検出結
果に基づいて前記ギャップを検出する光学式ギャップ検
出方法において、前記光学式センサによるギャップ検出
時に、前記一対の測定対象物のうち一の測定対象物を所
定位置に配設して、該一の測定対象物に対して前記光学
式センサからの光を照射し、その反射光に基づいて前記
光学式センサにより前記一の測定対象物の表面位置を検
出したのち、前記一対の測定対象物の他の測定対象物を
前記一の測定対象物にギャップを形成した状態で対向配
設し、該他の測定対象物に対して前記光学式センサの光
を照射し、その反射光に基づいて前記他の測定対象物の
表面位置を検出することを特徴とする。
In order to achieve the above object, an optical gap detection method according to the present invention is characterized in that, in the first aspect, a pair of measurement objects arranged in a state where a gap is formed between the pair of measurement objects is provided. An object is irradiated with light from an optical sensor, the optical sensor detects each surface position of the pair of measurement objects based on the reflected light, and the gap is detected based on the detection result. In the optical gap detection method, when detecting a gap by the optical sensor, one of the pair of measurement objects is disposed at a predetermined position, and the optical measurement is performed on the one measurement object. After irradiating light from the type sensor and detecting the surface position of the one measurement object by the optical sensor based on the reflected light, the other measurement object of the pair of measurement objects is Measurement target Are arranged opposite to each other with a gap formed, irradiating the light of the optical sensor to the other measurement object, and detecting the surface position of the other measurement object based on the reflected light. It is characterized by.

【0007】請求項2においては、前記一の測定対象物
の表面位置が湾曲形状に、前記他の測定対象物の表面位
置が2平面が交わる角部形状に形成されていることを特
徴とする。
According to a second aspect of the present invention, the surface position of the one measurement object is formed in a curved shape, and the surface position of the other measurement object is formed in a corner shape where two planes intersect. .

【0008】[0008]

【作用】上述した本発明の光学式ギャップ検出方法で
は、一対の測定対象物のうち一の測定対象物の表面位置
を光学式センサにより検出した後、この一の測定対象物
に対向して配設される他の測定対象物の表面位置を光学
式センサにより検出するようにしているので、一対の測
定対象物の相互間のギャップが小さく、かつ測定対象物
に湾曲面が存在する場合においても、各測定対象物の各
表面位置を正確に検出することができ、従って、一対の
測定対象物相互間のギャップを正確に検出することがで
きる。
In the above-described optical gap detecting method of the present invention, after the surface position of one of the pair of measuring objects is detected by the optical sensor, the optical sensor is arranged to face the one measuring object. Since the surface position of the other measurement target is set to be detected by the optical sensor, the gap between the pair of measurement targets is small, and even when the measurement target has a curved surface. In addition, each surface position of each measurement object can be accurately detected, and therefore, a gap between a pair of measurement objects can be accurately detected.

【0009】[0009]

【実施例】以下、本発明の一実施例を図面を参照して説
明する。
An embodiment of the present invention will be described below with reference to the drawings.

【0010】図1(a),(b)において、本実施例は従来技
術の図2に示した構成と同様の構成を有しており、すな
わち、光学式センサ1,センサコントロ−ラ4およびモ
ニタ5は従来技術と同様であり、また、作業対象ワ−ク
2は、所定半径Rで湾曲するコ−ナ−部(R部分2a〜
2d)を四隅に有する角柱状部材であり、作業対象ワ−
ク3は、断面コ字形状のコ形部材である。そして、本実
施例は、これらの作業対象ワ−ク2,3どうしを相互に
溶接する際に、これらの作業対象ワ−ク2,3相互間の
ギャップを検出しょうとするものである。
1 (a) and 1 (b), this embodiment has a configuration similar to that of the prior art shown in FIG. 2, that is, an optical sensor 1, a sensor controller 4 and The monitor 5 is the same as that of the prior art, and the work target work 2 has a corner portion (R portions 2a to 2b) curved with a predetermined radius R.
2d) is a prismatic member having four corners,
The hook 3 is a U-shaped member having a U-shaped cross section. In this embodiment, when welding these work workpieces 2 and 3 to each other, a gap between these work workpieces 2 and 3 is to be detected.

【0011】上述のごとく構成される装置により、作業
対象ワ−ク2,3相互間のギャップの検出を行なう際に
は、まず、図1(a)に示すように、角柱状部材である作
業対象ワ−ク2を所定位置に配設したのち、この一の外
側平面2Aに直交する他の外側平面2BとR部分2aと
が交わる表面位置aを検出する。つまり、光学式センサ
1を、作業対象ワ−ク2の一の外側平面2Aに対向する
位置に移動して、光学式センサ1により、作業対象ワ−
ク2の外側平面2Aに光を照射して、作業対象ワ−ク2
の外側平面2Aで反射される反射光の光学式センサ1へ
の入射位置に基づいて、センサコントロ−ラ4において
三角法により作業対象ワ−ク2の表面位置aを算出して
センサデ−タDaとして得る。尚、作業対象ワ−ク2の
表面位置aは、R部分2a上であっても、光学式センサ
1の反射光の可否がはっきりしている部分なので正確な
位置が計測できる。
When detecting the gap between the workpieces 2 and 3 using the apparatus constructed as described above, first, as shown in FIG. After arranging the target work 2 at a predetermined position, a surface position a where the other outer plane 2B orthogonal to the one outer plane 2A intersects the R portion 2a is detected. That is, the optical sensor 1 is moved to a position facing one outer flat surface 2A of the work object work 2, and the work object work is detected by the optical sensor 1.
By irradiating light to the outer flat surface 2A of the work 2
The sensor controller 4 calculates the surface position a of the work object work 2 by triangulation in the sensor controller 4 based on the incident position of the light reflected on the outer flat surface 2A on the optical sensor 1. Get as. The surface position "a" of the work 2 can be accurately measured even on the R portion 2a, since the reflected light of the optical sensor 1 is clear.

【0012】次いで、図1(b)に示すように、コ形部材
である作業対象ワ−ク3を、このコ形断面3Aが作業対
象ワ−ク2の外側平面2Bに対して所定の間隔(ギャッ
プ)を隔てて、かつ略平行となるように配設する。そし
て、本実施例では、光学式センサ1により、作業対象ワ
−ク3の外側平面3Bに光を照射して、作業対象ワ−ク
3の外側平面3Bで反射される反射光の光学式センサ1
の入射位置に基づき、センサコントロ−ラ4において三
角法により、作業対象ワ−ク2の表面位置aにギャップ
を挟んで対向する作業対象ワ−ク3の表面位置bを算出
してセンサデ−タDbとして得る。尚、作業対象ワ−ク
3の表面位置bは、湾曲面上に存在するものではないこ
とから、作業対象ワ−ク2の表面位置aと作業対象ワ−
ク3の表面位置bとが組み合わさっていても、正確に作
業対象ワ−ク3の表面位置bを検出することができる。
Next, as shown in FIG. 1 (b), the work 3 to be worked, which is a U-shaped member, has a U-shaped cross section 3A at a predetermined distance from the outer flat surface 2B of the work 2 to be worked. (Gaps) are arranged so as to be substantially parallel to each other. In this embodiment, the optical sensor 1 irradiates light to the outer flat surface 3B of the work 3 to be worked, and the optical sensor of the reflected light reflected by the outer flat surface 3B of the work 3 to be worked. 1
Based on the incident position, the sensor controller 4 calculates the surface position b of the work 3 to be opposed to the surface a of the work 2 with a gap therebetween by triangulation, and the sensor data is obtained. Obtained as Db. Since the surface position b of the work 3 does not exist on the curved surface, the surface position a of the work 2 and the work 2 are not located on the curved surface.
Even if the surface position b of the work 3 is combined, the surface position b of the work 3 can be accurately detected.

【0013】上述のごとく、作業対象ワ−ク2,3の表
面位置a,bを示すセンサデ−タDa,Dbが得られる
と、この両センサデ−タDa,Dbに基づいて、作業対
象ワ−ク2,3相互間のギャップ長Aを算出・決定す
る。
As described above, when the sensor data Da and Db indicating the surface positions a and b of the work workpieces 2 and 3 are obtained, the work workpiece work is performed based on both the sensor data Da and Db. Calculate and determine the gap length A between the two.

【0014】このように、本実施例の光学式ギャップ検
出方法によれば、角柱状部材である作業対象ワ−ク2を
所定位置に配設し、作業対象ワ−ク2の外側平面2Aに
光学式センサ1に光を照射して表面位置aを光学式セン
サ1で検出した後、コ形部材である作業対象ワ−ク3を
作業対象ワ−ク2の外側平面2Bに対して所定の間隔を
隔てるように配設して、当該作業対象ワ−ク3の外側平
面3に光学式センサ1の光を照射して、表面位置aに対
向する作業対象ワ−ク3の表面位置bを光学式センサ1
により検出するようにしているので、作業対象ワ−ク
2,3の相互間のギャップが小さく、かつ、作業対象ワ
−ク2に湾曲するR部2aが存在する場合においても、
作業対象ワ−ク2,3の各表面位置a,bを正確に検出
することができ、従って、作業対象ワ−ク2,3相互間
のギャップを正確に検出することが可能となる。
As described above, according to the optical gap detecting method of the present embodiment, the work piece 2 which is a prismatic member is disposed at a predetermined position, and the work piece 2 is disposed on the outer flat surface 2A of the work piece 2. After irradiating the optical sensor 1 with light and detecting the surface position a by the optical sensor 1, the work 3, which is a U-shaped member, is moved to a predetermined position with respect to the outer flat surface 2 B of the work 2. The work 3 is disposed at an interval, and the outer surface 3 of the work 3 is irradiated with light from the optical sensor 1 so that the surface position b of the work 3 facing the surface position a can be detected. Optical sensor 1
Therefore, even when the gap between the work-pieces 2 and 3 is small and the work-piece 2 has a curved R portion 2a,
The surface positions a and b of the work objects 2 and 3 can be accurately detected, and therefore, the gap between the work objects 2 and 3 can be accurately detected.

【0015】以上、この発明の実施例を図面により詳述
してきたが、具体的な構成はこの実施例に限られるもの
ではなく、この発明の要旨を免脱しない範囲の設計変更
等があってもこの発明に含まれる。例えば、上記実施例
では、角柱状部材の作業対象ワ−ク2とコ形部材の作業
対象ワ−ク3相互間のギャップ長Aを検出する場合につ
いて説明したが、本発明の方法は、他の形状の測定対象
物相互間のギャップを検出する場合にも、上記実施例と
同様に適用される。
Although the embodiment of the present invention has been described in detail with reference to the drawings, the specific configuration is not limited to this embodiment, and there are design changes and the like within the scope of the present invention. Is also included in the present invention. For example, in the above-described embodiment, the case where the gap length A between the work 2 to be worked of the prismatic member and the work 3 to be worked of the U-shaped member has been described. The same applies to the case of detecting the gap between the measurement objects having the shapes described above.

【0016】[0016]

【発明の効果】以上詳述したように、本発明の光学式ギ
ャップ検出方法によれば、一対の測定対象物のうち一の
測定対象物の表面位置を光学式センサにより検出した
後、この一の測定対象物に対向して配設される他の測定
対象物の表面位置を光学式センサにより検出するように
しているので、一対の測定対象物の相互間のギャップが
小さく、かつ、測定対象物に湾曲面が存在する場合にお
いても、一対の測定対象物の各表面位置を正確に検出す
ることができ、従って、一対の測定対象物相互間のギャ
ップを正確に検出することができる。
As described above in detail, according to the optical gap detecting method of the present invention, after detecting the surface position of one of the pair of measurement objects by the optical sensor, Since the surface position of another measurement object disposed opposite to the measurement object is detected by the optical sensor, the gap between the pair of measurement objects is small, and the measurement object Even when the object has a curved surface, the respective surface positions of the pair of measurement objects can be accurately detected, and therefore, the gap between the pair of measurement objects can be accurately detected.

【図面の簡単な説明】[Brief description of the drawings]

【図1】本発明の実施例としての光学式ギャップ検出方
法を示すものであって、(a)は一の測定対象物の表面位
置を検出する手順を示す斜視図、(b)は他の測定対象物
の表面位置を検出する手順を示す斜視図である。
FIG. 1 shows an optical gap detection method as an embodiment of the present invention, in which (a) is a perspective view showing a procedure for detecting a surface position of one measurement object, and (b) is another perspective view. It is a perspective view showing the procedure of detecting the surface position of a measuring object.

【図2】従来技術の光学式ギャップ検出方法を示す斜視
図である。
FIG. 2 is a perspective view showing a conventional optical gap detection method.

【符号の説明】[Explanation of symbols]

1 光学式センサ 2,3 作業対象ワ−ク(測定対象物) 1 Optical sensor 2, 3 Work target work (measurement target)

───────────────────────────────────────────────────── フロントページの続き (58)調査した分野(Int.Cl.6,DB名) G01B 11/00 - 11/30 B23K 9/127──────────────────────────────────────────────────続 き Continuation of front page (58) Field surveyed (Int.Cl. 6 , DB name) G01B 11/00-11/30 B23K 9/127

Claims (2)

(57)【特許請求の範囲】(57) [Claims] 【請求項1】 相互間にギャップを形成した状態で配設
された一対の測定対象物に対して光学式センサからの光
を照射し、その反射光に基づいて前記光学式センサによ
り前記一対の測定対象物の各表面位置を検出して、この
検出結果に基づいて前記ギャップを検出する光学式ギャ
ップ検出方法において、 前記光学式センサによるギャップ検出時に、前記一対の
測定対象物のうち一の測定対象物を所定位置に配設し
て、該一の測定対象物に対して前記光学式センサからの
光を照射し、その反射光に基づいて前記光学式センサに
より前記一の測定対象物の表面位置を検出したのち、 前記一対の測定対象物の他の測定対象物を前記一の測定
対象物にギャップを形成した状態で対向配設し、該他の
測定対象物に対して前記光学式センサの光を照射し、そ
の反射光に基づいて前記他の測定対象物の表面位置を検
出することを特徴とする光学式ギャップ検出方法。
An optical sensor irradiates a pair of measurement objects disposed with a gap between them with light from an optical sensor, and based on the reflected light, the pair of measurement objects is irradiated by the optical sensor. In the optical gap detection method of detecting each surface position of the measurement target and detecting the gap based on the detection result, when the gap is detected by the optical sensor, one of the pair of measurement targets is measured. An object is disposed at a predetermined position, the one measurement object is irradiated with light from the optical sensor, and the surface of the one measurement object is irradiated by the optical sensor based on the reflected light. After detecting the position, the other measurement object of the pair of measurement objects is disposed so as to face the one measurement object with a gap formed, and the optical sensor is provided for the other measurement object. Irradiate the light of Optical gap detecting method and detecting the surface position of the other measurement object based on the reflected light.
【請求項2】 前記一の測定対象物の表面位置が湾曲形
状に、前記他の測定対象物の表面位置が2平面が交わる
角部形状に形成されていることを特徴とする請求項1記
載の光学式ギャップ検出方法。
2. The apparatus according to claim 1, wherein the surface position of the one measurement object is formed in a curved shape, and the surface position of the other measurement object is formed in a corner shape where two planes intersect. Optical gap detection method.
JP13323693A 1993-06-03 1993-06-03 Optical gap detection method Expired - Fee Related JP2783493B2 (en)

Priority Applications (1)

Application Number Priority Date Filing Date Title
JP13323693A JP2783493B2 (en) 1993-06-03 1993-06-03 Optical gap detection method

Applications Claiming Priority (1)

Application Number Priority Date Filing Date Title
JP13323693A JP2783493B2 (en) 1993-06-03 1993-06-03 Optical gap detection method

Publications (2)

Publication Number Publication Date
JPH06341815A JPH06341815A (en) 1994-12-13
JP2783493B2 true JP2783493B2 (en) 1998-08-06

Family

ID=15099897

Family Applications (1)

Application Number Title Priority Date Filing Date
JP13323693A Expired - Fee Related JP2783493B2 (en) 1993-06-03 1993-06-03 Optical gap detection method

Country Status (1)

Country Link
JP (1) JP2783493B2 (en)

Also Published As

Publication number Publication date
JPH06341815A (en) 1994-12-13

Similar Documents

Publication Publication Date Title
Yu et al. A study on vision sensors for seam tracking of height-varying weldment. Part 1: Mathematical model
EP0316624A2 (en) Improved imaging and inspection apparatus and method
JP4187818B2 (en) Inspection method of welding state
JP2783493B2 (en) Optical gap detection method
JP2005014026A (en) Weld zone inspection method, and welding support system
JPH0484707A (en) Three-dimensional size measuring apparatus
JP2572286B2 (en) 3D shape and size measurement device
JP3275988B2 (en) Butt welding monitoring method and butt welding monitoring device
JP2630844B2 (en) 3D shape and size measurement device
JPS6357150B2 (en)
JPH07116737A (en) Instrument for measuring bending angle
JP3204587B2 (en) Position detection device
JPH05154510A (en) Method and instrument for detecting shape of welded part at butt-welding
JP2932418B2 (en) Work position measurement method
JPH06277843A (en) Method and device for multilayer welding
JPS62214869A (en) Automatic welding method
JPH06167318A (en) Optical detecting method for gap
JP3025577B2 (en) Shape processing method
JPH05337669A (en) Laser beam machine
JP2555133B2 (en) Inspection equipment
JPH0712533A (en) Detection method of welding gap
JP2783492B2 (en) Welding line position detection method
JP2753342B2 (en) Work position detector
JP2690249B2 (en) Welding line position detection method
JPH0727511A (en) Weld line position detecting method

Legal Events

Date Code Title Description
FPAY Renewal fee payment (prs date is renewal date of database)

Free format text: PAYMENT UNTIL: 20090522

Year of fee payment: 11

FPAY Renewal fee payment (prs date is renewal date of database)

Free format text: PAYMENT UNTIL: 20090522

Year of fee payment: 11

FPAY Renewal fee payment (prs date is renewal date of database)

Free format text: PAYMENT UNTIL: 20100522

Year of fee payment: 12

FPAY Renewal fee payment (prs date is renewal date of database)

Free format text: PAYMENT UNTIL: 20110522

Year of fee payment: 13

FPAY Renewal fee payment (prs date is renewal date of database)

Year of fee payment: 13

Free format text: PAYMENT UNTIL: 20110522

FPAY Renewal fee payment (prs date is renewal date of database)

Year of fee payment: 14

Free format text: PAYMENT UNTIL: 20120522

FPAY Renewal fee payment (prs date is renewal date of database)

Free format text: PAYMENT UNTIL: 20130522

Year of fee payment: 15

LAPS Cancellation because of no payment of annual fees