JP3680704B2 - Image recognition method for recognition mark in electronic component mounting apparatus - Google Patents

Image recognition method for recognition mark in electronic component mounting apparatus Download PDF

Info

Publication number
JP3680704B2
JP3680704B2 JP2000179663A JP2000179663A JP3680704B2 JP 3680704 B2 JP3680704 B2 JP 3680704B2 JP 2000179663 A JP2000179663 A JP 2000179663A JP 2000179663 A JP2000179663 A JP 2000179663A JP 3680704 B2 JP3680704 B2 JP 3680704B2
Authority
JP
Japan
Prior art keywords
recognition
image
mark
component mounting
electronic component
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Expired - Fee Related
Application number
JP2000179663A
Other languages
Japanese (ja)
Other versions
JP2001356006A (en
Inventor
隆史 平原
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
Panasonic Corp
Panasonic Holdings Corp
Original Assignee
Panasonic Corp
Matsushita Electric Industrial Co Ltd
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Panasonic Corp, Matsushita Electric Industrial Co Ltd filed Critical Panasonic Corp
Priority to JP2000179663A priority Critical patent/JP3680704B2/en
Publication of JP2001356006A publication Critical patent/JP2001356006A/en
Application granted granted Critical
Publication of JP3680704B2 publication Critical patent/JP3680704B2/en
Anticipated expiration legal-status Critical
Expired - Fee Related legal-status Critical Current

Links

Images

Landscapes

  • Length Measuring Devices By Optical Means (AREA)
  • Supply And Installment Of Electrical Components (AREA)

Description

【0001】
【発明の属する技術分野】
本発明は、電子部品実装用装置において基板などのワークに設けられた認識マークを画像認識する電子部品実装用装置における認識マークの画像認識方法に関するものである。
【0002】
【従来の技術】
基板にクリーム半田を印刷するスクリーン印刷装置や、クリーム半田印刷後の基板に電子部品を搭載する電子部品実装装置などの電子部品実装用装置において、基板などのワークや部品供給ユニット、ノズルストッカ等の位置検出用として認識マークを画像認識により検出する方法が広く用いられている。この方法は、認識対象部位をカメラで撮像して得られた撮像データを画像処理することにより、認識対象部位に形成された認識マークを検出するものである。
【0003】
この認識マークの検出のための画像処理においては、画像上における認識マークと周囲の背景部分との輝度差に基づいて認識マークを抽出し、この抽出結果から認識マークの形状や位置が検出される。このため、認識対象部位を撮像する際には、認識マークの部分が画像上で周囲から明瞭に分離可能となるように認識マークを構成すると共に、この構成に適合した撮像条件・照明条件を採用する必要がある。
【0004】
ところで、認識マークとして薄膜に認識マークを印刷により形成したシール状のものが用いられている。このシール状の認識マークは、汎用型のサイズ・形状のものを予め準備しておくことにより、基板など種々の認識対象に貼りつけるだけで簡便に認識マークとして使用できるという利点がある。
【0005】
【発明が解決しようとする課題】
しかしながら上記従来のシール状の認識マークを用いる方法においては、認識マークの検出において以下に示すような問題点があった。シール状の認識マークの基材としては一般に銀色の薄膜が用いられ、この薄膜表面に黒点を印刷したものが認識マークとして用いられていた。すなわち、銀色の背景色上の黒点が認識対象として撮像されていた。ところがこのシール状の認識マークは、肉眼で視認した場合には黒点が明瞭に判別できるものの、カメラによって撮像した場合には画像上で黒点を背景から明瞭に識別できず、認識マークの画像認識が困難であった。
【0006】
そこで本発明は、画像上での認識マークの認識を良好に行うことができる電子部品実装用装置における認識マークの画像認識方法を提供することを目的とする。
【0007】
【課題を解決するための手段】
請求項1記載の電子部品実装用装置における認識マークの画像認識方法は、ワークの認識対象部位に貼着された認識シールを撮像することによりこの認識シールに形成された認識マークを認識対象部位から抽出して認識する電子部品実装用装置における認識マークの画像認識方法であって、前記認識シールは撮像の際に前記認識対象部位を照明する照明手段から照射される有色照明光と同系統色の薄膜から成り、この薄膜に前記認識マークを形成した
【0008】
請求項2記載の電子部品実装用装置における認識マークの画像認識方法は、請求項1記載の電子部品実装用装置における認識マークの画像認識方法であって、前記照明手段の有色照明光は赤色LEDを光源とする赤色光であり、前記薄膜は赤色である。
【0009】
本発明、撮像の際に認識対象部位を照明する照明手段の有色照明光と同系統色の薄膜から成る認識シールに認識マークを形成して成るので、背景部分である薄膜からの反射光の光量を増加させて認識マークとの明度差のコントラストを明瞭化して、良好な認識を行うことができる。
【0010】
【発明の実施の形態】
次に本発明の実施の形態を図面を参照して説明する。図1は本発明の一実施の形態の画像認識装置の構成を示すブロック図、図2(a)は本発明の一実施の形態の画像認識対象の基板の平面図、図2(b)は本発明の一実施の形態のシール状の認識マークの平面図、図3は本発明の一実施の形態の認識マークの画像認識方法の説明図である。
【0011】
まず図1を参照して画像認識装置について説明する。この画像認識装置は、電子部品搭載装置や、クリーム半田印刷装置などの電子部品実装用装置に組み込まれ、実装対象基板の位置検出を行うために用いられるものである。図1において、基板保持部2には、ワークである電子部品実装用の基板1が保持されている。基板保持部2は、位置決めテーブル3によって水平方向に移動し、位置決めされる。
【0012】
図2(a)に示すように、基板1の認識対象部位である両対角位置には、シール状の認識マークである認識シール4が貼着されている。図2(b)に示すように、認識シール4は円形の薄膜4aに黒色の認識点4b(認識マーク)を印刷したものである。ここで、薄膜4aの上面は赤色にコーティングされており、認識シール4は赤色の背景色中に黒色の認識点が形成された構成となっている。
【0013】
基板保持部2の上方には、照明装置6(照明手段)を備えたカメラ5が配設されている。基板保持部2を図示しない駆動機構によって駆動することにより保持された基板1は水平移動し、基板1に貼着された認識シール4をカメラ5の下方に位置させることができる。そして照明装置6を点灯した状態でカメラ5によって基板1の認識対象部位を撮像することにより、認識シール4を撮像することができる。ここで、照明装置6は光源として多数の赤色LEDを備えており、照明装置6を点灯することにより、下方の認識シール4の上面に赤色照明光を照射する。
【0014】
カメラ5はA/D変換部10と接続されている。A/D変換部10はカメラ5によって撮像された画像データをA/D変換する。A/D変換された画像データは画像記憶部11に記憶される。照明駆動部12は、カメラ5の撮像時に照明装置6を駆動する。テーブル駆動部13は、基板保持部2を移動させる位置決めテーブル3を駆動する。
【0015】
画像認識部15は画像記憶部11に記憶された画像データを画像処理することにより、認識シール4の薄膜4a上面の認識点4b、すなわち赤色の背景色中の黒点を抽出し、認識点4bの位置を検出する。認識結果記憶部16は、位置認識の結果検出された位置を記憶する。CPU14は、画像認識装置の上記各部を制御する。
【0016】
この画像認識装置は上記のように構成されており、以下この画像認識装置によって行われる上記認識シール4を用いた認識マークの抽出について説明する。まず、認識シール4が貼着された基板1が基板保持部2に保持されたならば、認識シール4をカメラ5の下方に位置合わせする。次いで、照明装置6を点灯して赤色LED6aを発光させ、赤色照明光(矢印a)を基板1の撮像対象部位に照射する。これにより、認識シール4は赤色光により照明され、認識シール4の表面からの反射光がカメラ5に入光することにより、認識シール4の撮像が行われる。
【0017】
この撮像においては、図3(a)に示すように、黒色の認識点4bからの反射光(矢印b)はわずかであるのに対し、認識点4bの背景色部分である薄膜4aからの反射光(矢印c)は、薄膜4aの表面が赤色照明光と同系統色の赤色となっていることから、薄膜4aからの反射光の光量は、黒色の認識点4bからの反射光と比較して格段に大きく、背景部分と認識点からは明瞭な光量比で反射光が反射される。
【0018】
これにより、この反射光をカメラ5で撮像した画像20上においては、図3(b)に示すように、認識点4bに相当する部分と背景部分である薄膜4aに相当する部分との明度のコントラストが明瞭に現れ、認識点4bを正しく抽出して良好な位置認識結果を得ることができる。
【0019】
上記述べたような、認識マークにおいて背景色に有色照明光と同系統の色を使用することの効果は、実際の撮像により明確に確認されている。すなわち、銀色の薄膜上に黒点で印刷された従来の認識シールと、本実施の形態で示す赤色の薄膜上の黒点とを同一条件で撮像して得られた画像を比較した結果において、本実施の形態の認識シールを用いた方が、格段に良好な認識精度を安定して得ることができる。
【0020】
上記実施の形態では、照明の光源として赤色LEDを用いる例を示しているがこれ以外の有色光の光源を用いてもよい。この場合には、使用する光源の有色照明光に応じた同系統色を背景色として用いる。
【0021】
さらに、上記実施の形態では、基板の位置検出用に認識マークを用いる例を示しているが、認識対象部位としては基板などのワークに限定されず、例えば部品供給ユニットやノズルストッカなど電子部品実装装置内において個々に位置検出を行う必要があるユニット類の位置認識用として用いてもよい。
【0022】
【発明の効果】
本発明、撮像の際に認識対象部位を照明する照明手段の有色照明光と同系統色の薄膜から成る認識シールに認識マークを形成して成るので、背景部分である薄膜からの反射光の光量を増加させて認識マークとの明度差のコントラストを明瞭化して、良好な認識を行うことができる。また認識対象部位としては基板などのワークに限定されず、部品供給ユニットやノズルストッカなど電子部品実装装置内において個々に位置検出を行う必要があるユニット類の位置認識用にも適用できる。
【図面の簡単な説明】
【図1】本発明の一実施の形態の画像認識装置の構成を示すブロック図
【図2】(a)本発明の一実施の形態の画像認識対象の基板の平面図
(b)本発明の一実施の形態のシール状の認識マークの平面図
【図3】本発明の一実施の形態の認識マークの画像認識方法の説明図
【符号の説明】
1 基板
4 認識シール
4a 薄膜
4b 認識点
5 カメラ
6 照明装置
6a 赤色LED
[0001]
BACKGROUND OF THE INVENTION
The present invention relates to an image recognition method for a recognition mark in an electronic component mounting apparatus that recognizes an image of a recognition mark provided on a workpiece such as a substrate in the electronic component mounting apparatus.
[0002]
[Prior art]
In electronic component mounting devices such as screen printing devices that print cream solder on substrates and electronic component mounting devices that mount electronic components on substrates after cream solder printing, such as workpieces such as substrates, component supply units, nozzle stockers, etc. A method of detecting a recognition mark by image recognition is widely used for position detection. In this method, a recognition mark formed on a recognition target part is detected by performing image processing on imaging data obtained by imaging the recognition target part with a camera.
[0003]
In the image processing for detecting the recognition mark, the recognition mark is extracted based on the luminance difference between the recognition mark on the image and the surrounding background portion, and the shape and position of the recognition mark are detected from the extraction result. . For this reason, when imaging the region to be recognized, the recognition mark is configured so that the portion of the recognition mark can be clearly separated from the surroundings on the image, and the imaging conditions and illumination conditions suitable for this configuration are adopted. There is a need to.
[0004]
By the way, as a recognition mark, a seal-like one formed by printing a recognition mark on a thin film is used. This seal-like recognition mark has an advantage that it can be used as a recognition mark simply by sticking it to various recognition objects such as a substrate by preparing a general-purpose size and shape in advance.
[0005]
[Problems to be solved by the invention]
However, the conventional method using a seal-like recognition mark has the following problems in detecting the recognition mark. As a base material for the seal-like recognition mark, a silver thin film is generally used, and a black dot printed on the thin film surface is used as the recognition mark. That is, a black spot on the silver background color is captured as a recognition target. However, this seal-like recognition mark can clearly distinguish black spots when viewed with the naked eye, but when captured by a camera, the black spots cannot be clearly distinguished from the background on the image, and the recognition mark image recognition is not possible. It was difficult.
[0006]
SUMMARY OF THE INVENTION An object of the present invention is to provide a recognition mark image recognition method in an electronic component mounting apparatus that can satisfactorily recognize a recognition mark on an image.
[0007]
[Means for Solving the Problems]
The image recognition method of the recognition mark in the electronic component mounting apparatus according to claim 1, wherein the recognition mark formed on the recognition seal is imaged from the recognition target portion by imaging the recognition sticker attached to the recognition target portion of the workpiece. An image recognition method for a recognition mark in an electronic component mounting apparatus that is extracted and recognized, wherein the recognition sticker has the same color as the colored illumination light emitted from the illumination means for illuminating the recognition target part during imaging . The recognition mark was formed on the thin film .
[0008]
The recognition mark image recognition method in the electronic component mounting apparatus according to claim 2 is the recognition mark image recognition method in the electronic component mounting apparatus according to claim 1, wherein the colored illumination light of the illumination means is a red LED. And the thin film is red.
[0009]
The present invention, therefore by forming a recognition mark in recognition seal consisting of colored illumination light and the main colors of the thin film of the illumination means for illuminating the recognition target region during the imaging, the reflected light from the thin film is a background portion By increasing the amount of light and clarifying the contrast of the brightness difference with the recognition mark, good recognition can be performed.
[0010]
DETAILED DESCRIPTION OF THE INVENTION
Next, embodiments of the present invention will be described with reference to the drawings. FIG. 1 is a block diagram showing a configuration of an image recognition apparatus according to an embodiment of the present invention, FIG. 2A is a plan view of a substrate that is an image recognition target according to an embodiment of the present invention, and FIG. FIG. 3 is an explanatory view of a recognition mark image recognition method according to an embodiment of the present invention.
[0011]
First, an image recognition apparatus will be described with reference to FIG. This image recognition apparatus is incorporated in an electronic component mounting apparatus such as an electronic component mounting apparatus or a cream solder printing apparatus, and is used for detecting the position of a mounting target board. In FIG. 1, a substrate holding unit 2 holds a substrate 1 for mounting an electronic component, which is a workpiece. The substrate holder 2 is moved and positioned by the positioning table 3 in the horizontal direction.
[0012]
As shown in FIG. 2A, a recognition seal 4 that is a seal-like recognition mark is attached to both diagonal positions that are recognition target portions of the substrate 1. As shown in FIG. 2B, the recognition sticker 4 is obtained by printing a black recognition point 4b (recognition mark) on a circular thin film 4a. Here, the upper surface of the thin film 4a is coated in red, and the recognition seal 4 has a configuration in which a black recognition point is formed in a red background color.
[0013]
Above the substrate holding unit 2, a camera 5 having an illumination device 6 (illuminating means) is disposed. The substrate 1 held by driving the substrate holding unit 2 by a driving mechanism (not shown) moves horizontally, and the recognition seal 4 attached to the substrate 1 can be positioned below the camera 5. And the recognition sticker 4 can be imaged by imaging the recognition object site | part of the board | substrate 1 with the camera 5 in the state which turned on the illuminating device 6. FIG. Here, the illuminating device 6 includes a large number of red LEDs as a light source. When the illuminating device 6 is turned on, the upper surface of the lower recognition seal 4 is irradiated with red illumination light.
[0014]
The camera 5 is connected to the A / D conversion unit 10. The A / D conversion unit 10 performs A / D conversion on the image data captured by the camera 5. The A / D converted image data is stored in the image storage unit 11. The illumination drive unit 12 drives the illumination device 6 when the camera 5 captures an image. The table driving unit 13 drives the positioning table 3 that moves the substrate holding unit 2.
[0015]
The image recognition unit 15 performs image processing on the image data stored in the image storage unit 11 to extract the recognition point 4b on the upper surface of the thin film 4a of the recognition sticker 4, that is, the black point in the red background color. Detect position. The recognition result storage unit 16 stores a position detected as a result of position recognition. CPU14 controls each said part of an image recognition apparatus.
[0016]
This image recognition apparatus is configured as described above. Hereinafter, extraction of a recognition mark using the recognition seal 4 performed by the image recognition apparatus will be described. First, when the substrate 1 to which the recognition seal 4 is attached is held by the substrate holding unit 2, the recognition seal 4 is aligned below the camera 5. Next, the illuminating device 6 is turned on to cause the red LED 6a to emit light, and the imaging target portion of the substrate 1 is irradiated with red illumination light (arrow a). As a result, the recognition sticker 4 is illuminated with red light, and reflected light from the surface of the recognition sticker 4 enters the camera 5, whereby the recognition sticker 4 is imaged.
[0017]
In this imaging, as shown in FIG. 3A, the reflected light (arrow b) from the black recognition point 4b is slight, whereas the reflection from the thin film 4a which is the background color portion of the recognition point 4b. As for the light (arrow c), the surface of the thin film 4a is red in the same color as the red illumination light, so the amount of reflected light from the thin film 4a is compared with the reflected light from the black recognition point 4b. The reflected light is reflected with a clear light quantity ratio from the background portion and the recognition point.
[0018]
Thereby, on the image 20 obtained by capturing this reflected light with the camera 5, as shown in FIG. 3B, the brightness of the portion corresponding to the recognition point 4b and the portion corresponding to the thin film 4a which is the background portion. The contrast appears clearly, and the recognition point 4b can be correctly extracted to obtain a good position recognition result.
[0019]
The effect of using the same color as the colored illumination light as the background color in the recognition mark as described above has been clearly confirmed by actual imaging. That is, in the result of comparing the image obtained by imaging the conventional recognition sticker printed with a black dot on the silver thin film and the black dot on the red thin film shown in this embodiment under the same conditions, By using the recognition sticker of the form, it is possible to stably obtain much better recognition accuracy.
[0020]
In the above embodiment, an example in which a red LED is used as a light source for illumination is shown, but a colored light source other than this may be used. In this case, the same color corresponding to the colored illumination light of the light source to be used is used as the background color.
[0021]
Furthermore, in the above-described embodiment, an example in which a recognition mark is used for detecting the position of the board is shown. However, the recognition target part is not limited to a workpiece such as a board. For example, electronic component mounting such as a component supply unit or a nozzle stocker You may use for the position recognition of the units which need to detect a position individually in an apparatus.
[0022]
【The invention's effect】
The present invention, therefore by forming a recognition mark in recognition seal consisting of colored illumination light and the main colors of the thin film of the illumination means for illuminating the recognition target region during the imaging, the reflected light from the thin film is a background portion By increasing the amount of light and clarifying the contrast of the brightness difference with the recognition mark, good recognition can be performed. The recognition target part is not limited to a workpiece such as a substrate, but can be applied to position recognition of units that need to individually detect positions in an electronic component mounting apparatus such as a component supply unit and a nozzle stocker.
[Brief description of the drawings]
FIG. 1 is a block diagram illustrating a configuration of an image recognition apparatus according to an embodiment of the present invention. FIG. 2A is a plan view of a substrate that is an image recognition target according to an embodiment of the present invention. FIG. 3 is a plan view of a seal-like recognition mark according to an embodiment.
1 Substrate 4 Recognition seal 4a Thin film 4b Recognition point 5 Camera 6 Illumination device 6a Red LED

Claims (2)

ワークの認識対象部位に貼着された認識シールを撮像することによりこの認識シールに形成された認識マークを認識対象部位から抽出して認識する電子部品実装用装置における認識マークの画像認識方法であって、前記認識シールは撮像の際に前記認識対象部位を照明する照明手段から照射される有色照明光と同系統色の薄膜から成り、この薄膜に前記認識マークを形成したことを特徴とする電子部品実装用装置における認識マークの画像認識方法。This is an image recognition method for a recognition mark in an electronic component mounting apparatus that extracts and recognizes a recognition mark formed on a recognition sticker by imaging the recognition sticker attached to the recognition target part of the workpiece. The recognition sticker is made of a thin film having the same color as the colored illumination light emitted from the illumination means for illuminating the recognition target part during imaging, and the recognition mark is formed on the thin film. An image recognition method for a recognition mark in a component mounting apparatus. 前記照明手段の有色照明光は赤色LEDを光源とする赤色光であり、前記薄膜は赤色であることを特徴とする請求項1記載の電子部品実装用装置における認識マークの画像認識方法。2. A method for recognizing an image of a recognition mark in an electronic component mounting apparatus according to claim 1, wherein the colored illumination light of the illumination means is red light using a red LED as a light source, and the thin film is red.
JP2000179663A 2000-06-15 2000-06-15 Image recognition method for recognition mark in electronic component mounting apparatus Expired - Fee Related JP3680704B2 (en)

Priority Applications (1)

Application Number Priority Date Filing Date Title
JP2000179663A JP3680704B2 (en) 2000-06-15 2000-06-15 Image recognition method for recognition mark in electronic component mounting apparatus

Applications Claiming Priority (1)

Application Number Priority Date Filing Date Title
JP2000179663A JP3680704B2 (en) 2000-06-15 2000-06-15 Image recognition method for recognition mark in electronic component mounting apparatus

Publications (2)

Publication Number Publication Date
JP2001356006A JP2001356006A (en) 2001-12-26
JP3680704B2 true JP3680704B2 (en) 2005-08-10

Family

ID=18680894

Family Applications (1)

Application Number Title Priority Date Filing Date
JP2000179663A Expired - Fee Related JP3680704B2 (en) 2000-06-15 2000-06-15 Image recognition method for recognition mark in electronic component mounting apparatus

Country Status (1)

Country Link
JP (1) JP3680704B2 (en)

Families Citing this family (5)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
JP4648112B2 (en) * 2004-07-05 2011-03-09 パナソニック株式会社 Image generation method for parts
EP1887512A4 (en) 2005-06-02 2008-08-13 Matsushita Electric Ind Co Ltd Automatic part teaching device
JP5651221B2 (en) * 2013-09-30 2015-01-07 株式会社キングジム Symbol piece, image processing program, and image processing method
CN107461631A (en) * 2017-09-01 2017-12-12 苏州苏大维格光电科技股份有限公司 A kind of portable illumination device and identifying system
WO2022203364A1 (en) * 2021-03-26 2022-09-29 삼성전자 주식회사 Electronic device comprising housing comprising fiducial mark and method of manufacturing same

Also Published As

Publication number Publication date
JP2001356006A (en) 2001-12-26

Similar Documents

Publication Publication Date Title
JP4797081B2 (en) Mounting method of lens parts
US6529624B1 (en) Apparatus for inspecting cream solder on PCB and method thereof
JP3680704B2 (en) Image recognition method for recognition mark in electronic component mounting apparatus
EP1595138B1 (en) Image recognition apparatus and image recognition method
JP2008216059A (en) Inspection apparatus of printed board
JP2000124683A (en) Image pickup of electronic component and electronic component mounting equipment
JP2000028320A (en) Image recognizing equipment and image recognizing method
JP4818572B2 (en) Image recognition apparatus and image recognition method
JP2002048731A (en) Mounted base board visual inspection device and its visual inspection method
JP4818571B2 (en) Image recognition apparatus and image recognition method
JP2775411B2 (en) Lighting equipment for printed wiring board inspection equipment
JPH05288527A (en) Appearance inspecting method for mounted board and its device
JP3184339B2 (en) Screen printing device with paste cover
JP2001068900A (en) Mounted part checking method and device, and lighting equipment
JP4380926B2 (en) Auto handler for COF
JPH06237094A (en) Method and device for illumination of suction part
JP3402994B2 (en) Solder paste quality judgment method
JP2002048732A (en) Visual inspection device and visual inspection method
JP3622606B2 (en) Position recognition device
JP2734573B2 (en) Illumination device for ceramic substrate mark recognition
JPH08222896A (en) Illuminator for mounting machine
KR19990018439A (en) Component Inspection Device
JP2005101263A (en) Electronic part packaging device
JPH02132306A (en) Part position detecting device
JPH05296744A (en) Form measuring device

Legal Events

Date Code Title Description
A977 Report on retrieval

Free format text: JAPANESE INTERMEDIATE CODE: A971007

Effective date: 20040622

A131 Notification of reasons for refusal

Free format text: JAPANESE INTERMEDIATE CODE: A131

Effective date: 20040713

A521 Written amendment

Free format text: JAPANESE INTERMEDIATE CODE: A523

Effective date: 20040903

TRDD Decision of grant or rejection written
A01 Written decision to grant a patent or to grant a registration (utility model)

Free format text: JAPANESE INTERMEDIATE CODE: A01

Effective date: 20050426

A61 First payment of annual fees (during grant procedure)

Free format text: JAPANESE INTERMEDIATE CODE: A61

Effective date: 20050509

R151 Written notification of patent or utility model registration

Ref document number: 3680704

Country of ref document: JP

Free format text: JAPANESE INTERMEDIATE CODE: R151

FPAY Renewal fee payment (event date is renewal date of database)

Free format text: PAYMENT UNTIL: 20090527

Year of fee payment: 4

FPAY Renewal fee payment (event date is renewal date of database)

Free format text: PAYMENT UNTIL: 20100527

Year of fee payment: 5

FPAY Renewal fee payment (event date is renewal date of database)

Free format text: PAYMENT UNTIL: 20110527

Year of fee payment: 6

FPAY Renewal fee payment (event date is renewal date of database)

Free format text: PAYMENT UNTIL: 20110527

Year of fee payment: 6

FPAY Renewal fee payment (event date is renewal date of database)

Free format text: PAYMENT UNTIL: 20120527

Year of fee payment: 7

FPAY Renewal fee payment (event date is renewal date of database)

Free format text: PAYMENT UNTIL: 20120527

Year of fee payment: 7

FPAY Renewal fee payment (event date is renewal date of database)

Free format text: PAYMENT UNTIL: 20130527

Year of fee payment: 8

FPAY Renewal fee payment (event date is renewal date of database)

Free format text: PAYMENT UNTIL: 20130527

Year of fee payment: 8

LAPS Cancellation because of no payment of annual fees