JP4629590B2 - Personal identification device - Google Patents

Personal identification device Download PDF

Info

Publication number
JP4629590B2
JP4629590B2 JP2006027166A JP2006027166A JP4629590B2 JP 4629590 B2 JP4629590 B2 JP 4629590B2 JP 2006027166 A JP2006027166 A JP 2006027166A JP 2006027166 A JP2006027166 A JP 2006027166A JP 4629590 B2 JP4629590 B2 JP 4629590B2
Authority
JP
Japan
Prior art keywords
fingerprint
subject
light
light source
personal identification
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Expired - Fee Related
Application number
JP2006027166A
Other languages
Japanese (ja)
Other versions
JP2007207097A (en
Inventor
睦彦 堀江
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
Mitsubishi Electric Corp
Original Assignee
Mitsubishi Electric Corp
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Mitsubishi Electric Corp filed Critical Mitsubishi Electric Corp
Priority to JP2006027166A priority Critical patent/JP4629590B2/en
Publication of JP2007207097A publication Critical patent/JP2007207097A/en
Application granted granted Critical
Publication of JP4629590B2 publication Critical patent/JP4629590B2/en
Expired - Fee Related legal-status Critical Current
Anticipated expiration legal-status Critical

Links

Images

Landscapes

  • Measurement Of The Respiration, Hearing Ability, Form, And Blood Characteristics Of Living Organisms (AREA)
  • Image Input (AREA)

Description

この発明は、個人識別装置に関し、特に、個人の生体情報である指紋画像を安定して得ることで個人識別の性能の性能を向上させるための個人識別装置に関する。   The present invention relates to a personal identification device, and more particularly to a personal identification device for improving the performance of personal identification performance by stably obtaining a fingerprint image which is personal biometric information.

従来、この種の個人識別装置として、被検体の指紋表面を非接触状態で支持し、爪側から透過光を照射して指紋画像を撮像する個人識別装置がある（例えば、特許文献１参照）。また、指の表面の包絡面に対してほぼ垂直に照明光を照射し、回転走査して指紋パターンを撮像する指紋像入力装置がある（例えば、特許文献２参照）。   Conventionally, as this type of personal identification device, there is a personal identification device that supports a fingerprint surface of a subject in a non-contact state and shoots a fingerprint image by irradiating transmitted light from the nail side (see, for example, Patent Document 1). . In addition, there is a fingerprint image input apparatus that irradiates illumination light substantially perpendicularly to the envelope surface of the finger surface and rotates and scans to capture a fingerprint pattern (see, for example, Patent Document 2).

特開２００３−８５５３８号公報JP 2003-85538 A 特開平６−１７６１３６号公報JP-A-6-176136

しかしながら、従来の個人識別装置は、個人毎の指の厚さや形状の異なりに対応するものでなかった。   However, conventional personal identification devices have not been adapted to differences in finger thickness and shape for each individual.

この発明は、上述した点に鑑みてなされたもので、個人毎の指の厚さや形状の異なっていても最もコントラストの良い指紋画像を得て個人識別することができる個人識別装置を得ることを目的とする。   The present invention has been made in view of the above points, and it is an object of the present invention to obtain a personal identification device capable of obtaining a fingerprint image with the highest contrast even when the thickness or shape of a finger for each individual is different and identifying the individual. Objective.

この発明に係る個人識別装置は、被検体の指紋に対し当該被検体の指紋表面とは反対側の爪側上部から光が当該被検体を透過する光路長が異なるように照射角度が異なる透過光を照射するための複数の光源と、被検体の指紋表面を非接触状態で支持する被検体支持部と、前記被検体支持部に支持された前記被検体の指紋を透過する照射角度の異なる前記複数の光源を１個ずつ順次点灯して前記被検体を透過した透過光を読取り当該被検体の指紋に対応する複数の指紋画像を得る撮像手段と、前記撮像手段からの複数の指紋画像を画像処理してコントラストが最も良い指紋画像を選択して個人識別する信号処理部とを備えたものである。
The personal identification device according to the present invention transmits transmitted light having different irradiation angles so that light passes through the subject from the nail side upper part opposite to the fingerprint surface of the subject with respect to the subject's fingerprint. A plurality of light sources for irradiating the object, a subject support part that supports the fingerprint surface of the subject in a non-contact state, and a different irradiation angle that transmits the fingerprint of the subject supported by the subject support part An imaging unit that sequentially turns on a plurality of light sources one by one and reads transmitted light that has passed through the subject to obtain a plurality of fingerprint images corresponding to the fingerprint of the subject, and a plurality of fingerprint images from the imaging unit A signal processing unit for processing and selecting a fingerprint image with the best contrast to identify the person.

また、他の発明に係る個人識別装置は、被検体の指紋に対し当該被検体の指紋表面とは反対側の爪側上部から透過光を照射するための光源と、被検体の指紋表面を非接触状態で支持すると共に、指先を置くと下に下がる可動部と、当該可動部が一定範囲以下に下がったことを検出するセンサー部とを有し、前記センサー部が一定範囲以下に下がったことを検出するまで前記光源との距離を順次可変とする可動式の被検体支持部と、前記光源との距離を順次可変とした前記被検体支持部に支持された前記被検体の指紋を透過する前記光源からの光を撮像して指紋に対応する複数の指紋画像を得る撮像手段と、前記撮像手段からの複数の指紋画像を画像処理してコントラストが最も良い指紋画像を選択して個人識別する信号処理部とを備えたものである。
In addition, a personal identification device according to another aspect of the present invention provides a light source for irradiating transmitted light from the upper part of the nail opposite to the fingerprint surface of the subject with respect to the fingerprint of the subject, and the fingerprint surface of the subject. A movable part that supports in a contact state and lowers when a fingertip is placed, and a sensor part that detects that the movable part has fallen below a certain range, and the sensor part has fallen below a certain range A movable object support unit that can sequentially change the distance to the light source until the detection is detected, and the fingerprint of the object that is supported by the object support unit that can sequentially change the distance to the light source. An image capturing unit that captures light from the light source to obtain a plurality of fingerprint images corresponding to a fingerprint, and a plurality of fingerprint images from the image capturing unit are subjected to image processing to select a fingerprint image having the best contrast to identify the individual With signal processor A.

この発明によれば、指先の形状・太さ等の個人差によらず安定した透過画像が得られ、最もコントラストの良い指紋画像を得て個人識別することができる。   According to the present invention, a stable transmission image can be obtained regardless of individual differences such as the shape and thickness of the fingertip, and the fingerprint image with the best contrast can be obtained to identify the individual.

実施の形態１．
図１は、この発明の実施の形態１に係る個人識別装置の構成を示すブロック図である。図１に示される個人識別装置は、指紋を有する被検体である指１の爪側に対し照射角度が異なる透過光を照射するための複数の光源３１〜３３を有する光源３と、指１の指紋表面を非接触状態で支持する指支持部２Ａ，２Ｂと、指支持部２Ａ，２Ｂに支持された指１の指紋を透過する照射角度の異なる複数の光源３１〜３３からの光を撮像して指紋に対応する複数の指紋画像を得る撮像部４と、前記撮像部４からの複数の指紋画像を画像処理してコントラストが最も良い指紋画像を選択して個人識別する信号処理部５とを備えており、前記光源３１〜３３の光軸は、少しづつ角度を変えて設置されている。 Embodiment 1 FIG.
FIG. 1 is a block diagram showing the configuration of the personal identification device according to Embodiment 1 of the present invention. The personal identification device shown in FIG. 1 includes a light source 3 having a plurality of light sources 31 to 33 for irradiating transmitted light having different irradiation angles to a nail side of a finger 1 that is a subject having a fingerprint, Images of light from a plurality of light sources 31 to 33 having different irradiation angles that transmit the fingerprint of the finger 1 supported by the finger supports 2A and 2B and the finger supports 2A and 2B that support the fingerprint surface in a non-contact state. An image pickup unit 4 for obtaining a plurality of fingerprint images corresponding to fingerprints, and a signal processing unit 5 for performing image processing on the plurality of fingerprint images from the image pickup unit 4 to select a fingerprint image having the best contrast and for personal identification. The optical axes of the light sources 31 to 33 are installed at slightly different angles.

ここで、前記撮像部４としては、指１を透過した光の光強度分布を得るための結像レンズ４１及び例えば２次元固体撮像素子（ＣＣＤ、ＣＭＯＳイメージセンサ）でなる撮像素子４２と、撮像素子４２からの光強度分布に応じた電気信号を入力し、指紋画像を画像信号として出力する画像出力回路４３とを有する。   Here, the imaging unit 4 includes an imaging lens 41 for obtaining a light intensity distribution of light transmitted through the finger 1, an imaging element 42 such as a two-dimensional solid-state imaging element (CCD, CMOS image sensor), and imaging. An image output circuit 43 that inputs an electrical signal corresponding to the light intensity distribution from the element 42 and outputs a fingerprint image as an image signal is provided.

次に、上記構成に係る個人識別装置の動作について説明する。指１が指支持部２Ａ，２Ｂに置かれたことを検知すると、まず始めに、光源３１を点灯し、指１を透過した透過光を撮像部４で読み取り、指紋画像を信号処理部５で処理する。次に、光源３２を点灯し、同様にして指紋画像を採取する。さらに、最後に、光源３３を点灯し、同様にして指紋画像を採取する。   Next, the operation of the personal identification device according to the above configuration will be described. When it is detected that the finger 1 is placed on the finger supports 2A and 2B, first, the light source 31 is turned on, the transmitted light transmitted through the finger 1 is read by the imaging unit 4, and the fingerprint image is read by the signal processing unit 5. To process. Next, the light source 32 is turned on, and a fingerprint image is collected in the same manner. Finally, the light source 33 is turned on and a fingerprint image is collected in the same manner.

上述したようにして採取された３枚の指紋画像は、信号処理部５に入力され、信号処理部５において、コントラストの最もよい画像が選択され、指紋の登録・照合用に使用される。   The three fingerprint images collected as described above are input to the signal processing unit 5, and an image with the best contrast is selected by the signal processing unit 5 and used for fingerprint registration / collation.

したがって、実施の形態１によれば、照射角度の異なる複数の光源３１〜３３を順次点灯させて指紋画像を撮像するようにしたので、指先の形状・太さ等の個人差によらず安定した透過画像が得られ、最もコントラストの良い指紋画像を得て個人識別することができる。   Therefore, according to the first embodiment, since a plurality of light sources 31 to 33 having different irradiation angles are sequentially turned on to capture a fingerprint image, it is stable regardless of individual differences such as fingertip shape and thickness. A transparent image is obtained, and a fingerprint image with the highest contrast can be obtained to identify the individual.

実施の形態２．
図２は、この発明の実施の形態２に係る個人識別装置の構成を示すブロック図である。図２に示される個人識別装置において、図１に示す構成と同一部分は同一符号を付してその説明は省略する。図２に示す実施の形態２においては、光源３は、単一の光源でなり、指支持部２Ａ，２Ｂは、光源３との距離を順次可変とする可動式の指支持部でなる点が、図１に示す実施の形態１と異なる。 Embodiment 2. FIG.
FIG. 2 is a block diagram showing the configuration of the personal identification device according to Embodiment 2 of the present invention. In the personal identification device shown in FIG. 2, the same parts as those shown in FIG. In the second embodiment shown in FIG. 2, the light source 3 is a single light source, and the finger support portions 2 </ b> A and 2 </ b> B are movable finger support portions whose distance from the light source 3 can be sequentially changed. This is different from the first embodiment shown in FIG.

ここで、指支持部２Ａ，２Ｂは、図２の指支持部２Ａに示すように、指先を置くと下に下がる可動部２１と、可動部２１が一定値以下に下がったことを検出するセンサー部２２とで構成されている。   Here, as shown in the finger support 2A in FIG. 2, the finger supports 2A and 2B are a movable part 21 that is lowered when a fingertip is placed, and a sensor that detects that the movable part 21 has fallen below a certain value. Part 22.

そして、撮像部４は、可動する指支持部２Ａ，２Ｂに支持された指１の指紋を透過する光源３からの光を撮像して指紋に対応する複数の指紋画像を得るようになされ、信号処理部５は、撮像部４からの複数の指紋画像を画像処理してコントラストが最も良い指紋画像を選択して個人識別するようになされている。   The imaging unit 4 captures light from the light source 3 that transmits the fingerprint of the finger 1 supported by the movable finger support units 2A and 2B, and obtains a plurality of fingerprint images corresponding to the fingerprints. The processing unit 5 performs image processing on a plurality of fingerprint images from the imaging unit 4 and selects a fingerprint image having the best contrast to identify the individual.

次に、上記構成に係る個人識別装置の動作について説明する。指支持部２Ａ，２Ｂに指１が置かれたことを検知すると、光源３を点灯し、指１を透過した透過光をレンズ４１やＣＣＤ４２などのセンサーで構成された撮像部４で読み取り、その画像は信号処理部５に送られる。   Next, the operation of the personal identification device according to the above configuration will be described. When it is detected that the finger 1 is placed on the finger support portions 2A and 2B, the light source 3 is turned on, and the transmitted light that has passed through the finger 1 is read by the imaging unit 4 including sensors such as the lens 41 and the CCD 42. The image is sent to the signal processing unit 5.

次に、指１を指支持部２Ａ，２Ｂに置くことで、指支持部２Ａ，２Ｂの指先部分の可動部２１が少しずつ下にさがってくる。このとき、同様にして、一定間隔で順次透過光を撮像部４で読み取り、その画像は、信号処理部５へ送られる。   Next, by placing the finger 1 on the finger support portions 2A and 2B, the movable portion 21 of the fingertip portion of the finger support portions 2A and 2B is gradually lowered. At this time, similarly, the transmitted light is sequentially read by the imaging unit 4 at regular intervals, and the image is sent to the signal processing unit 5.

この動作は、可動部２１が一定範囲以下に下がったことをセンサー部２２が検出するまで繰り返す。信号処理部５では、送られてきた画像の中でコントラストが最もよい画像が選択され、指紋の登録・照合用に使用される。   This operation is repeated until the sensor unit 22 detects that the movable unit 21 has fallen below a certain range. In the signal processing unit 5, an image having the best contrast is selected from the transmitted images and used for fingerprint registration / collation.

なお、図２に示す実施の形態２では、可動部２１の構成として、バネによる実施の形態を示したものであるが、モータによる可動部の駆動などに置き換えてもよい。   In the second embodiment shown in FIG. 2, the movable portion 21 is configured with a spring as an example, but may be replaced with a drive of the movable portion with a motor.

従って、実施の形態２によれば、指支持部２Ａ，２Ｂを、光源３との距離を順次可変とする可動式の指支持部で構成し、指を置いたときに指先で押し下げる操作により、画像を連続撮像するようにしたので、指先の形状・太さ等の個人差によらず安定した透過画像が得られ、最もコントラストの高い画像を登録・照合用に採用することにより、簡単にかつ低コストで高性能な装置を構成することができる。   Therefore, according to the second embodiment, the finger support portions 2A and 2B are configured with a movable finger support portion whose distance from the light source 3 can be sequentially changed, and when the finger is placed, the finger support portions 2A and 2B are pushed down with the fingertip. Since images are continuously captured, a stable transmission image can be obtained regardless of individual differences such as the shape and thickness of the fingertips, and the highest contrast image can be used for registration and verification. A high-performance apparatus can be configured at low cost.

この発明の実施の形態１に係る個人識別装置の構成を示すブロック図である。It is a block diagram which shows the structure of the personal identification device which concerns on Embodiment 1 of this invention. この発明の実施の形態２に係る個人識別装置の構成を示すブロック図である。It is a block diagram which shows the structure of the personal identification device which concerns on Embodiment 2 of this invention.

符号の説明Explanation of symbols

１ 指、２Ａ，２Ｂ 指支持部、３，３１〜３３ 光源、４ 撮像部、５ 信号処理部。   1 finger, 2A, 2B finger support part, 3, 31-33 light source, 4 imaging part, 5 signal processing part.

Claims (2)

被検体の指紋に対し当該被検体の指紋表面とは反対側の爪側上部から光が当該被検体を透過する光路長が異なるように照射角度が異なる透過光を照射するための複数の光源と、
被検体の指紋表面を非接触状態で支持する被検体支持部と、
前記被検体支持部に支持された前記被検体の指紋を透過する照射角度の異なる前記複数の光源を１個ずつ順次点灯して前記被検体を透過した透過光を読取り当該被検体の指紋に対応する複数の指紋画像を得る撮像手段と、
前記撮像手段からの複数の指紋画像を画像処理してコントラストが最も良い指紋画像を選択して個人識別する信号処理部と
を備えた個人識別装置。 A plurality of light sources for irradiating transmitted light with different irradiation angles so that light passes through the subject from the nail side upper part opposite to the fingerprint surface of the subject with respect to the subject's fingerprint; ,
A subject support unit that supports the fingerprint surface of the subject in a non-contact state;
Corresponding to the fingerprint of the subject by sequentially turning on each of the plurality of light sources with different irradiation angles that pass through the subject's fingerprint supported by the subject support unit and reading the transmitted light that has passed through the subject Imaging means for obtaining a plurality of fingerprint images;
A personal identification device comprising: a signal processing unit that performs image processing on a plurality of fingerprint images from the imaging unit and selects a fingerprint image having the best contrast to identify the individual. 被検体の指紋に対し当該被検体の指紋表面とは反対側の爪側上部から透過光を照射するための光源と、
被検体の指紋表面を非接触状態で支持すると共に、指先を置くと下に下がる可動部と、当該可動部が一定範囲以下に下がったことを検出するセンサー部とを有し、前記センサー部が一定範囲以下に下がったことを検出するまで前記光源との距離を順次可変とする可動式の被検体支持部と、
前記光源との距離を順次可変とした前記被検体支持部に支持された前記被検体の指紋を透過する前記光源からの光を撮像して指紋に対応する複数の指紋画像を得る撮像手段と、 前記撮像手段からの複数の指紋画像を画像処理してコントラストが最も良い指紋画像を選択して個人識別する信号処理部と
を備えた個人識別装置。 A light source for irradiating transmitted light from the upper part of the nail opposite to the fingerprint surface of the subject with respect to the fingerprint of the subject;
A movable part that supports the fingerprint surface of the subject in a non-contact state and lowers when a fingertip is placed, and a sensor part that detects that the movable part has fallen below a certain range, the sensor part being A movable subject support that sequentially varies the distance from the light source until it is detected that the distance falls below a certain range;
An imaging means for obtaining a plurality of fingerprint images corresponding to fingerprints by imaging light from the light source that transmits the fingerprint of the subject supported by the subject support unit, the distance from the light source being sequentially variable; A personal identification device comprising: a signal processing unit that performs image processing on a plurality of fingerprint images from the imaging unit and selects a fingerprint image having the best contrast to identify the individual.
JP2006027166A 2006-02-03 2006-02-03 Personal identification device Expired - Fee Related JP4629590B2 (en)

Priority Applications (1)

Application Number Priority Date Filing Date Title
JP2006027166A JP4629590B2 (en) 2006-02-03 2006-02-03 Personal identification device

Applications Claiming Priority (1)

Application Number Priority Date Filing Date Title
JP2006027166A JP4629590B2 (en) 2006-02-03 2006-02-03 Personal identification device

Publications (2)

Publication Number Publication Date
JP2007207097A JP2007207097A (en) 2007-08-16
JP4629590B2 true JP4629590B2 (en) 2011-02-09

Family

ID=38486493

Family Applications (1)

Application Number Title Priority Date Filing Date
JP2006027166A Expired - Fee Related JP4629590B2 (en) 2006-02-03 2006-02-03 Personal identification device

Country Status (1)

Country Link
JP (1) JP4629590B2 (en)

Citations (5)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
JPH11183389A (en) * 1997-12-18 1999-07-09 Lintec Corp Observing device
JP2001520392A (en) * 1997-10-08 2001-10-30 シーメンス アクチエンゲゼルシヤフト Lighting setting method in an apparatus for position identification and / or quality inspection of components and / or substrates
JP2003242487A (en) * 2002-02-15 2003-08-29 Canon Inc Image recognizing device
JP2004021617A (en) * 2002-06-17 2004-01-22 Casio Comput Co Ltd Fingerprint reader and method therefor
JP2004290664A (en) * 2003-03-13 2004-10-21 Mitsubishi Electric Corp Identification device and fingerprint picture imaging method

Patent Citations (5)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
JP2001520392A (en) * 1997-10-08 2001-10-30 シーメンス アクチエンゲゼルシヤフト Lighting setting method in an apparatus for position identification and / or quality inspection of components and / or substrates
JPH11183389A (en) * 1997-12-18 1999-07-09 Lintec Corp Observing device
JP2003242487A (en) * 2002-02-15 2003-08-29 Canon Inc Image recognizing device
JP2004021617A (en) * 2002-06-17 2004-01-22 Casio Comput Co Ltd Fingerprint reader and method therefor
JP2004290664A (en) * 2003-03-13 2004-10-21 Mitsubishi Electric Corp Identification device and fingerprint picture imaging method

Also Published As

Publication number Publication date
JP2007207097A (en) 2007-08-16

Similar Documents

Publication Publication Date Title
US7218761B2 (en) System for obtaining print and other hand characteristic information using a non-planar prism
ES2347687T3 (en) QUALITY AND SEGMENTATION OF THE PREVIEW OF A DACTILAR FOOTPRINT.
JP4738532B2 (en) Non-contact fingerprint image acquisition device using a mirror
US20180018500A1 (en) Identification apparatus and identification method
EP2074946A1 (en) Hybrid Multi-Sensor Biometric Identification Device
US20150130917A1 (en) Miniature contactless fingerprinting device
GB2400714A (en) Combined optical fingerprint recogniser and navigation control
JP2019502986A (en) Terminal with fingerprint recognition function
US20180225502A1 (en) Fingerprint identification device and fingerprint identification method
US20140253711A1 (en) Agile non-contact biometric sensor
JP2014192828A (en) Image correction device, image correction method, and biometric authentication device
JP4344876B2 (en) Biometric authentication device
JP6443349B2 (en) Biometric authentication device and biometric authentication method using finger authentication prism
CN111868734A (en) Contactless rolling fingerprint
KR100895274B1 (en) Contactless type of sequential fingerprint images capturing apparatus
US8666127B1 (en) Method and apparatus for fake fingerprint detection
US7180643B2 (en) Live print scanner with holographic imaging a different magnifications
JP4629590B2 (en) Personal identification device
KR101147137B1 (en) Apparatus for extracting fingerprint and finger-vein information
JP5229490B2 (en) Biometric authentication device
JP2006215975A (en) Fingerprint verification device
WO2012005163A1 (en) Imaging device, method of imaging and recording medium with control program for imaging device recorded thereon
JP2006068047A (en) Biological information acquisition apparatus and method
JP4301877B2 (en) Fingerprint verification device
JP2018120383A (en) Biological image processing system, biological image processing method, biological image processing program, storing medium for storing biological image processing program

Legal Events

Date Code Title Description
A621 Written request for application examination

Free format text: JAPANESE INTERMEDIATE CODE: A621

Effective date: 20080829

A131 Notification of reasons for refusal

Free format text: JAPANESE INTERMEDIATE CODE: A131

Effective date: 20091201

A521 Request for written amendment filed

Free format text: JAPANESE INTERMEDIATE CODE: A523

Effective date: 20091228

A131 Notification of reasons for refusal

Free format text: JAPANESE INTERMEDIATE CODE: A131

Effective date: 20100309

A521 Request for written amendment filed

Free format text: JAPANESE INTERMEDIATE CODE: A523

Effective date: 20100430

A02 Decision of refusal

Free format text: JAPANESE INTERMEDIATE CODE: A02

Effective date: 20100629

A521 Request for written amendment filed

Free format text: JAPANESE INTERMEDIATE CODE: A523

Effective date: 20100913

A911 Transfer to examiner for re-examination before appeal (zenchi)

Free format text: JAPANESE INTERMEDIATE CODE: A911

Effective date: 20101007

TRDD Decision of grant or rejection written
A01 Written decision to grant a patent or to grant a registration (utility model)

Free format text: JAPANESE INTERMEDIATE CODE: A01

Effective date: 20101109

A01 Written decision to grant a patent or to grant a registration (utility model)

Free format text: JAPANESE INTERMEDIATE CODE: A01

A61 First payment of annual fees (during grant procedure)

Free format text: JAPANESE INTERMEDIATE CODE: A61

Effective date: 20101111

FPAY Renewal fee payment (event date is renewal date of database)

Free format text: PAYMENT UNTIL: 20131119

Year of fee payment: 3

R150 Certificate of patent or registration of utility model

Free format text: JAPANESE INTERMEDIATE CODE: R150

LAPS Cancellation because of no payment of annual fees