JPH07334765A - Light beam type body detecting device - Google Patents

Light beam type body detecting device

Info

Publication number
JPH07334765A
JPH07334765A JP6126245A JP12624594A JPH07334765A JP H07334765 A JPH07334765 A JP H07334765A JP 6126245 A JP6126245 A JP 6126245A JP 12624594 A JP12624594 A JP 12624594A JP H07334765 A JPH07334765 A JP H07334765A
Authority
JP
Japan
Prior art keywords
reflected light
area
areas
light
amount
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Granted
Application number
JP6126245A
Other languages
Japanese (ja)
Other versions
JP3229122B2 (en
Inventor
Hiroyuki Oba
浩之 大庭
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
Opt KK
Original Assignee
Opt KK
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Opt KK filed Critical Opt KK
Priority to JP12624594A priority Critical patent/JP3229122B2/en
Publication of JPH07334765A publication Critical patent/JPH07334765A/en
Application granted granted Critical
Publication of JP3229122B2 publication Critical patent/JP3229122B2/en
Anticipated expiration legal-status Critical
Expired - Lifetime legal-status Critical Current

Links

Landscapes

  • Burglar Alarm Systems (AREA)
  • Optical Radar Systems And Details Thereof (AREA)

Abstract

PURPOSE:To eliminate a disturbance factor and improve the detection precision by photodetecting reflected light from plural areas and outputting a detection signal when the arithmetic value based upon the quantity of reflected light and the reference quantity of reflected light is larger than a specific value in any one area. CONSTITUTION:This device is equipped with a light projecting means 1 which projects light on plural areas and a photodetecting means 2 which photodetects the reflected light from the respective areas. Then an arithmetic means 3 calculates the differences between the quantities of reflected light in the respective areas at a specific time and the reference quantities of reflected light determined by the areas from the output results of the quantities of reflected light of the photodetecting means 2, finds the mean value of the differences, and calculates the sums of the mean value and the reference quantities of reflected light of the respective areas and the differences between or the ratios of the mean value and the quantities of reflected light of the areas at specific intervals of time. When the difference or ratio exceeds the specific value in any one area, a decision means 4 outputs a detection signal. Consequently, even if the quantity of reflected light varies, the entry of a human body, etc., can surely be detected.

Description

【発明の詳細な説明】Detailed Description of the Invention

【0001】[0001]

【産業上の利用分野】本発明は、例えば、自動ドアの開
閉を行うために、検知エリア内の移動物体(人など)を
検知する光線式物体検知装置に関する。
BACKGROUND OF THE INVENTION 1. Field of the Invention The present invention relates to a light beam type object detecting device for detecting a moving object (such as a person) in a detection area in order to open and close an automatic door.

【0002】[0002]

【従来の技術】光線式物体検知装置においては、一般に
複数のエリアに向けて光線を投射し、その各エリアごと
に、その反射光を受光し、その受光量が基準光量との変
動量が所定のスレッショルドレベルを超えたときに、検
知エリア内への人体等の進入を検知するように構成され
ていた。この構成では、図3に示す人体の移動の場合
も、図4に示す吹雪などの場合も区別なく出力され、結
果として誤動作が多かった。
2. Description of the Related Art Generally, in a light ray type object detecting device, a light ray is projected toward a plurality of areas, the reflected light is received for each area, and the amount of received light varies with a reference amount of light. It is configured to detect the entry of a human body or the like into the detection area when the threshold level is exceeded. With this configuration, the human body shown in FIG. 3 and the snowstorm shown in FIG. 4 are output without distinction, resulting in many malfunctions.

【0003】そこで、例えばPIRのように、一対のエ
リアの出力の差を見て外乱要因をキャンセルする方式も
用いられている。この方式を採用した場合、例えば図4
に示すピークレベルa1,a2に大きな差が生じた場合
には、スレッショルドレベルを超えて出力してしまう。
Therefore, for example, as in the case of PIR, a method of canceling a disturbance factor by looking at the difference between the outputs of a pair of areas is also used. When this method is adopted, for example, as shown in FIG.
When there is a large difference between the peak levels a1 and a2 shown in (1), the output exceeds the threshold level.

【0004】[0004]

【発明が解決しようとする課題】ところで、上述した従
来の技術では、いずれも人体等の進入と外乱の場合の反
射光量の波形の違いを検知できず、検知の精度は不安定
である問題があった。
However, in any of the above-mentioned conventional techniques, there is a problem that the difference in the waveform of the reflected light amount when the human body or the like enters and the disturbance cannot be detected, and the detection accuracy is unstable. there were.

【0005】本発明はこれらの問題点を解決するために
なされたもので、反射光量の変動について、外乱による
ものをキャンセルし、人体の移動によるものについての
み検知することができる光線式物体検知装置を提供する
ことを目的とする。
The present invention has been made in order to solve these problems, and it is possible to cancel the fluctuation of the reflected light quantity due to the disturbance and detect only the fluctuation due to the movement of the human body. The purpose is to provide.

【0006】[0006]

【課題を解決するための手段】本発明の目的を達成する
ために、本発明の光線式移動物体検知装置は、図1に示
す本発明の基本概念図に示すように、複数のエリアに向
けて光を投光する投光手段1と、そのそれぞれのエリア
からの反射光を受光する受光手段2を備え、その受光手
段2による反射光量の出力結果に基づいて、所定時間に
おける上記各エリアの上記反射光量およびその各エリア
毎に定まる基準反射量との差をそれぞれ算出し、これら
の差の平均値を求めるとともに、上記所定時間毎に、そ
の平均値と各エリアの上記基準反射量とのそれぞれの和
と、そのエリアの上記反射光量との差または比をそれぞ
れ算出する演算手段3と、その差または比が上記いずれ
かのエリアにおいて所定値以上となったときに、検知信
号を出力する判別手段4を備えてなることによって特徴
付けられている。
In order to achieve the object of the present invention, the light beam type moving object detecting device of the present invention is directed to a plurality of areas as shown in the basic conceptual diagram of the present invention shown in FIG. A light projecting means 1 for projecting light and a light receiving means 2 for receiving the reflected light from each of the areas are provided. The difference between the amount of reflected light and the reference reflection amount determined for each area is calculated, and the average value of these differences is determined, and at each of the predetermined times, the average value and the reference reflection amount of each area. Calculation means 3 for calculating the difference or ratio between the respective sums and the amount of reflected light in the area, and a detection signal is output when the difference or ratio exceeds a predetermined value in any of the areas. Discrimination It is characterized by comprising comprises a stage 4.

【0007】[0007]

【作用】複数のエリアに対して、同時間における各エリ
アの反射光量とその各エリアのそれぞれの基準反射量と
の差の平均値を求められ、その差の平均値と各エリアの
基準反射量とのそれぞれの和と、そのエリアの反射光量
との差または比が、いずれかのエリアで所定値以上とな
った場合にのみ、検知信号が出力される。
[Function] For a plurality of areas, the average value of the difference between the reflected light amount of each area and the reference reflection amount of each area at the same time is obtained, and the average value of the difference and the reference reflection amount of each area The detection signal is output only when the difference or ratio between the respective sums of the above and the amount of reflected light in that area is equal to or larger than a predetermined value in any of the areas.

【0008】ここで、人がドアに向かって進んだとき、
反射光量の経時的変化を示す波形は、図3に示すよう
に、各エリア毎に異なった波形で、かつ、ピークが時系
列的なずれをもって現れる。これに対し、吹雪等の外乱
要因によって生ずる波形は、図4に示すように、ほぼ同
一形状の波形がほぼ同時に現れる。
[0008] Here, when a person advances toward the door,
As shown in FIG. 3, the waveform showing the change over time of the reflected light amount is different for each area, and the peaks appear with a time-series deviation. On the other hand, as shown in FIG. 4, the waveforms generated by disturbance factors such as snowstorms appear to have substantially the same shape at substantially the same time.

【0009】したがって、外乱要因によって生ずる波形
においては、各エリアの上記した差の平均値と各エリア
の基準反射量との和と、各エリアの反射光量との差はほ
とんどないのに対し、人が移動する場合には、大きな差
が生じるため、外乱によるものとの判別が可能となっ
て、人の移動を確実に検知できる。
Therefore, in the waveform generated by the disturbance factor, there is almost no difference between the sum of the average value of the above-mentioned differences in each area and the reference reflection amount in each area and the reflected light amount in each area. When the object moves, a large difference occurs, so that it is possible to determine that the object is caused by a disturbance, and the movement of the person can be reliably detected.

【0010】[0010]

【実施例】図2は本発明実施例が設置された状態の図を
示す。本発明実施例の光線式移動物体検知装置21は、
ドア22の上方に設けられ、この装置21には、投光器
(図示せず)および受光器(図示せず)が設けられてい
る。この投光器は、ドア22の前後に並んだ検知エリア
に対応した発光素子を備え、また、受光器は、同様に検
知エリアに対応した受光素子を備えている。この受光素
子により反射光が受光され、その反射光量について、以
下に説明する演算および検知を判別するための処理部が
備えられている。この処理部は、装置のハード構成とし
ては、マイコン等が対応する。
FIG. 2 is a diagram showing a state in which an embodiment of the present invention is installed. The light beam type moving object detection device 21 of the embodiment of the present invention is
It is provided above the door 22, and the device 21 is provided with a light projector (not shown) and a light receiver (not shown). The projector includes light emitting elements corresponding to the detection areas arranged in front of and behind the door 22, and the light receiver also includes light receiving elements corresponding to the detection areas. Reflected light is received by the light receiving element, and a processing unit for determining calculation and detection described below for the amount of reflected light is provided. The processing unit corresponds to a microcomputer or the like as the hardware configuration of the device.

【0011】以下にこの処理部の構成について説明す
る。まず、人体が移動してきた場合について、図5およ
び図6を参照しながら、説明する。
The configuration of this processing unit will be described below. First, a case where a human body moves will be described with reference to FIGS. 5 and 6.

【0012】各検知エリアの感度をほぼ同じとする。検
知エリアC,B,Aの反射光量の経時的な変化をそれぞ
れ図5(a),(b),(c)に示す。そこで、所定の
時間t1 におけるの反射光量の基準反射量からの変化量
を求め、その平均値を求める。なお、ここで各エリアに
おける変化量を算出する場合に、各エリアの基準反射量
を用いるのは、エリアを見る角度が各エリア毎に異なる
ことによる。
The sensitivities of the respective detection areas are substantially the same. FIGS. 5A, 5B, and 5C show changes with time of the reflected light amounts of the detection areas C, B, and A, respectively. Therefore, the change amount of the reflected light amount from the reference reflection amount at the predetermined time t 1 is obtained, and the average value thereof is obtained. In addition, when calculating the variation | change_quantity in each area here, the reason that the reference reflection amount of each area is used is because the angle which sees an area differs for every area.

【0013】図に示すように、検知エリアC,B,Aの
時間t1 における反射光量およびスレッショルドレベル
はそれぞれ(a1,s1),(a2,s2),(a3,
s3)である。これらから、各エリアの変化量の平均値
を式(1)によって求めた結果を図5(d)に示す。
As shown in the figure, the reflected light amount and the threshold level at the time t 1 of the detection areas C, B, A are (a1, s1), (a2, s2), (a3, respectively).
s3). From these, the result of obtaining the average value of the change amount of each area by the equation (1) is shown in FIG.

【0014】[0014]

【数1】 [Equation 1]

【0015】次に、このように求めた平均値をそれぞれ
各エリアの基準反射量に加算すると、図6に示すよう
に、破線で示す形状となる。そして、この破線で示す値
と、各エリアにおいて対応する反射光量との差(d c
b , a )を算出する。なお、この場合、差に限るこ
となく、比を求めてもよい。
Next, the average values thus obtained are respectively
When added to the reference reflection amount of each area, as shown in FIG.
In addition, the shape is indicated by a broken line. And the value shown by this dashed line
And the amount of reflected light corresponding to each area (d c
db,da) Is calculated. In this case, the difference is limited to
Alternatively, the ratio may be calculated.

【0016】この差あるいは比の値を求めた結果、検知
エリアC,B,Aのいずれかのエリアでこの差が大きく
なるか、もしくはこの比の値が所定の値を超えた場合
に、人体検出の信号を出力し、そうでない場合は、外乱
によるものとして人体検出の信号は出力しない。本実施
例の場合、差(dc ,db , a )はいずれのエリアに
おいても、大きいと判断され、人体検出の信号が出力さ
れる。
As a result of obtaining the value of this difference or ratio, when this difference becomes large in any one of the detection areas C, B, A, or the value of this ratio exceeds a predetermined value, the human body The detection signal is output, and if not, the human body detection signal is not output because of disturbance. In the case of this embodiment, the difference (d c , d b, d a ) is judged to be large in any area, and the human body detection signal is output.

【0017】次に、吹雪等の外乱が要因となって反射光
量がスレッショルドレベルに対し変化を示す場合につい
て、図7および図8を参照しながら、説明する。検知エ
リアC,B,Aの反射光量の経時的な変化をそれぞれ図
7(a),(b),(c)に示す。
Next, a case where the amount of reflected light changes with respect to the threshold level due to a disturbance such as snowstorm will be described with reference to FIGS. 7 and 8. 7A, 7B, and 7C show changes with time of the reflected light amounts of the detection areas C, B, and A, respectively.

【0018】上記と同様の演算により、所定の時間t1
におけるの反射光量の基準反射量からの変化量を求め、
その平均値を求める。図に示すように、検知エリアC,
B,Aの時間t1 における反射光量およびスレッショル
ドレベルはそれぞれ(a1,s1),(a2,s2),
(a3,s3)である。これらから、各エリアの変化量
の平均値を式(1)によって求めた結果を図7(d)に
示す。
By a calculation similar to the above, a predetermined time t 1
Find the amount of change in the amount of reflected light from the reference amount of reflection at
Calculate the average value. As shown in the figure, the detection area C,
The amounts of reflected light and threshold levels of B and A at time t 1 are (a1, s1), (a2, s2),
(A3, s3). From these, the result of obtaining the average value of the amount of change in each area by equation (1) is shown in FIG.

【0019】さらに、このように求めた平均値をそれぞ
れ各エリアの基準反射量に加算すると、図8に示すよう
に、破線で示す形状となる。そして、この破線で示す値
と、各エリアにおいて対応する反射光量との差を算出す
る。なお、この場合、差に限ることなく、比を求めても
よい。
Further, when the average value thus obtained is added to the reference reflection amount of each area, the shape shown by the broken line is obtained as shown in FIG. Then, the difference between the value indicated by the broken line and the corresponding reflected light amount in each area is calculated. In this case, the ratio may be calculated without being limited to the difference.

【0020】これらの図からも明らかなように、外乱が
要因となって反射光量が基準反射量を超えた場合、この
経時的反射光量の変化を示す波形はほぼ同じ形状をな
し、各エリアの反射光量と、その変化量の平均値と基準
反射量との和とは、その差はほとんどない。したがっ
て、検知信号は出力されない。
As is clear from these figures, when the amount of reflected light exceeds the reference amount of reflection due to disturbance, the waveform showing the change in the amount of reflected light over time has substantially the same shape, and There is almost no difference between the amount of reflected light and the sum of the average value of the amounts of change and the reference amount of reflection. Therefore, the detection signal is not output.

【0021】以上説明したように、本発明実施例では、
所定の時間(t1)を選択し、その一瞬について演算お
よび判別を行ったが、一定時間の各信号をメモリに記憶
させ、そのデータにより波形をサンプリングし、人体の
通過を判別する方法として、例えば、0.5秒間などの
一定時間を設定し、その時間内においてスレッショルド
レベルを超えた時間が8割を超えた場合には、人体の通
過と判断するといった構成としてもよい。この場合はさ
らに一層誤動作が低減される。
As described above, in the embodiment of the present invention,
A predetermined time (t1) was selected, and calculation and determination were performed for that moment. However, as a method of storing each signal for a certain time in a memory, sampling a waveform with the data, and determining passage of a human body, for example, , 0.5 seconds or the like, and if the time exceeding the threshold level exceeds 80% within that time, it may be determined that the human body has passed. In this case, malfunction is further reduced.

【0022】[0022]

【発明の効果】以上説明したように、本発明の光線式物
体検知装置によれば、複数のエリアに向けて光を投光す
る投光手段と、そのそれぞれのエリアからの反射光を受
光する受光手段を備え、所定時間における各エリアの反
射光量およびその各エリア毎の基準反射量との差をそれ
ぞれ算出してこれらの差の平均値を求めるとともに、所
定時間毎に、その平均値と各エリアの基準反射量とのそ
れぞれの和と、そのエリアの反射光量との差または比を
それぞれ算出する演算手段と、その差または比がいずれ
かのエリアにおいて所定値以上となったときに、検知信
号を出力する判別手段を備えた構成としたので、反射光
量の変動があっても、外乱を要因とする場合を排除で
き、人体等の進入を確実に検知することができ、検知の
精度を向上することができる。
As described above, according to the light ray type object detection apparatus of the present invention, the light projecting means for projecting light toward a plurality of areas and the light reflected from each area are received. A light receiving unit is provided, and the difference between the reflected light amount of each area and the reference reflection amount of each area at a predetermined time is calculated to obtain an average value of these differences, and the average value and each Calculation means for calculating the difference or ratio between the sum of the reference reflection amount of each area and the reflected light amount of the area, and detection when the difference or ratio exceeds a predetermined value in any area Since the configuration is provided with a determination unit that outputs a signal, even if there is a change in the amount of reflected light, it is possible to eliminate the case where the disturbance is the cause, and it is possible to reliably detect the entry of the human body, etc. To improve It can be.

【図面の簡単な説明】[Brief description of drawings]

【図1】本発明の構成を示す基本概念図FIG. 1 is a basic conceptual diagram showing the configuration of the present invention.

【図2】本発明実施例の設置状況を説明する図FIG. 2 is a diagram for explaining the installation situation of the embodiment of the present invention.

【図3】本発明実施例における検知エリア内を人が移動
した場合の作用説明図
FIG. 3 is an operation explanatory diagram when a person moves in a detection area according to the embodiment of the present invention.

【図4】本発明実施例における検知エリア内に外乱が生
じた場合の作用説明図
FIG. 4 is an operation explanatory diagram when a disturbance occurs in the detection area according to the embodiment of the present invention.

【図5】本発明実施例における検知エリア内を人が移動
した場合の動作を説明するための図
FIG. 5 is a diagram for explaining the operation when a person moves within the detection area according to the embodiment of the present invention.

【図6】同じく本発明実施例における検知エリア内を人
が移動した場合の動作を説明するための図
FIG. 6 is a diagram for explaining an operation when a person moves in the detection area according to the embodiment of the present invention.

【図7】同じく本発明実施例における検知エリア内に外
乱が生じた場合の動作を説明するための図
FIG. 7 is a diagram for explaining the operation when a disturbance occurs in the detection area in the embodiment of the present invention.

【図8】同じく本発明実施例における検知エリア内に外
乱が生じた場合の動作を説明するための図
FIG. 8 is a diagram for explaining the operation when a disturbance occurs in the detection area in the embodiment of the present invention.

【符号の説明】[Explanation of symbols]

1・・・・投光手段 2・・・・受光手段 3・・・・演算手段 4・・・・判別手段 21・・・・光線式移動物体検知装置 1 ... ・ Light emitting means 2 ... Light receiving means 3 ... Calculation means 4 ... Discrimination means 21 ... Light beam type moving object detection device

Claims (1)

【特許請求の範囲】[Claims] 【請求項1】 複数のエリアに向けて光を投光する投光
手段と、そのそれぞれのエリアからの反射光を受光する
受光手段を備え、その受光手段による反射光量の出力結
果に基づいて、所定時間における上記各エリアの上記反
射光量およびその各エリア毎に定まる基準反射量との差
をそれぞれ算出し、これらの差の平均値を求めるととも
に、上記所定時間毎に、その平均値と各エリアの上記基
準反射量とのそれぞれの和と、そのエリアの上記反射光
量との差または比をそれぞれ算出する演算手段と、その
差または比が上記いずれかのエリアにおいて所定値以上
となったときに、検知信号を出力する判別手段を備えて
なる光線式物体検知装置。
1. A light projecting means for projecting light toward a plurality of areas and a light receiving means for receiving reflected light from each of the areas, and based on an output result of the reflected light amount by the light receiving means, The difference between the reflected light amount of each area in a predetermined time and the reference reflection amount determined for each area is calculated respectively, and the average value of these differences is obtained, and at each predetermined time, the average value and each area are calculated. And a calculation means for calculating a difference or a ratio between each of the reference reflection amount and the reflected light amount of the area, and when the difference or the ratio becomes a predetermined value or more in any of the areas. A light beam type object detection device comprising a determination means for outputting a detection signal.
JP12624594A 1994-06-08 1994-06-08 Light beam type object detector Expired - Lifetime JP3229122B2 (en)

Priority Applications (1)

Application Number Priority Date Filing Date Title
JP12624594A JP3229122B2 (en) 1994-06-08 1994-06-08 Light beam type object detector

Applications Claiming Priority (1)

Application Number Priority Date Filing Date Title
JP12624594A JP3229122B2 (en) 1994-06-08 1994-06-08 Light beam type object detector

Publications (2)

Publication Number Publication Date
JPH07334765A true JPH07334765A (en) 1995-12-22
JP3229122B2 JP3229122B2 (en) 2001-11-12

Family

ID=14930397

Family Applications (1)

Application Number Title Priority Date Filing Date
JP12624594A Expired - Lifetime JP3229122B2 (en) 1994-06-08 1994-06-08 Light beam type object detector

Country Status (1)

Country Link
JP (1) JP3229122B2 (en)

Cited By (1)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
JP2009031296A (en) * 2008-08-11 2009-02-12 Omron Corp Detection device and lock-controlling device

Cited By (1)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
JP2009031296A (en) * 2008-08-11 2009-02-12 Omron Corp Detection device and lock-controlling device

Also Published As

Publication number Publication date
JP3229122B2 (en) 2001-11-12

Similar Documents

Publication Publication Date Title
US7569843B2 (en) Method for processing receiver signal and optical sensor
US4656462A (en) Object detecting apparatus including photosensors for restricted detection area
US6167991B1 (en) Method and apparatus for detecting position of an elevator door
US4648718A (en) Optical measuring system
JP3452794B2 (en) Visibility measurement device
US7791714B2 (en) Device and method for recording distance-measuring images
JPH07334765A (en) Light beam type body detecting device
US20230213630A1 (en) Method and device for identifying contamination on a protective screen of a lidar sensor
CN1038622C (en) Fire-alarm system for the early detection of fires
US5781282A (en) Distance measurement device
US6018159A (en) Differential clear container sensor with improved noise immunity
GB2303712A (en) Apparatus for and a method of detecting a cyclic variation of a signal
JP3564591B2 (en) Dust detection device and dust detection method
US20050001149A1 (en) Stray light correction method for an optical sensor array
JP3137559B2 (en) Distance measuring device
JPH08340242A (en) Detector switch
KR100250886B1 (en) Method and apparatus of forwardness / backwardness detecting and counting for moving object
JP7454751B2 (en) How to determine changes in lidar sensor ranging range
JP3477877B2 (en) Woven cloth inspection equipment
JP3382015B2 (en) Photoelectric sensor
JPH074622Y2 (en) Object passage detector
JPH10269389A (en) Method for detecting passage of plural persons in gate device
JP2938662B2 (en) Loom weft detection device
JPH07306963A (en) Method and device for discriminating normal/defective condition of paper
JP3409108B2 (en) Full color photoelectric sensor

Legal Events

Date Code Title Description
R250 Receipt of annual fees

Free format text: JAPANESE INTERMEDIATE CODE: R250

FPAY Renewal fee payment (event date is renewal date of database)

Free format text: PAYMENT UNTIL: 20070907

Year of fee payment: 6

FPAY Renewal fee payment (event date is renewal date of database)

Free format text: PAYMENT UNTIL: 20080907

Year of fee payment: 7

FPAY Renewal fee payment (event date is renewal date of database)

Free format text: PAYMENT UNTIL: 20080907

Year of fee payment: 7

FPAY Renewal fee payment (event date is renewal date of database)

Free format text: PAYMENT UNTIL: 20090907

Year of fee payment: 8

FPAY Renewal fee payment (event date is renewal date of database)

Free format text: PAYMENT UNTIL: 20100907

Year of fee payment: 9

FPAY Renewal fee payment (event date is renewal date of database)

Free format text: PAYMENT UNTIL: 20100907

Year of fee payment: 9

FPAY Renewal fee payment (event date is renewal date of database)

Free format text: PAYMENT UNTIL: 20110907

Year of fee payment: 10

FPAY Renewal fee payment (event date is renewal date of database)

Free format text: PAYMENT UNTIL: 20140907

Year of fee payment: 13

EXPY Cancellation because of completion of term