JPH1155652A - Sensor interlocking still image recording device - Google Patents

Sensor interlocking still image recording device

Info

Publication number
JPH1155652A
JPH1155652A JP9206131A JP20613197A JPH1155652A JP H1155652 A JPH1155652 A JP H1155652A JP 9206131 A JP9206131 A JP 9206131A JP 20613197 A JP20613197 A JP 20613197A JP H1155652 A JPH1155652 A JP H1155652A
Authority
JP
Japan
Prior art keywords
index
signal
area
still image
detection
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Granted
Application number
JP9206131A
Other languages
Japanese (ja)
Other versions
JP3811722B2 (en
Inventor
Takuji Andou
倬二 安藤
Kozo Hirai
晃造 平位
Tadashi Sugimoto
匡史 杉本
Yasuhiko Matsumoto
康彦 松本
Hiroshi Makino
弘 牧野
Takahiro Ohashi
孝浩 大橋
Akihiko Hayashi
明彦 林
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
Opt KK
Original Assignee
Opt KK
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Opt KK filed Critical Opt KK
Priority to JP20613197A priority Critical patent/JP3811722B2/en
Publication of JPH1155652A publication Critical patent/JPH1155652A/en
Application granted granted Critical
Publication of JP3811722B2 publication Critical patent/JP3811722B2/en
Anticipated expiration legal-status Critical
Expired - Fee Related legal-status Critical Current

Links

Abstract

PROBLEM TO BE SOLVED: To easily retrieve a desired image in a short time by picking up a still image in a photographic area to record the image signal when a human body is detected, outputting a command signal when the human body is detected in an index area that is set in a part of a detection area and adding an index signal to an image signal with the signal. SOLUTION: A 1st PIR sensor 2a sends a detection signal (a)to a control circuit 5 while a person A crosses in front of a sensor part 1 in the direction of an arrow G and is within a 1st detection area 4a and a 2nd PIR sensor 2b sends a detection signal (b) to the circuit 5 while he is inside a 2nd detection area 4b. A photographic command circuit 6 records a still image signal d which is inputted from a digital camera 7 in a card type memory 10 once in several seconds while the signals (a) and (b) are inputted. An index adding means 12 sends an index signal (f) that is necessary for retrieval to a still image recording circuit 9 while the person A is in an area 4c for index because the signals (a) and (b) are simultaneously inputted to the circuit 5.

Description

【発明の詳細な説明】DETAILED DESCRIPTION OF THE INVENTION

【0001】[0001]

【発明の属する技術分野】本発明は、所定の場所を通過
する人物をセンサで検出して静止画像で記録する、セン
サ連動静止画記録装置に関する。
BACKGROUND OF THE INVENTION 1. Field of the Invention The present invention relates to a sensor-linked still image recording apparatus for detecting a person passing a predetermined place with a sensor and recording the still image as a still image.

【0002】[0002]

【従来の技術】従来のこの種の記録装置には、受動型赤
外線センサ(以下、「PIRセンサ」という)で所定の
場所を通過する人物を検出して、ビデオカメラで動画と
して記録するとともに、センサの検知信号に基づいて、
記録する画像の部分に索引信号を記録しておき、後で録
画したテープを再生するとき、前記索引信号で頭出しす
るように構成しているものがある。
2. Description of the Related Art In a conventional recording apparatus of this type, a passive infrared sensor (hereinafter, referred to as a "PIR sensor") detects a person passing a predetermined place and records the moving image with a video camera. Based on the detection signal of the sensor,
There is a configuration in which an index signal is recorded in a portion of an image to be recorded, and when the recorded tape is played back later, the cue is performed by the index signal.

【0003】[0003]

【発明が解決しようとする課題】しかしながら、従来の
記録装置では、再生するときビデオテープを1撮影単位
ごとに早送りして見なければならないため、所望の画像
を捜し出すのに長い時間を要していた。この問題を解決
するために、センサの検知信号によってカメラで静止画
を1枚だけ記録するシステムもあるが、静止画が横顔で
あったり、写りが悪かったりして、人物の特定が困難に
なる場合がある。
However, in a conventional recording apparatus, a long time is required to search for a desired image because a video tape must be fast-forwarded for each photographing unit to be viewed during reproduction. Was. In order to solve this problem, there is a system in which only one still image is recorded by a camera based on a detection signal of a sensor. However, it is difficult to identify a person because the still image has a profile or poor image. There are cases.

【0004】本発明は、上記のような問題点の解消を目
的としてなされたもので、複数の静止画を記録したとき
でも、短時間で所望の画像を容易に検索できるセンサ連
動静止画記録装置を得ることを目的としている。
SUMMARY OF THE INVENTION The present invention has been made to solve the above problems, and has a sensor-linked still image recording apparatus capable of easily retrieving a desired image in a short time even when a plurality of still images are recorded. The purpose is to get.

【0005】[0005]

【課題を解決するための手段】本発明に係るセンサ連動
静止画記録装置は、それぞれの検知エリア内の人体を検
知する複数のセンサと、前記センサが人体を検知したと
き検知エリアを含む撮像エリアの静止画を撮像する撮像
手段と、この撮像手段からの画像信号を記録する画像記
録手段と、前記複数のセンサの検知エリアの一部に設定
した索引用エリアに存在する人体を検知して指令信号を
出力する索引指令回路と、前記指令信号に基づいて、前
記索引用エリア内の人体を撮像した画像信号に索引信号
を付加する索引付加手段とを備えたものである。
A sensor-linked still image recording apparatus according to the present invention comprises a plurality of sensors for detecting a human body in each detection area, and an imaging area including the detection area when the sensor detects a human body. Imaging means for capturing a still image of the subject, image recording means for recording an image signal from the imaging means, and a command for detecting and instructing a human body present in an index area set in a part of the detection area of the plurality of sensors. An index command circuit for outputting a signal; and index adding means for adding an index signal to an image signal obtained by imaging a human body in the index area based on the command signal.

【0006】本発明によれば、索引用エリア内にいる人
物の静止画像に索引信号が付加して記録される。したが
って、検知エリア内の人物を撮影した複数の静止画像が
存在する場合でも、索引用エリアの静止画像を容易に検
索できる。索引用エリアとして、カメラの撮像エリアの
中央に位置するエリア、または人物がカメラの方向に向
き易いエリアなど、適切なエリアを選んでおくことによ
り、人物の写りを良くすることができる。
According to the present invention, an index signal is added to a still image of a person in the index area and recorded. Therefore, even when there are a plurality of still images of a person in the detection area, the still images in the index area can be easily searched. By selecting an appropriate area such as an area located in the center of the imaging area of the camera or an area where a person easily faces the camera as the index area, the image of the person can be improved.

【0007】前記索引用エリアとして、前記複数のセン
サの一つの検知エリアを設定することができる。
[0007] One detection area of the plurality of sensors can be set as the index area.

【0008】また、前記センサを一対として、両センサ
の検知エリアの重なった部分を前記索引用エリアとして
設定することができる。
[0008] Further, a pair of the sensors can be set, and an overlapping portion of the detection areas of the two sensors can be set as the index area.

【0009】[0009]

【発明の実施の形態】以下、本発明の実施形態を図面に
基づいて説明する。図1は、本発明の一実施形態を示す
概略平面図である。図において、センサ部1は、第1,
第2のPIRセンサ2a,2bと、各PIRセンサ2
a,2bの検知エリアを定める光学系である第1,第2
のフレネルレンズ3a,3bとを有し、この光学系によ
り、第1のPIRセンサ2aに第1の検知エリア4a
が、第2のPIRセンサ2bに第2の検知エリア4bが
それぞれ設定され、さらに、両検知エリア4a,4bの
一部の重なる部分が索引用エリア4cとして設定されて
いる。このセンサ部1の前を人物Aが矢印G方向に横切
るように移動すると、人物Aが第1の検知エリア4a内
に居る間は第1のPIRセンサ2aが検知信号aを制御
回路5に送出し、ついで第2の検知エリア4b内に居る
間は第2のPIRセンサ2bが検知信号bを制御回路5
に送出する。
Embodiments of the present invention will be described below with reference to the drawings. FIG. 1 is a schematic plan view showing one embodiment of the present invention. In the figure, a sensor unit 1 includes
The second PIR sensors 2a and 2b and each PIR sensor 2
The first and second optical systems that define the detection areas a and 2b
Fresnel lenses 3a and 3b, and the first PIR sensor 2a has a first detection area 4a
However, a second detection area 4b is set in the second PIR sensor 2b, and a part of the two detection areas 4a and 4b that overlaps is set as an index area 4c. When the person A moves in front of the sensor unit 1 so as to cross in the direction of the arrow G, the first PIR sensor 2a sends the detection signal a to the control circuit 5 while the person A is in the first detection area 4a. Then, while in the second detection area 4b, the second PIR sensor 2b sends the detection signal b to the control circuit 5
To send to.

【0010】制御回路5を構成している撮影指令回路6
は、検知信号aおよびbが入力されている間、撮影指令
信号cを、撮像手段を構成しているデジタルカメラ7お
よび画像記録手段8に送出し、静止画像記録回路9は、
人物Aが検知エリア4a,4bから出るまでの間、つま
り、検知信号aまたはbが出力されている間、デジタル
カメラ7から入力される静止画像信号dをカード型のメ
モリ10に数秒間に1回の割合で静止画像を記録する。
デジタルカメラ7は、検知エリア4a,4bを含む広い
撮像エリア15を有し、索引用エリア4cはデジタルカ
メラ7の撮像エリア15の中央に位置している。
A photographing command circuit 6 constituting the control circuit 5
Sends the photographing command signal c to the digital camera 7 and the image recording means 8 constituting the imaging means while the detection signals a and b are being input, and the still image recording circuit 9
Until the person A exits the detection areas 4a and 4b, that is, while the detection signal a or b is being output, the still image signal d input from the digital camera 7 is stored in the card type memory 10 for several seconds. Record still images at the rate of the number of times.
The digital camera 7 has a wide imaging area 15 including the detection areas 4a and 4b, and the index area 4c is located at the center of the imaging area 15 of the digital camera 7.

【0011】ここで、前記デジタルカメラ7を連写モー
ドにして静止画像信号dを1秒間に数回の割合で記録す
ることも可能であり、その場合、メモリ10をフラッシ
ュメモリとフレームメモリとで構成し、静止画像信号d
を一旦フレームメモリに蓄えたのち、順次フラッシュメ
モリに記録する。
Here, it is possible to record the still image signal d several times per second by setting the digital camera 7 to the continuous shooting mode. In this case, the memory 10 is composed of a flash memory and a frame memory. Composing the still image signal d
Are once stored in the frame memory, and are sequentially recorded in the flash memory.

【0012】このとき、人物Aが索引用エリア4cに居
る間は、検知信号a,bが同時に制御回路5に入力され
るので、この入力を受けて、制御回路5内の索引指令回
路11は、指令信号eを索引付加手段12に送出する。
索引付加手段12は、撮影日時,索引番号,その他検索
に必要なデータをデジタル化した索引信号fを静止画像
記録回路9に送出し、静止画像記録回路9は、その索引
信号fが出力されたタイミング、またはその直後に入力
された静止画像信号dに索引信号fを付加してメモリ1
0に記録する。索引信号fは、例えば静止画像信号dの
頭の部分のアドレス欄に付加される。
At this time, while the person A is in the indexing area 4c, the detection signals a and b are simultaneously input to the control circuit 5, and upon receiving this input, the index command circuit 11 in the control circuit 5 , A command signal e to the index adding means 12.
The index adding unit 12 sends an index signal f obtained by digitizing the photographing date and time, the index number, and other data necessary for the search to the still image recording circuit 9, and the still image recording circuit 9 outputs the index signal f. An index signal f is added to the still image signal d input at or immediately after the timing,
Record at 0. The index signal f is added to, for example, an address column at the beginning of the still image signal d.

【0013】このようにしてメモリ10に記録された静
止画像は、記録順で索引信号を検索すれば、記録順に人
物Aが索引用エリア4cに居るときの静止画像のみを順
次見ることがでる。索引用に撮影した画像が横向きや後
向きであるなど、不明瞭な場合は、その前後の静止画像
を見ればよい。また、撮影日時で検索することにより、
特定の時間帯、または特定の時刻の静止画像をピックア
ップして見ることもできる。したがって、所望の静止画
像を短時間で検索することができる。ここで、デジタル
カメラ7および索引用エリア4cを、例えば部屋の入口
に向けて設定しておくと、入口から入ってくる人物の正
面像を撮像した静止画像に索引信号が付加されることに
なり、有益な静止画像が検索される。
In the still images recorded in the memory 10 as described above, if the index signal is searched in the recording order, only the still images when the person A is in the index area 4c can be sequentially viewed in the recording order. If the image taken for indexing is unclear, such as when the image is facing sideways or backward, it is sufficient to look at the still images before and after that. Also, by searching by shooting date and time,
Still images at a specific time zone or at a specific time can be picked up and viewed. Therefore, a desired still image can be searched in a short time. Here, if the digital camera 7 and the index area 4c are set, for example, toward the entrance of the room, an index signal is added to a still image obtained by capturing a front image of a person entering from the entrance. , Useful still images are searched.

【0014】図2は、本発明の他の実施形態のセンサ部
を示す斜視図である。図2において、センサ部1の第1
のフレネルレンズ3cは、第1のPIRセンサ2mに対
して中央の索引用エリア4cを設定し、第2のフレネル
レンズ3dは、第2のPIRセンサ2nに対して前記索
引用エリア4cの両側に検知エリア4dを設定する。第
1のPIRセンサ2mの検知信号mおよび第2のPIR
センサ2nの検知信号nは、それぞれ制御回路5の撮影
指令回路6および索引指令回路11に入力され、撮影指
令回路6は、検知信号mおよびnが入力されている間、
撮影指令信号cを撮像手段を構成しているデジタルカメ
ラ7および画像記録手段8に送出し、静止画像記録回路
9は、人物Aが検知エリア4b,4aから出るまでの
間、デジタルカメラ7から入力される静止画像信号dを
カード型のメモリ10に数秒間に1回の割合で静止画像
を記録する。
FIG. 2 is a perspective view showing a sensor unit according to another embodiment of the present invention. In FIG. 2, the first
Lens 3c sets a central index area 4c with respect to the first PIR sensor 2m, and the second Fresnel lens 3d has two index areas 4c with respect to the second PIR sensor 2n. The detection area 4d is set. Detection signal m of first PIR sensor 2m and second PIR
The detection signal n of the sensor 2n is inputted to the photographing command circuit 6 and the index command circuit 11 of the control circuit 5, respectively.
The photographing command signal c is sent to the digital camera 7 and the image recording means 8 constituting the image pickup means, and the still image recording circuit 9 receives the input from the digital camera 7 until the person A exits the detection areas 4b and 4a. The still image signal d is recorded in the card type memory 10 at a rate of once every several seconds.

【0015】また、索引指令回路11は、検知信号mが
入力されたとき指令信号eを索引付加手段12に送出す
る。索引付加手段12は、撮影日時,索引番号,その他
検索に必要なデータをデジタル化した索引信号fを静止
画像記録回路9に送出し、静止画像記録回路9は、その
索引信号fをそのとき入力された静止画像信号dに付加
してメモリ10に記録する。
The index command circuit 11 sends a command signal e to the index adding means 12 when the detection signal m is input. The index adding means 12 sends an index signal f obtained by digitizing the photographing date and time, the index number, and other data necessary for the search to the still image recording circuit 9, and the still image recording circuit 9 inputs the index signal f at that time. The still image signal d is recorded in the memory 10 in addition to the still image signal d.

【0016】[0016]

【発明の効果】本発明によれば、記録された静止画像を
索引信号を検索することで、所望の撮影画像を短時間で
検索することができるセンサ連動静止画記録装置が得ら
れる効果がある。
According to the present invention, there is an effect that a sensor-linked still image recording apparatus capable of searching for a desired photographed image in a short time by searching an index signal for a recorded still image. .

【図面の簡単な説明】[Brief description of the drawings]

【図1】本発明の一実施形態に係るセンサ連動静止画記
録装置の概略平面図である。
FIG. 1 is a schematic plan view of a sensor-linked still image recording device according to an embodiment of the present invention.

【図2】本発明の他の実施形態に係るセンサ部の構成を
示す斜視図である。
FIG. 2 is a perspective view illustrating a configuration of a sensor unit according to another embodiment of the present invention.

【符号の説明】[Explanation of symbols]

1…センサ部、2,2a,2b,2m,2n…PIRセ
ンサ、3,3a〜3d…フレネルレンズ、4a,4b,
4d,4p〜4t…検知エリア、4c…索引用エリア、
5…制御回路、6…撮影指令回路、7…デジタルカメラ
(撮像手段)、8…画像記録手段、9…静止画像記録回
路、10…メモリ、11…索引指令回路、12…索引付
加手段、15…撮像エリア、e…指令信号、f…索引信
号。
1 Sensor part, 2, 2a, 2b, 2m, 2n PIR sensor, 3, 3a to 3d Fresnel lens, 4a, 4b,
4d, 4p to 4t: detection area, 4c: index area,
5 control circuit, 6 photographing command circuit, 7 digital camera (imaging means), 8 image recording means, 9 still image recording circuit, 10 memory, 11 index command circuit, 12 index adding means, 15 ... imaging area, e ... command signal, f ... index signal.

───────────────────────────────────────────────────── フロントページの続き (72)発明者 松本 康彦 滋賀県大津市におの浜4丁目7番5号 オ プテックス株式会社内 (72)発明者 牧野 弘 滋賀県大津市におの浜4丁目7番5号 オ プテックス株式会社内 (72)発明者 大橋 孝浩 滋賀県大津市におの浜4丁目7番5号 オ プテックス株式会社内 (72)発明者 林 明彦 滋賀県大津市におの浜4丁目7番5号 オ プテックス株式会社内 ──────────────────────────────────────────────────続 き Continuing on the front page (72) Inventor Yasuhiko Matsumoto 4-7-5 Onohama, Otsu City, Shiga Prefecture Within Optex Corporation (72) Inventor Hiroshi Makino 4-7-5 Onohama, Otsu City, Shiga Prefecture Optex (72) Inventor Takahiro Ohashi 4-7-5 Nonohama, Otsu City, Shiga Prefecture Within Optex Corporation (72) Inventor Akihiko Hayashi 4-7-5, Oninohama, Otsu City, Shiga Prefecture Optex Corporation

Claims (3)

【特許請求の範囲】[Claims] 【請求項1】 それぞれの検知エリア内の人体を検知す
る複数のセンサと、 前記センサが人体を検知したとき検知エリアを含む撮像
エリアの静止画を撮像する撮像手段と、 この撮像手段からの画像信号を記録する画像記録手段
と、 前記複数のセンサの検知エリアの一部に設定した索引用
エリアに存在する人体を検知して指令信号を出力する索
引指令回路と、 前記指令信号に基づいて、前記索引用エリア内の人体を
撮像した画像信号に索引信号を付加する索引付加手段と
を備えたセンサ連動静止画記録装置。
1. A plurality of sensors for detecting a human body in each detection area, an imaging unit for capturing a still image of an imaging area including the detection area when the sensor detects a human body, and an image from the imaging unit An image recording unit that records a signal, an index command circuit that detects a human body present in an index area set in a part of the detection area of the plurality of sensors and outputs a command signal, based on the command signal, A sensor-linked still image recording apparatus comprising: an index adding unit that adds an index signal to an image signal obtained by imaging a human body in the index area.
【請求項2】 請求項1において、前記複数のセンサの
一つは、その検知エリアが前記索引用エリアとして設定
されているセンサ連動静止画記録装置。
2. The apparatus according to claim 1, wherein one of the plurality of sensors has a detection area set as the index area.
【請求項3】 請求項1において、前記センサは一対設
けられており、両センサの検知エリアの重なった部分が
前記索引用エリアとして設定されているセンサ連動静止
画記録装置。
3. The sensor-linked still image recording apparatus according to claim 1, wherein a pair of the sensors is provided, and a portion where detection areas of both sensors overlap is set as the index area.
JP20613197A 1997-07-31 1997-07-31 Sensor-linked still image recording device Expired - Fee Related JP3811722B2 (en)

Priority Applications (1)

Application Number Priority Date Filing Date Title
JP20613197A JP3811722B2 (en) 1997-07-31 1997-07-31 Sensor-linked still image recording device

Applications Claiming Priority (1)

Application Number Priority Date Filing Date Title
JP20613197A JP3811722B2 (en) 1997-07-31 1997-07-31 Sensor-linked still image recording device

Publications (2)

Publication Number Publication Date
JPH1155652A true JPH1155652A (en) 1999-02-26
JP3811722B2 JP3811722B2 (en) 2006-08-23

Family

ID=16518306

Family Applications (1)

Application Number Title Priority Date Filing Date
JP20613197A Expired - Fee Related JP3811722B2 (en) 1997-07-31 1997-07-31 Sensor-linked still image recording device

Country Status (1)

Country Link
JP (1) JP3811722B2 (en)

Cited By (3)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
JP2010226678A (en) * 2009-03-25 2010-10-07 Panasonic Electric Works Co Ltd Video intercom system
CN102208123A (en) * 2010-12-28 2011-10-05 邓韶昌 Invasion alarm system
CN104299346A (en) * 2014-10-31 2015-01-21 王烨辉 Home security method and system

Cited By (3)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
JP2010226678A (en) * 2009-03-25 2010-10-07 Panasonic Electric Works Co Ltd Video intercom system
CN102208123A (en) * 2010-12-28 2011-10-05 邓韶昌 Invasion alarm system
CN104299346A (en) * 2014-10-31 2015-01-21 王烨辉 Home security method and system

Also Published As

Publication number Publication date
JP3811722B2 (en) 2006-08-23

Similar Documents

Publication Publication Date Title
US5694514A (en) System and method for creating personalized image collections from multiple locations by using a communication network
US20020149681A1 (en) Automatic image capture
KR20000048976A (en) Personal video, and system and method of making same
JPH1155652A (en) Sensor interlocking still image recording device
CN106506969B (en) Camera module, the method and electronic equipment that portrait tracking is carried out by it
JP3191460B2 (en) Image reproducing apparatus and method
JP3337030B2 (en) Electronic still imaging device
JPH11234653A (en) Video supervisory system
JP3226646B2 (en) Automatic shooting system
KR100229886B1 (en) Apparatus for reproducing/writing the video of a supervisory camera and method of controlling the same
KR100267731B1 (en) High-speed search possible vcr
JPH11150677A (en) Photographing device and detection system of moving body having photographing device
JPH05183790A (en) Electronic still camera
JP3208804B2 (en) Monitoring video signal recording device
JP2600000B2 (en) Printer
JP3658003B2 (en) Electronic camera
JPH0340677A (en) Still video camera and its reproducing device
JP3305021B2 (en) Target object detection device
JPH06203290A (en) Image type crossing accident recorder
JPS62271581A (en) Television interphone device
JP2002077809A (en) Video recording system
JPS6068785A (en) Electronic camera
JP2002077809A5 (en)
JPS63249587A (en) Golf swing recording apparatus
JPH07111627A (en) Electronic still camera

Legal Events

Date Code Title Description
A621 Written request for application examination

Free format text: JAPANESE INTERMEDIATE CODE: A621

Effective date: 20040615

A977 Report on retrieval

Free format text: JAPANESE INTERMEDIATE CODE: A971007

Effective date: 20060322

TRDD Decision of grant or rejection written
A01 Written decision to grant a patent or to grant a registration (utility model)

Free format text: JAPANESE INTERMEDIATE CODE: A01

Effective date: 20060404

A61 First payment of annual fees (during grant procedure)

Free format text: JAPANESE INTERMEDIATE CODE: A61

Effective date: 20060407

R150 Certificate of patent or registration of utility model

Free format text: JAPANESE INTERMEDIATE CODE: R150

FPAY Renewal fee payment (event date is renewal date of database)

Free format text: PAYMENT UNTIL: 20090609

Year of fee payment: 3

FPAY Renewal fee payment (event date is renewal date of database)

Free format text: PAYMENT UNTIL: 20100609

Year of fee payment: 4

FPAY Renewal fee payment (event date is renewal date of database)

Free format text: PAYMENT UNTIL: 20110609

Year of fee payment: 5

FPAY Renewal fee payment (event date is renewal date of database)

Free format text: PAYMENT UNTIL: 20110609

Year of fee payment: 5

FPAY Renewal fee payment (event date is renewal date of database)

Free format text: PAYMENT UNTIL: 20130609

Year of fee payment: 7

FPAY Renewal fee payment (event date is renewal date of database)

Free format text: PAYMENT UNTIL: 20130609

Year of fee payment: 7

S531 Written request for registration of change of domicile

Free format text: JAPANESE INTERMEDIATE CODE: R313531

R350 Written notification of registration of transfer

Free format text: JAPANESE INTERMEDIATE CODE: R350

R250 Receipt of annual fees

Free format text: JAPANESE INTERMEDIATE CODE: R250

R250 Receipt of annual fees

Free format text: JAPANESE INTERMEDIATE CODE: R250

LAPS Cancellation because of no payment of annual fees