JP3556829B2 - Glasses monitor magnifier - Google Patents

Glasses monitor magnifier Download PDF

Info

Publication number
JP3556829B2
JP3556829B2 JP11774998A JP11774998A JP3556829B2 JP 3556829 B2 JP3556829 B2 JP 3556829B2 JP 11774998 A JP11774998 A JP 11774998A JP 11774998 A JP11774998 A JP 11774998A JP 3556829 B2 JP3556829 B2 JP 3556829B2
Authority
JP
Japan
Prior art keywords
type
monitor
eyeglass
image
type monitor
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Expired - Lifetime
Application number
JP11774998A
Other languages
Japanese (ja)
Other versions
JPH11275422A (en
Inventor
淳 高橋
Original Assignee
淳 高橋
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by 淳 高橋 filed Critical 淳 高橋
Priority to JP11774998A priority Critical patent/JP3556829B2/en
Publication of JPH11275422A publication Critical patent/JPH11275422A/en
Application granted granted Critical
Publication of JP3556829B2 publication Critical patent/JP3556829B2/en
Anticipated expiration legal-status Critical
Expired - Lifetime legal-status Critical Current

Links

Images

Landscapes

  • Eyeglasses (AREA)
  • Lenses (AREA)
  • Closed-Circuit Television Systems (AREA)
  • Studio Devices (AREA)

Description

【0001】
【産業上の利用分野】
この発明は、精密作業時の作業視野拡大明視装置、ワンマンコントロール記録装置、作業者に視覚と音声による指示を与える装置に関わる。
【0002】
【従来の技術】
従来、光学拡大鏡装置は固定焦点であり、固定焦点距離に従って、作業部位と頭部位置の距離を一定に保ち作業することを強いられた。
【0003】
また、高拡大率の光学拡大鏡装置を使用する場合、作業部位拡大像が視野の全体あるいは大部分を占めることになり、歯科口腔領域の様に口唇等により機械器具等や手指を作業部位に直達させることが不可能な場合、障害物を視覚的に確認しながら排除あるいは回避する事が困難であった。
【0004】
作業者が独りで両手を使用する作業中に作業部位を撮影記録するためには、三脚等を利用してカメラを固定するか、あるいは第三者にカメラを保持させる必要があった。
【0005】
さらに、近接した作業部位に対して、作業者視野画と同一の視野画にて撮影記録しようとする場合、作業者頭部などが撮影の妨げとなるか、カメラ本体が作業者の視野の妨げになり、特に歯科口腔領域の様に視野方向が限定される場合、手術、処置等を中断することなく記録を画像撮影することが困難であった。
【0006】
また、指導者が作業者に視覚的に指示を与えようとする場合、作業者の側近で指示棒等を利用して作業対象物を指し示し、口頭で指示をする必要があった。また、遠隔地より作業者が作業野を注視した状態のまま、しかも対象が人間の場合、第三者あるいは患者等に知られることなく、指導者が作業者の視野内に視覚的指示および音声による指示を与えることは不可能であった。
【0007】
【発明が解決しようとする課題】
解決しようとする課題は、拡大率および作業者頭部と作業部位の距離に関係なく自動的に任意の拡大率を確保し、
【0008】
高拡大率で作業を行う場合、視野の中心部のみ高拡大率とし、中心部以外の視野を等倍、あるいは低拡大率にて表示し、
【0009】
両手を使用する作業中に作業者と同一の作業視野画の情報を作業者自身が記録する場合、作業者の両手の自由を確保し、
【0010】
作業者が作業部位を注視した状態で、遠隔地より指導者が作業者に対して第三者に認識されることなく、作業者の視野モニター内に直接的に視覚による指示、および音声による指示を与えることを目的としている。
【0011】
【課題を解決するための手段】
この発明は上記目的を達成するためになされたものであり、第1の発明は、眼鏡型モニターと、前記眼鏡型モニター前面の装着作業者左右瞳孔中央部に相当する位置から、裸眼視野方向に向けて取り付けたズームレンズ搭載自動焦点CCDカメラを取り付けた装置である。
【0012】
前記、眼鏡型モニターに装着されたズームレンズ搭載自動焦点CCDカメラから入力された情報を、画像処理により分画し、拡大部分を中央に、拡大部分以外の視野を等倍あるいは低拡大率で、眼鏡型モニターと遠隔モニターに表示する装置である。
【0013】
の発明は、眼鏡型モニターと同一画面を得るように、有線あるいは無線にて接続された遠隔モニターに、画像処理により書き込み表示をすることにより、前記眼鏡型モニターに視覚的に指示画像を表示するとともに、有線あるいは無線にてイヤホンマイク等により音声で指示を与える装置。
【0014】
の発明は、眼鏡型モニター部搭載CCDカメラに接続されたワンマンコントロール記録装置である。
【0015】
【発明実施の形態】
上記第1の発明のように構成された、眼鏡型モニターと、前記眼鏡型モニター前面の装着作業者左右瞳孔中央部に相当する位置から、裸眼視野方向に向けて取り付けたズームレンズ搭載自動焦点CCDカメラは、任意の設定拡大率に対して、作業者頭部と作業部位の距離に関係なく自動的に適正焦点を得るように自動調節する。
【0016】
前記、眼鏡型モニターに装着されたズームレンズ搭載自動焦点CCDカメラから入力された情報は、画像処理装置により分画され、拡大部分を中央に、拡大部分以外の視野は等倍あるいは低拡大率で、眼鏡型モニターと遠隔モニターに表示する。
【0017】
の発明のように、頭部に搭載された眼鏡型モニターと同一画面を得るように、有線あるいは無線にて接続された遠隔モニターは、ペンタブレット入力または液晶ペンタブレット入力等によって、任意の指示図形及び文字を頭部に搭載された小型モニターと遠隔モニターに書き込み、視覚的に指示を与えると共に、有線あるいは無線にてイヤホンマイク等により音声で指示を与える。
【0018】
の発明のように、眼鏡型モニターから視野方向に向け搭載されたCCDカメラに接続した動画および静止画記録装置は、作業者の両手の自由を奪うことなく頭部に装着した眼鏡型モニター画面で確認される作業実体を記録できる。
【実施例】
実施例について図面を参照して説明すると、作業者は、眼鏡型モニター2と、前記眼鏡型モニター前面の装着作業者左右瞳孔中央部に相当する位置から、裸眼視野方向に向けて取り付けたズームレンズ搭載自動焦点CCDカメラ1を頭部に装着して、細密作業の際に作業部位を拡大明視する。
【0019】
この、眼鏡型モニター2に装着したズームレンズ搭載自動焦点CCDカメラ1から入力された情報は、画像処理装置6により分画され、拡大部分は中央に、拡大部分以外の視野は等倍あるいは低拡大率で、眼鏡型モニター2と遠隔モニター5に表示される。
【0020】
の発明のように、頭部に搭載された眼鏡型モニターと同一画面を得るように、有線あるいは無線にて接続された遠隔モニター上に、ペンタブレット入力または液晶ペンタブレット入力等の指示画像入力装置8によって、任意の指示図形及び文字を入力することによって、頭部に搭載された眼鏡型モニター9に書き込み指示を視覚的に与えるとともに、有線あるいは無線にてイヤホンマイク3等により音声で指示を与える。
【0021】
の発明のように、眼鏡部搭載CCDカメラ1に動画および静止画記録装置7を接続し、頭部に搭載された眼鏡型モニター画面9と遠隔モニター5で確認される作業実体を記録する。
【発明の効果】
本発明は、以上に説明したように構成されているので、以下に記載されるような効果を奏する。上記第1の発明のように構成された眼鏡型モニターと、前記眼鏡型モニター前面の装着作業者左右瞳孔中央部に相当する位置から、裸眼視野方向に向けて取り付けたズームレンズ搭載自動焦点CCDカメラは、任意の設定拡大率に対して、作業者頭部と作業部位の距離に関係なく適正焦点を得るように自動調節するので、作業者は頭部の位置に制約を受けることなく作業部位を拡大明視することが可能となる。
【0022】
さらに、眼鏡型モニターに装着したズームレンズ搭載自動焦点CCDカメラから入力された画像情報は、コンピューター画像処理により分画し、拡大部分は中央に、拡大部分以外の視野は等倍あるいは低拡大率で、眼鏡型モニターと外部モニターに表示するので高拡大率で装置を使用する場合、視野作業部位の拡大像が視野の全体あるいは大部分を占めることが無くなり、作業部位拡大部の周囲をも明視野に置くことが可能となり、障害物等を排除、あるいは回避して、機械器具あるいは手指を作業部位に容易に到達させる事ができる。
【0023】
の発明のように、頭部に搭載した眼鏡型モニターと同一画面を得るように、有線あるいは無線にて接続された遠隔モニターと、前記遠隔モニターに画像入力可能なペンタブレット、または液晶ペンタブレット等の指示画像入力装置に、任意の指示図形及び文字を入力することによって、作業者が作業対象から目を背けることなく、指導者が遠隔地から作業者の頭部に搭載された眼鏡型モニター画面に、視覚による指示を与えることが可能となる。さらに、イヤホンマイクを利用して音声による指示を与えることが可能となる。これにより、作業対象が人間の場合、第三者あるいは患者等に知られることなく、指導者が作業者の視野内に視覚による指示、および音声による指示を与えることが可能となる。特に、医科、歯科の臨床教育のように人間に対して意識下における手術等の処置に対して指導を行う場合、患者に不安感を抱かせないための有用な指導手段となるばかりでなく、インターネットあるいは電話回線等を利用して、専門医が一般医に対して遠隔指導管理の下で手術処置等を行うことが可能となる。
【0024】
の発明のように、眼鏡部搭載CCDカメラに接続した動画および静止画記録装置は、作業者が両手の自由を奪われることなく頭部に搭載した眼鏡型モニターと遠隔モニター5の画面で確認される作業実体情報をそのままに記録できる効果を奏する。
【図面の簡単な説明】
【図1】本装置の装着状態を示す正面図。
【図2】本装置の装着状態を示す側面図。
【図3】この発明の遠隔モニターおよび画像処理装置等の構成図。
【図4】眼鏡型モニター視野部肉眼図。
【符号の説明】
1. CCDカメラ
2. 眼鏡型モニター
3. イヤホンマイク
4. 画像、音声送受信機
5. 遠隔モニター
6. 画像処理装置
7. 動画および静止画記録装置
8. 指示画像入力装置
9. 眼鏡型モニター視野全画
10.眼鏡型モニター視野拡大部
11.眼鏡型モニター視野非拡大部
[0001]
[Industrial applications]
The present invention relates to an apparatus for enlarging a visual field of work in precision work, a one-man control recording apparatus, and an apparatus for giving visual and audio instructions to an operator.
[0002]
[Prior art]
Conventionally, an optical magnifying glass apparatus has a fixed focal point, and according to a fixed focal length, it is required to maintain a constant distance between a work site and a head position to perform an operation.
[0003]
In addition, when using an optical magnifying device with a high magnification, a magnified image of the work site occupies the entire or most of the visual field, and a machine tool or a finger is applied to the work site by a lip or the like as in a dental oral region. When it is impossible to reach the obstacle directly, it is difficult to remove or avoid the obstacle while visually confirming the obstacle.
[0004]
In order to photograph and record a work site while the worker uses both hands by himself, it is necessary to fix the camera using a tripod or the like or to have a third party hold the camera.
[0005]
Furthermore, when shooting and recording an adjacent work site in the same view as the worker's view, the worker's head may interfere with the shooting, or the camera body may interfere with the worker's view. In particular, when the direction of the field of view is limited, such as in a dental oral region, it has been difficult to image a record without interrupting surgery, treatment, and the like.
[0006]
In addition, when the instructor attempts to visually give an instruction to the worker, it is necessary to point to the work target using a pointing stick or the like near the worker and give the verbal instruction. In addition, when the worker is watching the work field from a remote location, and the subject is a human, the instructor gives visual instructions and voices within the worker's visual field without being known by a third party or patient. It was impossible to give instructions by
[0007]
[Problems to be solved by the invention]
The problem to be solved is to automatically secure any magnification regardless of the magnification and the distance between the worker's head and the work site
[0008]
When working at a high magnification, the center of the field of view is set to a high magnification, and the fields of view other than the center are displayed at the same magnification or at a low magnification,
[0009]
If the worker records information of the same work field of view as the worker during work using both hands, ensure the freedom of both hands of the worker,
[0010]
With the worker gazing at the work site, the instructor can directly give visual and audio instructions to the worker's visual field monitor without being recognized by a third party from a remote location. The purpose is to give.
[0011]
[Means for Solving the Problems]
The present invention has been made in order to achieve the above object, and a first invention is to provide a spectacle-shaped monitor and a position corresponding to the center of the left and right pupils of a wearer on the front of the spectacle-shaped monitor, in the direction of the naked eye visual field. This is a device equipped with an auto-focus CCD camera equipped with a zoom lens mounted facing.
[0012]
The information input from the auto-focus CCD camera equipped with a zoom lens mounted on the spectacle-type monitor is fractionated by image processing, the enlarged portion is in the center, and the field of view other than the enlarged portion is at the same magnification or at a low magnification, It is a device that displays on the glasses-type monitor and the remote monitor.
[0013]
According to a second aspect of the present invention, an instruction image is visually displayed on the glasses-type monitor by writing and displaying by image processing on a wired or wirelessly connected remote monitor so as to obtain the same screen as the glasses-type monitor. A device that displays and gives a voice or wireless instruction using an earphone microphone or the like.
[0014]
The third invention is a one-man control recording device connected to a CCD camera mounted on a spectacle type monitor.
[0015]
DETAILED DESCRIPTION OF THE INVENTION
An eyeglass-type monitor and an auto-focus CCD mounted with a zoom lens mounted in the naked eye viewing direction from a position corresponding to the center of the left and right pupils of the wearer in front of the eyeglass-type monitor, configured as in the first invention. The camera automatically adjusts to an appropriate set magnification so as to automatically obtain an appropriate focus regardless of the distance between the operator's head and the work site.
[0016]
The information input from the auto-focus CCD camera equipped with the zoom lens mounted on the spectacle type monitor is fractionated by the image processing device, and the enlarged portion is centered, and the field of view other than the enlarged portion is at the same magnification or at a low magnification. Display on the glasses-type monitor and the remote monitor.
[0017]
As in the second invention, the remote monitor connected by wire or wirelessly to obtain the same screen as the eyeglass-type monitor mounted on the head can be arbitrarily input by pen tablet input or liquid crystal pen tablet input. The instruction figures and characters are written on a small monitor and a remote monitor mounted on the head, and the instructions are given visually, and the instructions are given by voice using a wired or wireless earphone microphone or the like.
[0018]
As in the third invention, the moving image and still image recording device connected to the CCD camera mounted in the viewing direction from the spectacle type monitor is a spectacle type monitor mounted on the head without depriving the operator of both hands. It can record the working entity confirmed on the screen.
【Example】
The embodiment will be described with reference to the drawings. An operator has a spectacles-type monitor 2 and a zoom lens attached to the naked eye viewing direction from a position corresponding to the center of the left and right pupils of the wearer on the front of the spectacles-type monitor. The mounted auto-focus CCD camera 1 is mounted on the head, and the work site is magnified and clearly visible during fine work.
[0019]
The information input from the auto-focus CCD camera 1 equipped with the zoom lens mounted on the spectacle type monitor 2 is fractionated by the image processing device 6, and the enlarged portion is in the center, and the field of view other than the enlarged portion is the same magnification or low magnification. The ratio is displayed on the glasses-type monitor 2 and the remote monitor 5 at the same rate.
[0020]
As in the second invention, an instruction image such as a pen tablet input or a liquid crystal pen tablet input is displayed on a remote monitor connected by wire or wirelessly so as to obtain the same screen as the glasses-type monitor mounted on the head. By inputting an arbitrary instruction figure and characters by the input device 8, a write instruction is visually given to the glasses-type monitor 9 mounted on the head, and a voice instruction is given by the earphone microphone 3 or the like in a wired or wireless manner. give.
[0021]
As in the third invention, the moving image and still image recording device 7 is connected to the CCD camera 1 mounted on the spectacle section, and the working entity identified on the spectacle type monitor screen 9 mounted on the head and the remote monitor 5 is recorded. .
【The invention's effect】
The present invention is configured as described above, and has the following effects. An eyeglass-type monitor configured as in the first aspect of the invention, and an autofocus CCD camera equipped with a zoom lens mounted in the direction of the naked eye viewing direction from a position corresponding to the center of the left and right pupils of the wearer in front of the eyeglass-type monitor Automatically adjusts to obtain an appropriate focus regardless of the distance between the worker's head and the work site for an arbitrary set magnification, so that the worker can adjust the work site without being restricted by the position of the head. It becomes possible to see clearly.
[0022]
Furthermore , image information input from an autofocus CCD camera equipped with a zoom lens mounted on a spectacle type monitor is fractionated by computer image processing, and the enlarged part is in the center, and the field of view other than the enlarged part is at the same magnification or low magnification. When using the device at a high magnification, the magnified image of the visual field working area does not occupy the whole or most of the field of view, and the surrounding area of the magnifying area of the working area is also bright field. , And obstructions or the like can be eliminated or avoided, and the machine tool or finger can easily reach the work site.
[0023]
As in the second invention, a remote monitor connected by wire or wireless so as to obtain the same screen as the eyeglass-type monitor mounted on the head, and a pen tablet or a liquid crystal pen capable of inputting an image to the remote monitor By inputting an arbitrary instruction figure and characters into an instruction image input device such as a tablet, the instructor can take a spectacle type mounted on the worker's head from a remote place without turning the operator's eyes on the work target. Visual instructions can be given to the monitor screen. Furthermore, it is possible to give a voice instruction using an earphone microphone. Thus, when the work target is a human, the instructor can give a visual instruction and a voice instruction within the field of view of the worker without being known by a third party or a patient. In particular, when providing guidance on procedures such as surgery under consciousness to humans, such as medical and dental clinical education, it is not only a useful guidance means for not giving patients anxiety, Using the Internet or a telephone line, it becomes possible for a specialist to perform a surgical procedure or the like on a general physician under remote guidance management.
[0024]
As in the third invention, the moving image and still image recording device connected to the CCD camera mounted on the spectacles section can be displayed on the screen of the spectacle-type monitor and the remote monitor 5 mounted on the head without depriving the worker of the freedom of both hands. This has the effect of recording the confirmed work entity information as it is.
[Brief description of the drawings]
FIG. 1 is a front view showing a mounted state of the present apparatus.
FIG. 2 is a side view showing a mounted state of the apparatus.
FIG. 3 is a configuration diagram of a remote monitor, an image processing device, and the like of the present invention.
FIG. 4 is a macroscopic view of a spectacle type monitor visual field part.
[Explanation of symbols]
1. 1. CCD camera 2. glasses-type monitor Earphone microphone4. 4. Image and audio transceiver Remote monitor 6. Image processing device 7. Moving picture and still picture recording device8. 8. Instruction image input device 9. Glasses-type monitor whole view 10. Glasses-type monitor view expansion section Glasses-type monitor non-magnifying area

Claims (3)

眼鏡型モニターと、前記眼鏡型モニター前面の装着作業者左右瞳孔中央部に相当する位置から、裸眼視野方向に向けて取り付けたズームレンズ搭載自動焦点CCDカメラからなる装置であって、前記ズームレンズ搭載自動焦点CCDカメラから入力された画像情報を画像処理し、前記眼鏡型モニターに表示する等倍あるいは低拡大率の画像の中央部に拡大画像を分画表示することを特徴とする眼鏡型モニター式拡大鏡。An apparatus comprising an eyeglass-type monitor and a self-focusing CCD camera with a zoom lens mounted in the direction of the naked eye viewing direction from a position corresponding to the center of the left and right pupils of the wearer on the front of the eyeglass-type monitor, wherein the zoom lens is mounted. An eyeglass-type monitor type, wherein image processing is performed on image information input from an autofocus CCD camera, and an enlarged image is fractionally displayed at the center of an image of the same magnification or a low magnification displayed on the eyeglass-type monitor. Magnifier. 請求項1の眼鏡型モニター式拡大鏡の画像情報を、インターネット、電話回線、有線あるいは無線にて接続する遠隔モニターに表示し、その遠隔モニター表示される画像上で書き込む指示図形及び文字等の指示画像を画像処理装置で合成し、その合成画像情報を、装着作業者眼鏡型モニター式拡大鏡の眼鏡型モニターに表示するとともに、装着作業者のイヤホンに、インターネット、電話回線、有線あるいは無線にて接続されたマイクロフォンを利用して、視覚と音声による指示を可能としたことを特徴とする眼鏡型モニター式拡大鏡。The image information of the glasses-type monitor type magnifying glass according to claim 1 is displayed on a remote monitor connected via the Internet, a telephone line, a wire or wirelessly, and instructions such as instruction figures and characters to be written on the image displayed on the remote monitor. The image is synthesized by the image processing device, and the synthesized image information is displayed on the eyeglass-type monitor of the wearer's eyeglass-type monitor-type magnifying glass, and is connected to the earphone of the wearer via the Internet, a telephone line, wired or wireless. A spectacle-type monitor-type magnifying glass characterized in that visual and audio instructions can be provided using a connected microphone. 前記請求項1,又は2の眼鏡型モニター式拡大鏡の画像情報をインターネット、電話回線、有線あるいは無線で接続した動画および静止画記録装置に出力することを特徴とする眼鏡型モニター式拡大鏡。3. An eyeglass-type monitor-type magnifying glass, wherein the image information of the eyeglass-type monitor-type magnifying glass according to claim 1 or 2 is output to a moving image and still image recording device connected to the Internet, a telephone line, or a wired or wireless connection.
JP11774998A 1998-03-23 1998-03-23 Glasses monitor magnifier Expired - Lifetime JP3556829B2 (en)

Priority Applications (1)

Application Number Priority Date Filing Date Title
JP11774998A JP3556829B2 (en) 1998-03-23 1998-03-23 Glasses monitor magnifier

Applications Claiming Priority (1)

Application Number Priority Date Filing Date Title
JP11774998A JP3556829B2 (en) 1998-03-23 1998-03-23 Glasses monitor magnifier

Publications (2)

Publication Number Publication Date
JPH11275422A JPH11275422A (en) 1999-10-08
JP3556829B2 true JP3556829B2 (en) 2004-08-25

Family

ID=14719373

Family Applications (1)

Application Number Title Priority Date Filing Date
JP11774998A Expired - Lifetime JP3556829B2 (en) 1998-03-23 1998-03-23 Glasses monitor magnifier

Country Status (1)

Country Link
JP (1) JP3556829B2 (en)

Families Citing this family (2)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
JP4288843B2 (en) 2000-10-25 2009-07-01 沖電気工業株式会社 Remote work support system
GB2461022A (en) * 2008-06-16 2009-12-23 Michael Wiper Recording camera system that transmits stored images

Also Published As

Publication number Publication date
JPH11275422A (en) 1999-10-08

Similar Documents

Publication Publication Date Title
US10423012B2 (en) Wearable vision redirecting devices
US10424115B2 (en) Head-worn platform for integrating virtuality with reality
US9772495B2 (en) Digital loupe device
US11272170B2 (en) Ergonomic protective eyewear
EP3725254A2 (en) Microsurgery system with a robotic arm controlled by a head-mounted display
US20050206583A1 (en) Selectively controllable heads-up display system
US11950968B2 (en) Surgical augmented reality
JPH08140991A (en) Observing apparatus for medical treatment
WO2012075155A2 (en) System and method of viewing and tracking stereoscopic video images
KR20080080291A (en) Method of dental microscopic procedure
US10747004B2 (en) Ergonomic protective eyewear
JP5870162B2 (en) Imaging system
JPWO2008096719A1 (en) Head mounted display with open peripheral vision
CN107835953B (en) Wearable visual redirection device
WO2017147235A1 (en) Wearable systems having remotely positioned vision redirection
US10448004B1 (en) Ergonomic protective eyewear
US20240061272A1 (en) Electronic loupe
US7443417B1 (en) Method of performing dental work and apparatus providing vision enhancement dentistry
JP3556829B2 (en) Glasses monitor magnifier
CN115087413A (en) Method for operating a surgical microscope and surgical microscope
JP2689718B2 (en) Display device for micro surgery
US20240022680A1 (en) Electronic loupe
JPH07193768A (en) Dental picture display mechanism
WO2019098838A1 (en) Spectacles as ergonomical aid
Britto et al. Personal video monitor as an accessory to dental operating microscopes.

Legal Events

Date Code Title Description
TRDD Decision of grant or rejection written
A01 Written decision to grant a patent or to grant a registration (utility model)

Free format text: JAPANESE INTERMEDIATE CODE: A01

Effective date: 20040428

A61 First payment of annual fees (during grant procedure)

Free format text: JAPANESE INTERMEDIATE CODE: A61

Effective date: 20040513

R150 Certificate of patent or registration of utility model

Free format text: JAPANESE INTERMEDIATE CODE: R150

A521 Request for written amendment filed

Free format text: JAPANESE INTERMEDIATE CODE: A523

Effective date: 20031112

R250 Receipt of annual fees

Free format text: JAPANESE INTERMEDIATE CODE: R250

FPAY Renewal fee payment (event date is renewal date of database)

Free format text: PAYMENT UNTIL: 20090521

Year of fee payment: 5

FPAY Renewal fee payment (event date is renewal date of database)

Free format text: PAYMENT UNTIL: 20100521

Year of fee payment: 6

FPAY Renewal fee payment (event date is renewal date of database)

Free format text: PAYMENT UNTIL: 20110521

Year of fee payment: 7

FPAY Renewal fee payment (event date is renewal date of database)

Free format text: PAYMENT UNTIL: 20120521

Year of fee payment: 8

FPAY Renewal fee payment (event date is renewal date of database)

Free format text: PAYMENT UNTIL: 20130521

Year of fee payment: 9

R250 Receipt of annual fees

Free format text: JAPANESE INTERMEDIATE CODE: R250

R250 Receipt of annual fees

Free format text: JAPANESE INTERMEDIATE CODE: R250

R250 Receipt of annual fees

Free format text: JAPANESE INTERMEDIATE CODE: R250

R250 Receipt of annual fees

Free format text: JAPANESE INTERMEDIATE CODE: R250

R250 Receipt of annual fees

Free format text: JAPANESE INTERMEDIATE CODE: R250

EXPY Cancellation because of completion of term