JP2002304192A - Voice recognition device - Google Patents

Voice recognition device

Info

Publication number
JP2002304192A
JP2002304192A JP2001107756A JP2001107756A JP2002304192A JP 2002304192 A JP2002304192 A JP 2002304192A JP 2001107756 A JP2001107756 A JP 2001107756A JP 2001107756 A JP2001107756 A JP 2001107756A JP 2002304192 A JP2002304192 A JP 2002304192A
Authority
JP
Japan
Prior art keywords
disk
voice
recognition
voice recognition
data
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Granted
Application number
JP2001107756A
Other languages
Japanese (ja)
Other versions
JP4724943B2 (en
Inventor
Yoshitaka Ozaki
義隆 尾崎
Toru Nada
徹 名田
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
Denso Corp
Original Assignee
Denso Corp
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Denso Corp filed Critical Denso Corp
Priority to JP2001107756A priority Critical patent/JP4724943B2/en
Publication of JP2002304192A publication Critical patent/JP2002304192A/en
Application granted granted Critical
Publication of JP4724943B2 publication Critical patent/JP4724943B2/en
Anticipated expiration legal-status Critical
Expired - Fee Related legal-status Critical Current

Links

Landscapes

  • Rotational Drive Of Disk (AREA)

Abstract

PROBLEM TO BE SOLVED: To reduce the time required for recognition by reducing the time required to read voice data from a disk. SOLUTION: When discrimination is made to determine that a PTT switch has been operated (a step 101), a beep sound is generated (a step 102) and a command to start rotating the disk is outputted to a disk driver (a step 103). Then, audio signals of voice uttered by a user are taken in from a microphone to conduct voice recognition process (a step 104). When a recognition result is obtained, the driver is controlled, talk-back data, corresponding to the recognition result are obtained from the disk and talk-back voice is outputted from a loudspeaker (a step 105). Since the rotation of the disk is started prior to the voice recognition process, the time required to read the talk-back data is reduced, even though the disk is stopped.

Description

【発明の詳細な説明】DETAILED DESCRIPTION OF THE INVENTION

【0001】[0001]

【発明の属する技術分野】本発明は、ユーザが発声した
音声を認識し、トークバック音声を発声させる音声認識
装置に関する。
BACKGROUND OF THE INVENTION 1. Field of the Invention The present invention relates to a speech recognition apparatus for recognizing speech uttered by a user and producing talkback speech.

【0002】[0002]

【従来の技術および発明が解決しようとする課題】従
来、この種の音声認識装置として、例えばカーナビゲー
ションシステムに用いられる音声認識など種々のものが
提案されている。
2. Description of the Related Art Various types of voice recognition apparatuses of this type have been proposed, such as voice recognition used in car navigation systems.

【0003】このような音声認識装置において、認識結
果をユーザに通知するための音声データがDVD等の大
容量のディスクに格納されている。ディスクに格納され
たデータは、ディスクドライバを用いて読み出される。
ディスクドライバは、ディスクを高速で回転させ、ヘッ
ドを回転方向と垂直に移動させて、データの読み出しを
行う。また、ディスクドライバは、その耐久性向上およ
び消費電力低減のために、ディスクに対するアクセスが
一定時間以上ない場合に、ディスクの回転を停止させる
ようになっている。
In such a voice recognition device, voice data for notifying a user of a recognition result is stored in a large-capacity disk such as a DVD. Data stored on the disk is read using a disk driver.
The disk driver reads the data by rotating the disk at a high speed and moving the head perpendicular to the rotation direction. Further, in order to improve the durability and reduce the power consumption, the disk driver stops the rotation of the disk when there is no access to the disk for a certain time or more.

【0004】ディスクが停止状態にあるときに、音声デ
ータの読み出し要求があると、ディスクの回転が安定
し、読み出し用ヘッドの焦点が合うまでに、約1〜2秒
の時間がかかってしまう。このため、音声認識装置にお
ける認識時間が長くなってしまう。すなわち、認識時間
を、ユーザの発話完了から認識結果を得てトークバック
音声が発生するまでの時間と定義した場合、認識結果を
得てトークバック音声が発生するまでの時間が長くなる
ため、認識時間が長くなってしまう。
If there is a request to read audio data while the disk is stopped, it takes about 1-2 seconds for the rotation of the disk to stabilize and for the read head to be in focus. For this reason, the recognition time in the voice recognition device becomes long. In other words, if the recognition time is defined as the time from the completion of the utterance of the user to the time when the recognition result is obtained and the talk-back sound is generated, the time until the recognition result is obtained and the talk-back sound is generated becomes longer. Time will be long.

【0005】本発明は上記問題に鑑みたもので、ディス
クからの音声データの読み出しにかかる時間を短くして
認識時間を短くすることを目的とする。
The present invention has been made in view of the above problems, and has as its object to reduce the time required for reading audio data from a disk to shorten the recognition time.

【0006】[0006]

【課題を解決するための手段】上記目的を達成するた
め、請求項1に記載の発明では、音声認識を開始させる
ためのスイッチをユーザが操作した後にユーザが発声し
た音声の音声信号をマイクから取り込んで、音声認識処
理を行い、認識結果に応じた音声データをディスクから
取得して、トークバック音声をスピーカから発声させる
音声認識装置において、前記スイッチが操作された後、
前記音声認識処理を開始するまでの間の所定タイミング
において、前記ディスクの回転を開始させるための処理
を行う手段を備えたことを特徴としている。
In order to achieve the above object, according to the first aspect of the present invention, a voice signal of a voice uttered by a user after a user operates a switch for starting voice recognition is transmitted from a microphone. In the voice recognition device that captures and performs voice recognition processing, obtains voice data according to the recognition result from the disk, and generates talkback voice from a speaker, after the switch is operated,
At a predetermined timing before the start of the voice recognition process, there is provided a means for performing a process for starting the rotation of the disk.

【0007】この発明によれば、先にディスクの回転を
開始させておき、その後に認識結果に応じた音声データ
をディスクから取得するようにしているから、ディスク
からの音声データの読み出しにかかる時間を短くして認
識時間を短くすることができる。
According to the present invention, since the rotation of the disk is started first, and then the audio data corresponding to the recognition result is obtained from the disk, the time required for reading the audio data from the disk is obtained. And the recognition time can be shortened.

【0008】[0008]

【発明の実施の形態】以下、本発明を図に示す実施形態
について説明する。図1に、音声認識システムの全体構
成を示す。音声認識システムは、PTT(pusu to talk)
スイッチ1と、マイク2と、スピーカ3と、音声認識装
置4と、ディスクドライバ5とからなる。このディスク
ドライバ5には、トークバックデータなどのデータが格
納されたディスク6が装備される。
DETAILED DESCRIPTION OF THE PREFERRED EMBODIMENTS The present invention will be described below with reference to an embodiment shown in the drawings. FIG. 1 shows the overall configuration of the speech recognition system. The voice recognition system is PTT (pusu to talk)
It comprises a switch 1, a microphone 2, a speaker 3, a voice recognition device 4, and a disk driver 5. The disk driver 5 includes a disk 6 in which data such as talkback data is stored.

【0009】PTTスイッチ1は、音声認識を開始する
ときにユーザによって操作される。音声認識装置4は、
PTTスイッチ1が操作された後にユーザが発声した音
声の音声信号をマイク2から取り込んで、音声認識処理
を行い、ディスクドライバ5を制御して認識結果に応じ
た音声データ(トークバックデータ)をディスク6から
取得し、トークバック音声をスピーカ3から発声させ
る。この音声認識装置4は、単独の装置のみならず、例
えば車両用のナビゲーション装置の制御装置において実
現することもできる。この場合、ナビゲーション装置に
おける制御装置は、コンピュータを用いて構成され、ナ
ビゲーションとしての機能を実行するための種々の機能
を備えるとともに、音声認識を行う機能も備えている。
The PTT switch 1 is operated by the user when starting speech recognition. The voice recognition device 4
A voice signal of a voice uttered by the user after the PTT switch 1 is operated is taken in from the microphone 2, voice recognition processing is performed, and the disk driver 5 is controlled to generate voice data (talkback data) corresponding to the recognition result. 6, and the talkback sound is uttered from the speaker 3. The voice recognition device 4 can be realized not only in a single device but also in a control device of a navigation device for a vehicle, for example. In this case, the control device in the navigation device is configured using a computer, and has various functions for executing functions as navigation and also has a function for performing voice recognition.

【0010】以下、この実施形態における音声認識装置
4の具体的な作動を、図2に示す処理に従って説明す
る。
Hereinafter, a specific operation of the speech recognition apparatus 4 in this embodiment will be described with reference to the processing shown in FIG.

【0011】音声認識装置4は、図2に示す処理を繰り
返し実行している。まず、PTTスイッチ1が操作され
たか否かを判定する(ステップ101)。PTTスイッ
チ1が操作されたことを判定すると、ユーザの発声を促
すためにビープ音をスピーカ3から発生させる(ステッ
プ102)。そして、ディスク6の回転を開始させる指
令をディスクドライバ5に出力する(ステップ10
3)。
The speech recognition device 4 repeatedly executes the processing shown in FIG. First, it is determined whether or not the PTT switch 1 has been operated (step 101). When it is determined that the PTT switch 1 has been operated, a beep sound is generated from the speaker 3 to prompt the user to utter (Step 102). Then, a command to start the rotation of the disk 6 is output to the disk driver 5 (step 10).
3).

【0012】次に、ユーザが発声した音声の音声信号を
マイク2から取り込んで、音声認識処理を行う(ステッ
プ104)。すなわち、マイク2から取り込んだ音声信
号により、解析・辞書照を行って認識結果を求める。こ
のとき、認識処理時間に対して、音声認識装置4のCP
Uの処理能力が十分でなければ、音声信号をバッファリ
ングし、ユーザの発声が完了した後も、引き続き、バッ
ファリングされた音声信号に基づいて音声認識処理を行
うようにする。
Next, a voice signal of a voice uttered by the user is taken in from the microphone 2 and voice recognition processing is performed (step 104). That is, based on the voice signal taken in from the microphone 2, analysis and dictionary illumination are performed to obtain a recognition result. At this time, the CP of the speech recognition device 4 is compared with the recognition processing time.
If the processing capability of U is not sufficient, the voice signal is buffered, and the voice recognition process is continuously performed based on the buffered voice signal even after the utterance of the user is completed.

【0013】そして、認識結果が得られると、ディスク
ドライバ5を制御して認識結果に応じたトークバックデ
ータをディスク6から取得し、トークバック音声をスピ
ーカ3から発声させる(ステップ105)。この場合、
ステップ103において、ディスク6の回転を先に開始
させるようにしているから、ディスク6がそれまで停止
していても、トークバックデータを読み出すまでにディ
スク6の回転が安定しているため、トークバックデータ
の読み出し時間を短くすることができる。
When the recognition result is obtained, the disk driver 5 is controlled to obtain talkback data corresponding to the recognition result from the disk 6, and the talkback sound is uttered from the speaker 3 (step 105). in this case,
In step 103, since the rotation of the disk 6 is started first, the rotation of the disk 6 is stable before the talkback data is read even if the disk 6 has been stopped. Data read time can be shortened.

【0014】なお、上記した実施形態では、ディスク6
の回転を開始させるための処理を、ディスク6が回転し
ているか停止しているかに係わらず回転開始させるもの
を示したが、ディスク6が回転しているか否かを判定
し、停止しているときにのみ回転を開始させるようにし
てもよい。
In the above embodiment, the disk 6
The process for starting the rotation of the disk 6 is described as starting the rotation regardless of whether the disk 6 is rotating or stopped. However, it is determined whether or not the disk 6 is rotating, and the process is stopped. The rotation may be started only when necessary.

【0015】また、上記した実施形態では、PTTスイ
ッチ1が操作されことを判定し、ビープを発生させた後
に、ディスク6の回転を開始させるものを示したが、そ
の回転開始のタイミングは、PTTスイッチ1が操作さ
れた後、音声認識処理を開始するまでの間であれば、他
のタイミングであってもよい。但し、認識する音声が非
常に短いような場合を想定すると、PTTスイッチ1が
操作された直後(ビープ音の発生前、あるいは発生後)
が好ましい。
Further, in the above-described embodiment, a case is described in which it is determined that the PTT switch 1 is operated, and after the beep is generated, the rotation of the disk 6 is started. Other timings may be used as long as the timing is after the switch 1 is operated and before the voice recognition processing is started. However, assuming that the voice to be recognized is very short, immediately after the PTT switch 1 is operated (before or after the generation of the beep).
Is preferred.

【図面の簡単な説明】[Brief description of the drawings]

【図1】本発明の一実施形態に係る音声認識システムの
全体構成を示す図である。
FIG. 1 is a diagram showing an overall configuration of a speech recognition system according to an embodiment of the present invention.

【図2】図1中の音声認識装置4の処理を示すフローチ
ャートである。
FIG. 2 is a flowchart showing a process of the speech recognition device 4 in FIG.

【符号の説明】[Explanation of symbols]

1…PTTスイッチ、2…マイク、3…スピーカ、4…
音声認識装置、5…ディスクドライバ、6…ディスク。
1 ... PTT switch, 2 ... microphone, 3 ... speaker, 4 ...
Voice recognition device, 5: disk driver, 6: disk.

───────────────────────────────────────────────────── フロントページの続き (51)Int.Cl.7 識別記号 FI テーマコート゛(参考) G11B 19/20 G10L 3/00 R Fターム(参考) 5D015 KK02 KK04 LL10 LL12 5D045 AB17 5D109 EA20 ──────────────────────────────────────────────────続 き Continued on the front page (51) Int.Cl. 7 Identification symbol FI Theme coat ゛ (Reference) G11B 19/20 G10L 3/00 R F-term (Reference) 5D015 KK02 KK04 LL10 LL12 5D045 AB17 5D109 EA20

Claims (1)

【特許請求の範囲】[Claims] 【請求項1】 音声認識を開始させるためのスイッチを
ユーザが操作した後にユーザが発声した音声の音声信号
をマイクから取り込んで、音声認識処理を行い、認識結
果に応じた音声データをディスクから取得して、トーク
バック音声をスピーカから発声させる音声認識装置にお
いて、 前記スイッチが操作された後、前記音声認識処理を開始
するまでの間の所定タイミングにおいて、前記ディスク
の回転を開始させるための処理を行う手段を備えたこと
を特徴とする音声認識装置。
1. A user operates a switch for starting voice recognition and then takes in a voice signal of a voice uttered by the user from a microphone, performs voice recognition processing, and obtains voice data according to a recognition result from a disk. Then, in a voice recognition device that generates talkback voice from a speaker, a process for starting rotation of the disc at a predetermined timing after the switch is operated and before the voice recognition process is started. A speech recognition device, comprising:
JP2001107756A 2001-04-05 2001-04-05 Voice recognition device Expired - Fee Related JP4724943B2 (en)

Priority Applications (1)

Application Number Priority Date Filing Date Title
JP2001107756A JP4724943B2 (en) 2001-04-05 2001-04-05 Voice recognition device

Applications Claiming Priority (1)

Application Number Priority Date Filing Date Title
JP2001107756A JP4724943B2 (en) 2001-04-05 2001-04-05 Voice recognition device

Publications (2)

Publication Number Publication Date
JP2002304192A true JP2002304192A (en) 2002-10-18
JP4724943B2 JP4724943B2 (en) 2011-07-13

Family

ID=18960022

Family Applications (1)

Application Number Title Priority Date Filing Date
JP2001107756A Expired - Fee Related JP4724943B2 (en) 2001-04-05 2001-04-05 Voice recognition device

Country Status (1)

Country Link
JP (1) JP4724943B2 (en)

Cited By (4)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
JP2008130101A (en) * 2006-11-16 2008-06-05 Kenwood Corp Optical disk reproducing device, standby state setting method, and standby state setting program
CN106550286A (en) * 2016-11-07 2017-03-29 武汉卡比特信息有限公司 Based on the real-time intercommunication method under driving environment, terminal, server and system
CN111081236A (en) * 2018-10-22 2020-04-28 中兴通讯股份有限公司 Voice processing method, terminal and computer storage medium
JP2021015180A (en) * 2019-07-11 2021-02-12 東芝映像ソリューション株式会社 Electronic apparatus, program and voice recognition method

Citations (18)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
JPS59218582A (en) * 1983-05-27 1984-12-08 株式会社日立製作所 Automatic transactor
JPH01292668A (en) * 1988-05-20 1989-11-24 Fuji Photo Film Co Ltd Recording/reproducing device
JPH02264551A (en) * 1989-04-05 1990-10-29 Oki Electric Ind Co Ltd Voice reply recognition device
JPH03169183A (en) * 1989-11-29 1991-07-22 Konica Corp Still video camera
JPH0541020A (en) * 1991-12-20 1993-02-19 Teac Corp Disk driving device
JPH06274190A (en) * 1993-03-18 1994-09-30 Sony Corp Navigation system and speech recognition device
JPH0721669A (en) * 1993-07-02 1995-01-24 Fujitsu Ltd Control system for large capacity optical disk
JPH07176174A (en) * 1992-12-25 1995-07-14 Mitsubishi Electric Corp Disk device
JPH0934488A (en) * 1995-07-18 1997-02-07 Mazda Motor Corp Voice operating device for car on-board apparatus
JPH11110956A (en) * 1997-09-30 1999-04-23 Sony Corp Device and method for reproducing signal, device and method for recording/reproducing signal
JP2000181500A (en) * 1998-12-15 2000-06-30 Equos Research Co Ltd Speech recognition apparatus and agent apparatus
JP2000221049A (en) * 1999-01-29 2000-08-11 Equos Research Co Ltd Vehicle situation grasping system, agent device, and vehicle controller
JP2000314635A (en) * 1999-04-28 2000-11-14 Equos Research Co Ltd Agent device
JP2001022384A (en) * 1999-07-09 2001-01-26 Nissan Motor Co Ltd Voice interactive device
JP2001034289A (en) * 1999-07-16 2001-02-09 Nec Corp Interactive system using natural language
JP2001042891A (en) * 1999-07-27 2001-02-16 Suzuki Motor Corp Speech recognition apparatus, speech recognition mounting device, speech recognition mounting system, speech recognition method, and memory medium
JP2001067091A (en) * 1999-08-25 2001-03-16 Sony Corp Voice recognition device
JP2001083981A (en) * 1999-09-08 2001-03-30 Mitsubishi Electric Corp Speech recognition system and method and recording medium readable by computer having recorded voice recognition program therein

Family Cites Families (1)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
DE19533541C1 (en) * 1995-09-11 1997-03-27 Daimler Benz Aerospace Ag Method for the automatic control of one or more devices by voice commands or by voice dialog in real time and device for executing the method

Patent Citations (18)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
JPS59218582A (en) * 1983-05-27 1984-12-08 株式会社日立製作所 Automatic transactor
JPH01292668A (en) * 1988-05-20 1989-11-24 Fuji Photo Film Co Ltd Recording/reproducing device
JPH02264551A (en) * 1989-04-05 1990-10-29 Oki Electric Ind Co Ltd Voice reply recognition device
JPH03169183A (en) * 1989-11-29 1991-07-22 Konica Corp Still video camera
JPH0541020A (en) * 1991-12-20 1993-02-19 Teac Corp Disk driving device
JPH07176174A (en) * 1992-12-25 1995-07-14 Mitsubishi Electric Corp Disk device
JPH06274190A (en) * 1993-03-18 1994-09-30 Sony Corp Navigation system and speech recognition device
JPH0721669A (en) * 1993-07-02 1995-01-24 Fujitsu Ltd Control system for large capacity optical disk
JPH0934488A (en) * 1995-07-18 1997-02-07 Mazda Motor Corp Voice operating device for car on-board apparatus
JPH11110956A (en) * 1997-09-30 1999-04-23 Sony Corp Device and method for reproducing signal, device and method for recording/reproducing signal
JP2000181500A (en) * 1998-12-15 2000-06-30 Equos Research Co Ltd Speech recognition apparatus and agent apparatus
JP2000221049A (en) * 1999-01-29 2000-08-11 Equos Research Co Ltd Vehicle situation grasping system, agent device, and vehicle controller
JP2000314635A (en) * 1999-04-28 2000-11-14 Equos Research Co Ltd Agent device
JP2001022384A (en) * 1999-07-09 2001-01-26 Nissan Motor Co Ltd Voice interactive device
JP2001034289A (en) * 1999-07-16 2001-02-09 Nec Corp Interactive system using natural language
JP2001042891A (en) * 1999-07-27 2001-02-16 Suzuki Motor Corp Speech recognition apparatus, speech recognition mounting device, speech recognition mounting system, speech recognition method, and memory medium
JP2001067091A (en) * 1999-08-25 2001-03-16 Sony Corp Voice recognition device
JP2001083981A (en) * 1999-09-08 2001-03-30 Mitsubishi Electric Corp Speech recognition system and method and recording medium readable by computer having recorded voice recognition program therein

Cited By (5)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
JP2008130101A (en) * 2006-11-16 2008-06-05 Kenwood Corp Optical disk reproducing device, standby state setting method, and standby state setting program
CN106550286A (en) * 2016-11-07 2017-03-29 武汉卡比特信息有限公司 Based on the real-time intercommunication method under driving environment, terminal, server and system
CN111081236A (en) * 2018-10-22 2020-04-28 中兴通讯股份有限公司 Voice processing method, terminal and computer storage medium
JP2021015180A (en) * 2019-07-11 2021-02-12 東芝映像ソリューション株式会社 Electronic apparatus, program and voice recognition method
JP7216621B2 (en) 2019-07-11 2023-02-01 Tvs Regza株式会社 Electronic devices, programs and speech recognition methods

Also Published As

Publication number Publication date
JP4724943B2 (en) 2011-07-13

Similar Documents

Publication Publication Date Title
US20050216271A1 (en) Speech dialogue system for controlling an electronic device
JP2006201749A (en) Device in which selection is activated by voice, and method in which selection is activated by voice
JP2008256802A (en) Voice recognition device and voice recognition method
JP7023823B2 (en) In-vehicle device and voice recognition method
JPH11126092A (en) Voice recognition device and on-vehicle voice recognition device
JP2002304192A (en) Voice recognition device
EP2507792B1 (en) Vocabulary dictionary recompile for in-vehicle audio system
JP6817386B2 (en) Voice recognition methods, voice wakeup devices, voice recognition devices, and terminals
WO2019202351A1 (en) Device control apparatus, and control method for controlling devices
JP2001296891A (en) Method and device for voice recognition
US20210357179A1 (en) Agent coordination device, agent cooridnation method and recording medium
US10127910B2 (en) Speech recognition apparatus and computer program product for speech recognition
JPH09134193A (en) Speech recognition device
JP4810343B2 (en) Speech processing apparatus and control method thereof
JP2001013984A (en) Speech manipulation apparatus
JP6851491B2 (en) Voice dialogue control device and voice dialogue control method
JP2004354722A (en) Speech recognition device
JPH11237892A (en) Device and method for control by speech recognition and storage medium recording program for control by speech voice recognition
JP7258007B2 (en) Voice recognition method, voice wake-up device, voice recognition device, and terminal
US20210360326A1 (en) Agent cooperation device, operation method thereof, and storage medium
JP2021089310A (en) Voice operation device, voice operation system and voice operation method
JP7069730B2 (en) Information processing equipment, methods, and programs
JP2002023903A (en) Use interaction method, device for performing the same and storage medium storing program for performing the same
JP2005134436A (en) Speech recognition device
JPH0458639B2 (en)

Legal Events

Date Code Title Description
A621 Written request for application examination

Free format text: JAPANESE INTERMEDIATE CODE: A621

Effective date: 20070726

A131 Notification of reasons for refusal

Free format text: JAPANESE INTERMEDIATE CODE: A131

Effective date: 20100608

A521 Request for written amendment filed

Free format text: JAPANESE INTERMEDIATE CODE: A523

Effective date: 20100806

A131 Notification of reasons for refusal

Free format text: JAPANESE INTERMEDIATE CODE: A131

Effective date: 20101019

A521 Request for written amendment filed

Free format text: JAPANESE INTERMEDIATE CODE: A523

Effective date: 20101213

A01 Written decision to grant a patent or to grant a registration (utility model)

Free format text: JAPANESE INTERMEDIATE CODE: A01

Effective date: 20110315

A61 First payment of annual fees (during grant procedure)

Free format text: JAPANESE INTERMEDIATE CODE: A61

Effective date: 20110328

FPAY Renewal fee payment (event date is renewal date of database)

Free format text: PAYMENT UNTIL: 20140422

Year of fee payment: 3

R250 Receipt of annual fees

Free format text: JAPANESE INTERMEDIATE CODE: R250

R250 Receipt of annual fees

Free format text: JAPANESE INTERMEDIATE CODE: R250

R250 Receipt of annual fees

Free format text: JAPANESE INTERMEDIATE CODE: R250

LAPS Cancellation because of no payment of annual fees