JP3529049B2 - 学習装置及び学習方法並びにロボット装置 - Google Patents

学習装置及び学習方法並びにロボット装置

Info

Publication number
JP3529049B2
JP3529049B2 JP2002060425A JP2002060425A JP3529049B2 JP 3529049 B2 JP3529049 B2 JP 3529049B2 JP 2002060425 A JP2002060425 A JP 2002060425A JP 2002060425 A JP2002060425 A JP 2002060425A JP 3529049 B2 JP3529049 B2 JP 3529049B2
Authority
JP
Japan
Prior art keywords
target object
recognition
unit
name
learning
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Expired - Fee Related
Application number
JP2002060425A
Other languages
English (en)
Japanese (ja)
Other versions
JP2003255989A (ja
JP2003255989A5 (enExample
Inventor
秀樹 下村
一美 青山
敬一 山田
康治 浅野
厚志 大久保
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
Sony Corp
Original Assignee
Sony Corp
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Priority to JP2002060425A priority Critical patent/JP3529049B2/ja
Application filed by Sony Corp filed Critical Sony Corp
Priority to PCT/JP2003/002560 priority patent/WO2003075261A1/ja
Priority to CNB038002256A priority patent/CN1241168C/zh
Priority to DE60318990T priority patent/DE60318990T2/de
Priority to KR1020037014405A priority patent/KR100988708B1/ko
Priority to US10/476,662 priority patent/US7720775B2/en
Priority to EP03710242A priority patent/EP1482480B1/en
Publication of JP2003255989A publication Critical patent/JP2003255989A/ja
Application granted granted Critical
Publication of JP3529049B2 publication Critical patent/JP3529049B2/ja
Publication of JP2003255989A5 publication Critical patent/JP2003255989A5/ja
Anticipated expiration legal-status Critical
Expired - Fee Related legal-status Critical Current

Links

Classifications

    • GPHYSICS
    • G10MUSICAL INSTRUMENTS; ACOUSTICS
    • G10LSPEECH ANALYSIS TECHNIQUES OR SPEECH SYNTHESIS; SPEECH RECOGNITION; SPEECH OR VOICE PROCESSING TECHNIQUES; SPEECH OR AUDIO CODING OR DECODING
    • G10L15/00Speech recognition
    • G10L15/22Procedures used during a speech recognition process, e.g. man-machine dialogue
    • GPHYSICS
    • G06COMPUTING OR CALCULATING; COUNTING
    • G06NCOMPUTING ARRANGEMENTS BASED ON SPECIFIC COMPUTATIONAL MODELS
    • G06N3/00Computing arrangements based on biological models
    • G06N3/004Artificial life, i.e. computing arrangements simulating life
    • G06N3/008Artificial life, i.e. computing arrangements simulating life based on physical entities controlled by simulated intelligence so as to replicate intelligent life forms, e.g. based on robots replicating pets or humans in their appearance or behaviour
    • GPHYSICS
    • G06COMPUTING OR CALCULATING; COUNTING
    • G06TIMAGE DATA PROCESSING OR GENERATION, IN GENERAL
    • G06T7/00Image analysis
    • GPHYSICS
    • G06COMPUTING OR CALCULATING; COUNTING
    • G06VIMAGE OR VIDEO RECOGNITION OR UNDERSTANDING
    • G06V40/00Recognition of biometric, human-related or animal-related patterns in image or video data
    • G06V40/10Human or animal bodies, e.g. vehicle occupants or pedestrians; Body parts, e.g. hands
    • G06V40/16Human faces, e.g. facial parts, sketches or expressions
    • G06V40/168Feature extraction; Face representation
    • G06V40/171Local features and components; Facial parts ; Occluding parts, e.g. glasses; Geometrical relationships
    • GPHYSICS
    • G10MUSICAL INSTRUMENTS; ACOUSTICS
    • G10LSPEECH ANALYSIS TECHNIQUES OR SPEECH SYNTHESIS; SPEECH RECOGNITION; SPEECH OR VOICE PROCESSING TECHNIQUES; SPEECH OR AUDIO CODING OR DECODING
    • G10L15/00Speech recognition
    • G10L15/20Speech recognition techniques specially adapted for robustness in adverse environments, e.g. in noise, of stress induced speech
    • GPHYSICS
    • G10MUSICAL INSTRUMENTS; ACOUSTICS
    • G10LSPEECH ANALYSIS TECHNIQUES OR SPEECH SYNTHESIS; SPEECH RECOGNITION; SPEECH OR VOICE PROCESSING TECHNIQUES; SPEECH OR AUDIO CODING OR DECODING
    • G10L15/00Speech recognition
    • G10L15/26Speech to text systems
    • GPHYSICS
    • G10MUSICAL INSTRUMENTS; ACOUSTICS
    • G10LSPEECH ANALYSIS TECHNIQUES OR SPEECH SYNTHESIS; SPEECH RECOGNITION; SPEECH OR VOICE PROCESSING TECHNIQUES; SPEECH OR AUDIO CODING OR DECODING
    • G10L15/00Speech recognition
    • G10L15/28Constructional details of speech recognition systems

Landscapes

  • Engineering & Computer Science (AREA)
  • Health & Medical Sciences (AREA)
  • Physics & Mathematics (AREA)
  • Human Computer Interaction (AREA)
  • Multimedia (AREA)
  • Computational Linguistics (AREA)
  • Theoretical Computer Science (AREA)
  • Oral & Maxillofacial Surgery (AREA)
  • General Health & Medical Sciences (AREA)
  • Audiology, Speech & Language Pathology (AREA)
  • General Physics & Mathematics (AREA)
  • Acoustics & Sound (AREA)
  • Computer Vision & Pattern Recognition (AREA)
  • Biophysics (AREA)
  • Data Mining & Analysis (AREA)
  • Computing Systems (AREA)
  • Mathematical Physics (AREA)
  • Software Systems (AREA)
  • Molecular Biology (AREA)
  • Evolutionary Computation (AREA)
  • General Engineering & Computer Science (AREA)
  • Biomedical Technology (AREA)
  • Artificial Intelligence (AREA)
  • Life Sciences & Earth Sciences (AREA)
  • Robotics (AREA)
  • Manipulator (AREA)
  • Toys (AREA)
  • Image Analysis (AREA)
JP2002060425A 2002-03-06 2002-03-06 学習装置及び学習方法並びにロボット装置 Expired - Fee Related JP3529049B2 (ja)

Priority Applications (7)

Application Number Priority Date Filing Date Title
JP2002060425A JP3529049B2 (ja) 2002-03-06 2002-03-06 学習装置及び学習方法並びにロボット装置
CNB038002256A CN1241168C (zh) 2002-03-06 2003-03-05 识别装置和识别方法,以及机器人设备
DE60318990T DE60318990T2 (de) 2002-03-06 2003-03-05 Lernvorrichtung, lernverfahren und robotervorrichtung
KR1020037014405A KR100988708B1 (ko) 2002-03-06 2003-03-05 학습 장치, 학습 방법 및 로봇 장치
PCT/JP2003/002560 WO2003075261A1 (en) 2002-03-06 2003-03-05 Learning apparatus, learning method, and robot apparatus
US10/476,662 US7720775B2 (en) 2002-03-06 2003-03-05 Learning equipment and learning method, and robot apparatus
EP03710242A EP1482480B1 (en) 2002-03-06 2003-03-05 Learning apparatus, learning method, and robot apparatus

Applications Claiming Priority (1)

Application Number Priority Date Filing Date Title
JP2002060425A JP3529049B2 (ja) 2002-03-06 2002-03-06 学習装置及び学習方法並びにロボット装置

Publications (3)

Publication Number Publication Date
JP2003255989A JP2003255989A (ja) 2003-09-10
JP3529049B2 true JP3529049B2 (ja) 2004-05-24
JP2003255989A5 JP2003255989A5 (enExample) 2004-09-30

Family

ID=27784796

Family Applications (1)

Application Number Title Priority Date Filing Date
JP2002060425A Expired - Fee Related JP3529049B2 (ja) 2002-03-06 2002-03-06 学習装置及び学習方法並びにロボット装置

Country Status (7)

Country Link
US (1) US7720775B2 (enExample)
EP (1) EP1482480B1 (enExample)
JP (1) JP3529049B2 (enExample)
KR (1) KR100988708B1 (enExample)
CN (1) CN1241168C (enExample)
DE (1) DE60318990T2 (enExample)
WO (1) WO2003075261A1 (enExample)

Cited By (2)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US7152050B2 (en) 2003-02-19 2006-12-19 Sony Corporation Learning system capable of performing additional learning and robot apparatus
WO2008018136A1 (en) * 2006-08-10 2008-02-14 Pioneer Corporation Speaker recognizing device, speaker recognizing method, etc.

Families Citing this family (58)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
JP3919726B2 (ja) * 2003-10-02 2007-05-30 株式会社東芝 学習装置及びその方法
JP4303602B2 (ja) * 2004-01-09 2009-07-29 本田技研工業株式会社 顔面像取得システム
GB0407260D0 (en) * 2004-03-31 2004-05-05 Ibm Accelerated solution of constraint satisfaction problems by partioning of the variable space
JP4569186B2 (ja) * 2004-06-15 2010-10-27 ソニー株式会社 画像処理装置および方法、記録媒体、並びにプログラム
JP4086024B2 (ja) * 2004-09-14 2008-05-14 ソニー株式会社 ロボット装置及びその行動制御方法
CN100452710C (zh) * 2004-09-29 2009-01-14 上海赢思软件技术有限公司 一种短信机器人系统
JP4204541B2 (ja) 2004-12-24 2009-01-07 株式会社東芝 対話型ロボット、対話型ロボットの音声認識方法および対話型ロボットの音声認識プログラム
EP2138958A1 (en) * 2008-06-27 2009-12-30 Honda Research Institute Europe GmbH Sensor signal processing with feature classifier cooperation
JP2010055375A (ja) * 2008-08-28 2010-03-11 Toshiba Corp 電子機器操作指示装置およびその操作方法
KR20120027253A (ko) * 2009-04-23 2012-03-21 코닌클리케 필립스 일렉트로닉스 엔.브이. 물체-학습 로봇 및 방법
US8566097B2 (en) 2009-06-02 2013-10-22 Honda Motor Co., Ltd. Lexical acquisition apparatus, multi dialogue behavior system, and lexical acquisition program
JP2011115898A (ja) * 2009-12-03 2011-06-16 Honda Motor Co Ltd ロボット
US8775341B1 (en) 2010-10-26 2014-07-08 Michael Lamport Commons Intelligent control with hierarchical stacked neural networks
US9015093B1 (en) 2010-10-26 2015-04-21 Michael Lamport Commons Intelligent control with hierarchical stacked neural networks
US8452451B1 (en) * 2011-05-06 2013-05-28 Google Inc. Methods and systems for robotic command language
US9566710B2 (en) 2011-06-02 2017-02-14 Brain Corporation Apparatus and methods for operating robotic devices using selective state space training
JP5698614B2 (ja) * 2011-06-22 2015-04-08 インターナショナル・ビジネス・マシーンズ・コーポレーションInternational Business Machines Corporation コンテキスト情報処理システム及び方法
US8965580B2 (en) 2012-06-21 2015-02-24 Rethink Robotics, Inc. Training and operating industrial robots
EP2689650B1 (en) * 2012-07-27 2014-09-10 Honda Research Institute Europe GmbH Trainable autonomous lawn mower
US9764468B2 (en) 2013-03-15 2017-09-19 Brain Corporation Adaptive predictor apparatus and methods
US9242372B2 (en) 2013-05-31 2016-01-26 Brain Corporation Adaptive robotic interface apparatus and methods
US9314924B1 (en) 2013-06-14 2016-04-19 Brain Corporation Predictive robotic controller apparatus and methods
US9792546B2 (en) 2013-06-14 2017-10-17 Brain Corporation Hierarchical robotic controller apparatus and methods
US9384443B2 (en) 2013-06-14 2016-07-05 Brain Corporation Robotic training apparatus and methods
US9436909B2 (en) 2013-06-19 2016-09-06 Brain Corporation Increased dynamic range artificial neuron network apparatus and methods
US20150032258A1 (en) * 2013-07-29 2015-01-29 Brain Corporation Apparatus and methods for controlling of robotic devices
EP3043348B1 (en) * 2013-09-03 2017-10-04 Panasonic Intellectual Property Corporation of America Voice interaction control method
US9296101B2 (en) 2013-09-27 2016-03-29 Brain Corporation Robotic control arbitration apparatus and methods
US9579789B2 (en) 2013-09-27 2017-02-28 Brain Corporation Apparatus and methods for training of robotic control arbitration
US9597797B2 (en) 2013-11-01 2017-03-21 Brain Corporation Apparatus and methods for haptic training of robots
US9463571B2 (en) 2013-11-01 2016-10-11 Brian Corporation Apparatus and methods for online training of robots
US9248569B2 (en) 2013-11-22 2016-02-02 Brain Corporation Discrepancy detection apparatus and methods for machine learning
US9358685B2 (en) 2014-02-03 2016-06-07 Brain Corporation Apparatus and methods for control of robot actions based on corrective user inputs
US9346167B2 (en) 2014-04-29 2016-05-24 Brain Corporation Trainable convolutional network apparatus and methods for operating a robotic vehicle
US9630318B2 (en) 2014-10-02 2017-04-25 Brain Corporation Feature detection apparatus and methods for training of robotic navigation
US9881349B1 (en) 2014-10-24 2018-01-30 Gopro, Inc. Apparatus and methods for computerized object identification
US9717387B1 (en) 2015-02-26 2017-08-01 Brain Corporation Apparatus and methods for programming and training of robotic household appliances
JP6084654B2 (ja) * 2015-06-04 2017-02-22 シャープ株式会社 音声認識装置、音声認識システム、当該音声認識システムで使用される端末、および、話者識別モデルを生成するための方法
EP3332923A4 (en) * 2015-08-04 2019-04-10 Beijing Evolver Robotics Co., Ltd MULTIFUNCTIONAL HOUSE ROBOT
JP6681800B2 (ja) * 2016-07-15 2020-04-15 株式会社日立製作所 制御装置、制御システム、および制御方法
JP6785950B2 (ja) * 2016-08-25 2020-11-18 エルジー エレクトロニクス インコーポレイティド 移動ロボット及びその制御方法
US11096848B2 (en) 2016-09-12 2021-08-24 Fuji Corporation Assistance device for identifying a user of the assistance device from a spoken name
US10430657B2 (en) 2016-12-12 2019-10-01 X Development Llc Object recognition tool
KR20180082033A (ko) * 2017-01-09 2018-07-18 삼성전자주식회사 음성을 인식하는 전자 장치
WO2018230345A1 (ja) * 2017-06-15 2018-12-20 株式会社Caiメディア 対話ロボットおよび対話システム、並びに対話プログラム
KR102433393B1 (ko) * 2017-12-12 2022-08-17 한국전자통신연구원 동영상 콘텐츠 내의 인물을 인식하는 장치 및 방법
US10593318B2 (en) * 2017-12-26 2020-03-17 International Business Machines Corporation Initiating synthesized speech outpout from a voice-controlled device
CN108172226A (zh) * 2018-01-27 2018-06-15 上海萌王智能科技有限公司 一种可学习应答语音和动作的语音控制机器人
US11126257B2 (en) * 2018-04-17 2021-09-21 Toyota Research Institute, Inc. System and method for detecting human gaze and gesture in unconstrained environments
DE102018207513A1 (de) * 2018-05-15 2019-11-21 Siemens Aktiengesellschaft Verfahren zum rechnergestützten Lernen eines Roboters über einen Sprachdialog
WO2020056377A1 (en) 2018-09-13 2020-03-19 The Charles Stark Draper Laboratory, Inc. One-click robot order
KR102833767B1 (ko) 2019-02-12 2025-07-15 삼성전자주식회사 객체를 모니터링하는 방법 및 이를 지원하는 전자 장치
WO2021066801A1 (en) * 2019-09-30 2021-04-08 Siemens Aktiengesellschaft Robotics control system and method for training said robotics control system
JP6921448B1 (ja) * 2020-05-20 2021-08-18 株式会社ルークシステム 新規物体操作ロボットの制御プログラムおよび制御方法、ならびに、新規物体操作システム
US20240086509A1 (en) * 2021-01-19 2024-03-14 Sony Group Corporation Information processing device, information processing method, and information processing program
JP7664548B2 (ja) * 2021-03-01 2025-04-18 パナソニックIpマネジメント株式会社 発話分類装置および発話分類方法
US20240256971A1 (en) 2021-06-04 2024-08-01 Sony Group Corporation Training apparatus, training method, and training program
WO2023146118A1 (ko) * 2022-01-25 2023-08-03 삼성전자 주식회사 Hci를 통해 태그를 획득하고 물체에 대한 명령을 수행하는 방법 및 전자 장치

Citations (5)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
JP2001228891A (ja) 2000-02-16 2001-08-24 Mitsubishi Electric Corp 音声対話装置
JP2001300148A (ja) 2000-04-18 2001-10-30 Casio Comput Co Ltd アクション応答システムおよびそのプログラム記録媒体
JP2002202795A (ja) 2000-12-28 2002-07-19 Kenzo Iwama ロボット、単語学習装置およびその方法
JP2002219677A (ja) 2000-10-13 2002-08-06 Sony Corp ロボット装置及びロボット装置の行動制御方法
JP2003186494A (ja) 2001-12-17 2003-07-04 Sony Corp 音声認識装置および方法、記録媒体、並びにプログラム

Family Cites Families (6)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US6118888A (en) * 1997-02-28 2000-09-12 Kabushiki Kaisha Toshiba Multi-modal interface apparatus and method
JP3211186B2 (ja) * 1997-12-15 2001-09-25 オムロン株式会社 ロボット、ロボットシステム、ロボットの学習方法、ロボットシステムの学習方法および記録媒体
JP4366617B2 (ja) * 1999-01-25 2009-11-18 ソニー株式会社 ロボット装置
JP2002160185A (ja) * 2000-03-31 2002-06-04 Sony Corp ロボット装置、ロボット装置の行動制御方法、外力検出装置及び外力検出方法
JP4143305B2 (ja) * 2001-01-30 2008-09-03 日本電気株式会社 ロボット装置、照合環境判定方法、及び照合環境判定プログラム
JP4108342B2 (ja) * 2001-01-30 2008-06-25 日本電気株式会社 ロボット、ロボット制御システム、およびそのプログラム

Patent Citations (5)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
JP2001228891A (ja) 2000-02-16 2001-08-24 Mitsubishi Electric Corp 音声対話装置
JP2001300148A (ja) 2000-04-18 2001-10-30 Casio Comput Co Ltd アクション応答システムおよびそのプログラム記録媒体
JP2002219677A (ja) 2000-10-13 2002-08-06 Sony Corp ロボット装置及びロボット装置の行動制御方法
JP2002202795A (ja) 2000-12-28 2002-07-19 Kenzo Iwama ロボット、単語学習装置およびその方法
JP2003186494A (ja) 2001-12-17 2003-07-04 Sony Corp 音声認識装置および方法、記録媒体、並びにプログラム

Non-Patent Citations (3)

* Cited by examiner, † Cited by third party
Title
Deb Roy,Integration of speech and vision using mutual information,Proceedings of the 2000 IEEE International Conference on Acoustics, Speech, and Signal Processing,米国,2000年 6月 5日,Vol.4,Pages 2369−2372
下村, 青山, 藤田,自立型エンタテイメントロボットと音声対話,人工知能学会第36回言語・音声理解と対話処理研究会資料,日本,2002年11月 7日,Pages 21−26
金, 岩橋,知覚情報の統合に基づく言語音声単位の獲得アルゴリズム,電子情報通信学会技術研究報告[思考と言語],日本,2000年10月13日,TL2000−21,Pages 9−16

Cited By (2)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US7152050B2 (en) 2003-02-19 2006-12-19 Sony Corporation Learning system capable of performing additional learning and robot apparatus
WO2008018136A1 (en) * 2006-08-10 2008-02-14 Pioneer Corporation Speaker recognizing device, speaker recognizing method, etc.

Also Published As

Publication number Publication date
WO2003075261A1 (en) 2003-09-12
DE60318990T2 (de) 2009-02-05
KR20040094289A (ko) 2004-11-09
US7720775B2 (en) 2010-05-18
EP1482480A4 (en) 2005-12-14
JP2003255989A (ja) 2003-09-10
DE60318990D1 (de) 2008-03-20
EP1482480A1 (en) 2004-12-01
KR100988708B1 (ko) 2010-10-18
CN1507617A (zh) 2004-06-23
EP1482480B1 (en) 2008-02-06
CN1241168C (zh) 2006-02-08
US20050004710A1 (en) 2005-01-06

Similar Documents

Publication Publication Date Title
JP3529049B2 (ja) 学習装置及び学習方法並びにロボット装置
Tatulli et al. Feature extraction using multimodal convolutional neural networks for visual speech recognition
Li et al. Robust automatic speech recognition: a bridge to practical applications
Abdel-Hamid et al. Convolutional neural networks for speech recognition
CN112331183B (zh) 基于自回归网络的非平行语料语音转换方法及系统
Wu et al. A novel lip descriptor for audio-visual keyword spotting based on adaptive decision fusion
CN113823272B (zh) 语音处理方法、装置、电子设备以及存储介质
CN112216307B (zh) 语音情感识别方法以及装置
CN107972028A (zh) 人机交互方法、装置及电子设备
CN110751260A (zh) 电子设备、任务处理的方法以及训练神经网络的方法
Cheng et al. Visual speaker authentication with random prompt texts by a dual-task CNN framework
Liu et al. Audio-visual keyword spotting based on adaptive decision fusion under noisy conditions for human-robot interaction
CN116312512A (zh) 面向多人场景的视听融合唤醒词识别方法及装置
JP2022126962A (ja) 発話内容認識装置、学習データ収集システム、方法及びプログラム
Amami et al. A robust voice pathology detection system based on the combined bilstm–cnn architecture
Vimala et al. Isolated speech recognition system for Tamil language using statistical pattern matching and machine learning techniques
CN102141812A (zh) 机器人
CN120766652A (zh) 一种多模态融合驱动下情感感知增强的tts语音合成方法
Ktistakis et al. A multimodal human-machine interaction scheme for an intelligent robotic nurse
Rashmi et al. Optimization of Convolutional Neural Network Architectures for High-Accuracy Spoken Digit Classification Using Mel-Frequency Cepstral Coefficients.
Kasabov et al. Incremental learning in autonomous systems: evolving connectionist systems for on-line image and speech recognition
Jadczyk Audio-visual speech processing system for Polish applicable to human-computer interaction
JPH11122114A (ja) コードブック作成装置およびコードブック作成方法、並びにベクトル量子化装置およびベクトル量子化方法
Luo et al. Research and application of voiceprint recognition based on a deep recurrent neural network
Rigoll Information theory principles for the design of self-organizing maps in combination with hidden Markov modeling for continuous speech recognition

Legal Events

Date Code Title Description
TRDD Decision of grant or rejection written
A01 Written decision to grant a patent or to grant a registration (utility model)

Free format text: JAPANESE INTERMEDIATE CODE: A01

Effective date: 20040206

A61 First payment of annual fees (during grant procedure)

Free format text: JAPANESE INTERMEDIATE CODE: A61

Effective date: 20040219

R151 Written notification of patent or utility model registration

Ref document number: 3529049

Country of ref document: JP

Free format text: JAPANESE INTERMEDIATE CODE: R151

FPAY Renewal fee payment (event date is renewal date of database)

Free format text: PAYMENT UNTIL: 20080305

Year of fee payment: 4

FPAY Renewal fee payment (event date is renewal date of database)

Free format text: PAYMENT UNTIL: 20090305

Year of fee payment: 5

FPAY Renewal fee payment (event date is renewal date of database)

Free format text: PAYMENT UNTIL: 20100305

Year of fee payment: 6

FPAY Renewal fee payment (event date is renewal date of database)

Free format text: PAYMENT UNTIL: 20100305

Year of fee payment: 6

FPAY Renewal fee payment (event date is renewal date of database)

Free format text: PAYMENT UNTIL: 20110305

Year of fee payment: 7

FPAY Renewal fee payment (event date is renewal date of database)

Free format text: PAYMENT UNTIL: 20120305

Year of fee payment: 8

R250 Receipt of annual fees

Free format text: JAPANESE INTERMEDIATE CODE: R250

FPAY Renewal fee payment (event date is renewal date of database)

Free format text: PAYMENT UNTIL: 20120305

Year of fee payment: 8

FPAY Renewal fee payment (event date is renewal date of database)

Free format text: PAYMENT UNTIL: 20130305

Year of fee payment: 9

R250 Receipt of annual fees

Free format text: JAPANESE INTERMEDIATE CODE: R250

FPAY Renewal fee payment (event date is renewal date of database)

Free format text: PAYMENT UNTIL: 20130305

Year of fee payment: 9

FPAY Renewal fee payment (event date is renewal date of database)

Free format text: PAYMENT UNTIL: 20140305

Year of fee payment: 10

R250 Receipt of annual fees

Free format text: JAPANESE INTERMEDIATE CODE: R250

R250 Receipt of annual fees

Free format text: JAPANESE INTERMEDIATE CODE: R250

R250 Receipt of annual fees

Free format text: JAPANESE INTERMEDIATE CODE: R250

R250 Receipt of annual fees

Free format text: JAPANESE INTERMEDIATE CODE: R250

R250 Receipt of annual fees

Free format text: JAPANESE INTERMEDIATE CODE: R250

R250 Receipt of annual fees

Free format text: JAPANESE INTERMEDIATE CODE: R250

R250 Receipt of annual fees

Free format text: JAPANESE INTERMEDIATE CODE: R250

R250 Receipt of annual fees

Free format text: JAPANESE INTERMEDIATE CODE: R250

LAPS Cancellation because of no payment of annual fees