JP2014532448A - 音声特性を用いて上気道を特徴づけるシステム及び方法 - Google Patents

音声特性を用いて上気道を特徴づけるシステム及び方法 Download PDF

Info

Publication number
JP2014532448A
JP2014532448A JP2014536371A JP2014536371A JP2014532448A JP 2014532448 A JP2014532448 A JP 2014532448A JP 2014536371 A JP2014536371 A JP 2014536371A JP 2014536371 A JP2014536371 A JP 2014536371A JP 2014532448 A JP2014532448 A JP 2014532448A
Authority
JP
Japan
Prior art keywords
patient
upper airway
utterance
recorded
anatomical parameter
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Pending
Application number
JP2014536371A
Other languages
English (en)
Japanese (ja)
Other versions
JP2014532448A5 (https=
Inventor
ワール スタイン デ
ワール スタイン デ
ステファン ウィンテル
ステファン ウィンテル
アレクサンデル コーネリス ヘーリングス
アレクサンデル コーネリス ヘーリングス
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
Koninklijke Philips NV
Original Assignee
Koninklijke Philips NV
Koninklijke Philips Electronics NV
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Koninklijke Philips NV, Koninklijke Philips Electronics NV filed Critical Koninklijke Philips NV
Publication of JP2014532448A publication Critical patent/JP2014532448A/ja
Publication of JP2014532448A5 publication Critical patent/JP2014532448A5/ja
Pending legal-status Critical Current

Links

Images

Classifications

    • G—PHYSICS
    • G16—INFORMATION AND COMMUNICATION TECHNOLOGY [ICT] SPECIALLY ADAPTED FOR SPECIFIC APPLICATION FIELDS
    • G16Z—INFORMATION AND COMMUNICATION TECHNOLOGY [ICT] SPECIALLY ADAPTED FOR SPECIFIC APPLICATION FIELDS, NOT OTHERWISE PROVIDED FOR
    • G16Z99/00—Subject matter not provided for in other main groups of this subclass
    • A—HUMAN NECESSITIES
    • A61—MEDICAL OR VETERINARY SCIENCE; HYGIENE
    • A61B—DIAGNOSIS; SURGERY; IDENTIFICATION
    • A61B7/00—Instruments for auscultation
    • A61B7/003—Detecting lung or respiration noise
    • A—HUMAN NECESSITIES
    • A61—MEDICAL OR VETERINARY SCIENCE; HYGIENE
    • A61B—DIAGNOSIS; SURGERY; IDENTIFICATION
    • A61B5/00—Measuring for diagnostic purposes; Identification of persons
    • A61B5/08—Measuring devices for evaluating the respiratory organs
    • A61B5/0826—Detecting or evaluating apnoea events
    • A—HUMAN NECESSITIES
    • A61—MEDICAL OR VETERINARY SCIENCE; HYGIENE
    • A61B—DIAGNOSIS; SURGERY; IDENTIFICATION
    • A61B5/00—Measuring for diagnostic purposes; Identification of persons
    • A61B5/103—Measuring devices for testing the shape, pattern, colour, size or movement of the body or parts thereof, for diagnostic purposes
    • A61B5/107—Measuring physical dimensions, e.g. size of the entire body or parts thereof
    • A61B5/1075—Measuring physical dimensions, e.g. size of the entire body or parts thereof for measuring dimensions by non-invasive methods, e.g. for determining thickness of tissue layer
    • A—HUMAN NECESSITIES
    • A61—MEDICAL OR VETERINARY SCIENCE; HYGIENE
    • A61B—DIAGNOSIS; SURGERY; IDENTIFICATION
    • A61B5/00—Measuring for diagnostic purposes; Identification of persons
    • A61B5/48—Other medical applications
    • A61B5/4803—Speech analysis specially adapted for diagnostic purposes
    • A—HUMAN NECESSITIES
    • A61—MEDICAL OR VETERINARY SCIENCE; HYGIENE
    • A61B—DIAGNOSIS; SURGERY; IDENTIFICATION
    • A61B5/00—Measuring for diagnostic purposes; Identification of persons
    • A61B5/48—Other medical applications
    • A61B5/4806—Sleep evaluation
    • A61B5/4818—Sleep apnoea
    • A—HUMAN NECESSITIES
    • A61—MEDICAL OR VETERINARY SCIENCE; HYGIENE
    • A61B—DIAGNOSIS; SURGERY; IDENTIFICATION
    • A61B5/00—Measuring for diagnostic purposes; Identification of persons
    • A61B5/48—Other medical applications
    • A61B5/4836—Diagnosis combined with treatment in closed-loop systems or methods
    • A61B5/4839—Diagnosis combined with treatment in closed-loop systems or methods combined with drug delivery
    • A—HUMAN NECESSITIES
    • A61—MEDICAL OR VETERINARY SCIENCE; HYGIENE
    • A61B—DIAGNOSIS; SURGERY; IDENTIFICATION
    • A61B5/00—Measuring for diagnostic purposes; Identification of persons
    • A61B5/48—Other medical applications
    • A61B5/486—Biofeedback
    • A—HUMAN NECESSITIES
    • A61—MEDICAL OR VETERINARY SCIENCE; HYGIENE
    • A61B—DIAGNOSIS; SURGERY; IDENTIFICATION
    • A61B5/00—Measuring for diagnostic purposes; Identification of persons
    • A61B5/70—Means for positioning the patient in relation to the detecting, measuring or recording means
    • A—HUMAN NECESSITIES
    • A61—MEDICAL OR VETERINARY SCIENCE; HYGIENE
    • A61B—DIAGNOSIS; SURGERY; IDENTIFICATION
    • A61B5/00—Measuring for diagnostic purposes; Identification of persons
    • A61B5/72—Signal processing specially adapted for physiological signals or for diagnostic purposes
    • A61B5/7271—Specific aspects of physiological measurement analysis
    • A61B5/7282—Event detection, e.g. detecting unique waveforms indicative of a medical condition
    • A—HUMAN NECESSITIES
    • A61—MEDICAL OR VETERINARY SCIENCE; HYGIENE
    • A61B—DIAGNOSIS; SURGERY; IDENTIFICATION
    • A61B5/00—Measuring for diagnostic purposes; Identification of persons
    • A61B5/74—Details of notification to user or communication with user or patient; User input means
    • A61B5/7475—User input or interface means, e.g. keyboard, pointing device, joystick
    • A61B5/749—Voice-controlled interfaces
    • A—HUMAN NECESSITIES
    • A61—MEDICAL OR VETERINARY SCIENCE; HYGIENE
    • A61B—DIAGNOSIS; SURGERY; IDENTIFICATION
    • A61B7/00—Instruments for auscultation
    • A61B7/02—Stethoscopes
    • A61B7/04—Electric stethoscopes
    • A—HUMAN NECESSITIES
    • A61—MEDICAL OR VETERINARY SCIENCE; HYGIENE
    • A61B—DIAGNOSIS; SURGERY; IDENTIFICATION
    • A61B2562/00—Details of sensors; Constructional details of sensor housings or probes; Accessories for sensors
    • A61B2562/02—Details of sensors specially adapted for in-vivo measurements
    • A61B2562/0204—Acoustic sensors
    • A—HUMAN NECESSITIES
    • A61—MEDICAL OR VETERINARY SCIENCE; HYGIENE
    • A61B—DIAGNOSIS; SURGERY; IDENTIFICATION
    • A61B5/00—Measuring for diagnostic purposes; Identification of persons
    • A61B5/72—Signal processing specially adapted for physiological signals or for diagnostic purposes
    • A61B5/7235—Details of waveform analysis
    • A61B5/7264—Classification of physiological signals or data, e.g. using neural networks, statistical classifiers, expert systems or fuzzy systems
    • A61B5/7267—Classification of physiological signals or data, e.g. using neural networks, statistical classifiers, expert systems or fuzzy systems involving training the classification device
    • A—HUMAN NECESSITIES
    • A61—MEDICAL OR VETERINARY SCIENCE; HYGIENE
    • A61M—DEVICES FOR INTRODUCING MEDIA INTO, OR ONTO, THE BODY; DEVICES FOR TRANSDUCING BODY MEDIA OR FOR TAKING MEDIA FROM THE BODY; DEVICES FOR PRODUCING OR ENDING SLEEP OR STUPOR
    • A61M15/00—Inhalators
    • G—PHYSICS
    • G10—MUSICAL INSTRUMENTS; ACOUSTICS
    • G10L—SPEECH ANALYSIS TECHNIQUES OR SPEECH SYNTHESIS; SPEECH RECOGNITION; SPEECH OR VOICE PROCESSING TECHNIQUES; SPEECH OR AUDIO CODING OR DECODING
    • G10L25/00—Speech or voice analysis techniques not restricted to a single one of groups G10L15/00 - G10L21/00
    • G10L25/48—Speech or voice analysis techniques not restricted to a single one of groups G10L15/00 - G10L21/00 specially adapted for particular use
    • G10L25/51—Speech or voice analysis techniques not restricted to a single one of groups G10L15/00 - G10L21/00 specially adapted for particular use for comparison or discrimination
    • G10L25/66—Speech or voice analysis techniques not restricted to a single one of groups G10L15/00 - G10L21/00 specially adapted for particular use for comparison or discrimination for extracting parameters related to health condition
    • G—PHYSICS
    • G10—MUSICAL INSTRUMENTS; ACOUSTICS
    • G10L—SPEECH ANALYSIS TECHNIQUES OR SPEECH SYNTHESIS; SPEECH RECOGNITION; SPEECH OR VOICE PROCESSING TECHNIQUES; SPEECH OR AUDIO CODING OR DECODING
    • G10L25/00—Speech or voice analysis techniques not restricted to a single one of groups G10L15/00 - G10L21/00
    • G10L25/75—Speech or voice analysis techniques not restricted to a single one of groups G10L15/00 - G10L21/00 for modelling vocal tract parameters

Landscapes

  • Health & Medical Sciences (AREA)
  • Life Sciences & Earth Sciences (AREA)
  • Engineering & Computer Science (AREA)
  • Surgery (AREA)
  • General Health & Medical Sciences (AREA)
  • Veterinary Medicine (AREA)
  • Physics & Mathematics (AREA)
  • Public Health (AREA)
  • Animal Behavior & Ethology (AREA)
  • Molecular Biology (AREA)
  • Biomedical Technology (AREA)
  • Heart & Thoracic Surgery (AREA)
  • Medical Informatics (AREA)
  • Biophysics (AREA)
  • Pathology (AREA)
  • Physiology (AREA)
  • Pulmonology (AREA)
  • Acoustics & Sound (AREA)
  • Chemical & Material Sciences (AREA)
  • Medicinal Chemistry (AREA)
  • Bioinformatics & Cheminformatics (AREA)
  • Pharmacology & Pharmacy (AREA)
  • Oral & Maxillofacial Surgery (AREA)
  • Dentistry (AREA)
  • Audiology, Speech & Language Pathology (AREA)
  • Artificial Intelligence (AREA)
  • Computer Vision & Pattern Recognition (AREA)
  • Psychiatry (AREA)
  • Signal Processing (AREA)
  • Biodiversity & Conservation Biology (AREA)
  • Measurement Of The Respiration, Hearing Ability, Form, And Blood Characteristics Of Living Organisms (AREA)
JP2014536371A 2011-10-20 2012-10-11 音声特性を用いて上気道を特徴づけるシステム及び方法 Pending JP2014532448A (ja)

Applications Claiming Priority (3)

Application Number Priority Date Filing Date Title
US201161549315P 2011-10-20 2011-10-20
US61/549,315 2011-10-20
PCT/IB2012/055501 WO2013057637A1 (en) 2011-10-20 2012-10-11 A system and method for characterizing an upper airway using speech characteristics

Publications (2)

Publication Number Publication Date
JP2014532448A true JP2014532448A (ja) 2014-12-08
JP2014532448A5 JP2014532448A5 (https=) 2015-11-12

Family

ID=47324215

Family Applications (1)

Application Number Title Priority Date Filing Date
JP2014536371A Pending JP2014532448A (ja) 2011-10-20 2012-10-11 音声特性を用いて上気道を特徴づけるシステム及び方法

Country Status (9)

Country Link
US (1) US10182787B2 (https=)
EP (1) EP2744408B1 (https=)
JP (1) JP2014532448A (https=)
CN (1) CN103889324B (https=)
BR (1) BR112014009233A8 (https=)
IN (1) IN2014CN02660A (https=)
MX (1) MX352472B (https=)
RU (1) RU2623129C2 (https=)
WO (1) WO2013057637A1 (https=)

Cited By (1)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
JP2023531464A (ja) * 2020-06-18 2023-07-24 ユニバーシティ オブ マニトバ 身体計測情報と気管呼吸音を使用して覚醒時に閉塞性睡眠時無呼吸をスクリーニングする方法とシステム

Families Citing this family (17)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
IN2014CN02660A (https=) 2011-10-20 2015-06-26 Koninkl Philips Nv
AP2014007651A0 (en) 2011-10-20 2014-05-31 Albert Vangura A hand-held tool for cutting laminated glass
WO2015161493A1 (en) * 2014-04-24 2015-10-29 Motorola Solutions, Inc. Method and apparatus for enhancing alveolar trill
CN104523236B (zh) * 2015-01-07 2016-08-24 厦门大学 一种抗干扰的喉振动发声测评装置
US11672472B2 (en) * 2016-07-10 2023-06-13 B.G. Negev Technologies And Applications Ltd., At Ben-Gurion University Methods and systems for estimation of obstructive sleep apnea severity in wake subjects by multiple speech analyses
US10475530B2 (en) 2016-11-10 2019-11-12 Sonde Health, Inc. System and method for activation and deactivation of cued health assessment
CN110831497A (zh) * 2017-05-05 2020-02-21 瑞思迈私人有限公司 呼吸障碍的筛查、诊断及监测
US11380351B2 (en) * 2018-09-20 2022-07-05 Samsung Electronics Co., Ltd. System and method for pulmonary condition monitoring and analysis
CN110013222A (zh) * 2019-04-03 2019-07-16 杭州电子科技大学 一种用于睡眠呼吸暂停检测的系统
EP3838137A1 (en) * 2019-12-19 2021-06-23 Koninklijke Philips N.V. Automated and objective symptom severity score
FR3108492A1 (fr) * 2020-03-29 2021-10-01 Ghislaine ALAJOUANINE Dispositif de capture, d’enregistrement et d’analyse des bruits respiratoires
US12023146B2 (en) 2020-10-08 2024-07-02 International Business Machines Corporation Multi-modal lung capacity measurement for respiratory illness prediction
CN113571088B (zh) * 2021-07-27 2023-10-03 上海交通大学医学院附属第九人民医院 一种基于深度学习声纹识别的困难气道评估方法及装置
US11596334B1 (en) 2022-04-28 2023-03-07 Gmeci, Llc Systems and methods for determining actor status according to behavioral phenomena
KR20250019691A (ko) * 2022-06-03 2025-02-10 필립모리스 프로덕츠 에스.에이. 전체 폐 내 에어로졸 선량측정 예측 방법
US11882237B1 (en) 2022-11-30 2024-01-23 Gmeci, Llc Apparatus and methods for monitoring human trustworthiness
CN116473521B (zh) * 2023-06-21 2023-08-18 四川大学华西医院 疑似环杓关节脱位声音频谱识别方法及系统

Citations (4)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
JP2008026357A (ja) * 2006-07-18 2008-02-07 Okayama Univ 音声の基本周波数検出方法及び声帯特性評価装置
JP2009045446A (ja) * 2007-07-20 2009-03-05 Canon Inc 吸入装置
JP2010238133A (ja) * 2009-03-31 2010-10-21 Namco Bandai Games Inc プログラム、情報記憶媒体、口形状制御方法及び口形状制御装置
US20110240015A1 (en) * 2008-12-23 2011-10-06 Koninklijke Philips Electronics N.V. Method and apparatus comprising stepped mouthpiece for aerosol drug delivery

Family Cites Families (20)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US5404871A (en) * 1991-03-05 1995-04-11 Aradigm Delivery of aerosol medications for inspiration
RU2126240C1 (ru) * 1994-02-03 1999-02-20 Республиканское научно-практическое объединение медико-социальной реабилитации детей и подростков с врожденной челюстно-лицевой патологией и тяжелыми нарушениями речи "Бонум" Способ восстановления рече- и голосообразовательной функции у детей с ринолалией
JP2986792B2 (ja) * 1998-03-16 1999-12-06 株式会社エイ・ティ・アール音声翻訳通信研究所 話者正規化処理装置及び音声認識装置
JP3413384B2 (ja) 2000-03-07 2003-06-03 株式会社国際電気通信基礎技術研究所 調音状態の推定表示方法およびそのためのコンピュータプログラムを記録したコンピュータ読取可能な記録媒体
US6726636B2 (en) * 2000-04-12 2004-04-27 Loran Technologies, Inc. Breathalyzer with voice recognition
US6666830B1 (en) 2000-08-17 2003-12-23 East River Ventures, Lp System and method for detecting the onset of an obstructive sleep apnea event
US6580944B1 (en) 2000-11-28 2003-06-17 The United States Of America As Represented By The Secretary Of The Navy Method and apparatus for diagnosing sleep breathing disorders while a patient in awake
US7160252B2 (en) 2003-01-10 2007-01-09 Medtronic, Inc. Method and apparatus for detecting respiratory disturbances
US20050197588A1 (en) * 2004-03-04 2005-09-08 Scott Freeberg Sleep disordered breathing alert system
US7640160B2 (en) * 2005-08-05 2009-12-29 Voicebox Technologies, Inc. Systems and methods for responding to natural language speech utterance
JP4812029B2 (ja) * 2007-03-16 2011-11-09 富士通株式会社 音声認識システム、および、音声認識プログラム
US7559903B2 (en) * 2007-03-28 2009-07-14 Tr Technologies Inc. Breathing sound analysis for detection of sleep apnea/popnea events
CA2585824A1 (en) 2007-03-29 2008-09-29 Telecommunications Research Laboratory Breathing sound analysis for detection of sleep apnea/hypopnea events
US20090285763A1 (en) * 2008-05-13 2009-11-19 Finlay Warren H Infant aerosol drug delivery systems and methods
US10695519B2 (en) 2009-04-02 2020-06-30 Breathe Technologies, Inc. Methods, systems and devices for non-invasive open ventilation with gas delivery nozzles within nasal pillows
US10387621B2 (en) * 2009-01-16 2019-08-20 Cerner Innovation, Inc. Matching of vibratory inhalers to patient vocal tract for optimization of particle dispersion
CN110975088B (zh) * 2009-02-11 2023-08-04 瑞思迈私人有限公司 呼吸治疗装置的声波检测
US8215302B2 (en) * 2009-09-22 2012-07-10 Kassatly L Samuel A Discontinuous positive airway pressure device and method of reducing sleep disordered breathing events
US9070357B1 (en) * 2011-05-11 2015-06-30 Brian K. Buchheit Using speech analysis to assess a speaker's physiological health
IN2014CN02660A (https=) 2011-10-20 2015-06-26 Koninkl Philips Nv

Patent Citations (4)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
JP2008026357A (ja) * 2006-07-18 2008-02-07 Okayama Univ 音声の基本周波数検出方法及び声帯特性評価装置
JP2009045446A (ja) * 2007-07-20 2009-03-05 Canon Inc 吸入装置
US20110240015A1 (en) * 2008-12-23 2011-10-06 Koninklijke Philips Electronics N.V. Method and apparatus comprising stepped mouthpiece for aerosol drug delivery
JP2010238133A (ja) * 2009-03-31 2010-10-21 Namco Bandai Games Inc プログラム、情報記憶媒体、口形状制御方法及び口形状制御装置

Cited By (2)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
JP2023531464A (ja) * 2020-06-18 2023-07-24 ユニバーシティ オブ マニトバ 身体計測情報と気管呼吸音を使用して覚醒時に閉塞性睡眠時無呼吸をスクリーニングする方法とシステム
JP7719107B2 (ja) 2020-06-18 2025-08-05 ユニバーシティ オブ マニトバ 身体計測情報と気管呼吸音を使用して覚醒時に閉塞性睡眠時無呼吸をスクリーニングする方法とシステム

Also Published As

Publication number Publication date
WO2013057637A1 (en) 2013-04-25
EP2744408B1 (en) 2022-02-16
RU2623129C2 (ru) 2017-06-22
BR112014009233A8 (pt) 2017-06-20
CN103889324B (zh) 2017-05-17
CN103889324A (zh) 2014-06-25
MX352472B (es) 2017-11-27
BR112014009233A2 (pt) 2017-06-13
IN2014CN02660A (https=) 2015-06-26
US20140276228A1 (en) 2014-09-18
MX2014004534A (es) 2014-07-28
US10182787B2 (en) 2019-01-22
EP2744408A1 (en) 2014-06-25
RU2014120177A (ru) 2015-11-27

Similar Documents

Publication Publication Date Title
CN103889324B (zh) 一种使用语音特性来表征上气道的系统和方法
US11207049B2 (en) System and method for characterizing an upper airway using speech characteristics
CN112822976B (zh) 通过语音分析估计肺容量
KR20180115599A (ko) 발화 개선을 위한 두경부 물리 특성 기반의 가이드 및 피드백 시스템
JP6568071B2 (ja) 上気道の分析のためのシステム及び当該システムの作動方法、患者インタフェース装置、並びに、呼吸圧サポートシステム
JP6898912B2 (ja) 上気道を解析するシステム及び方法、並びに呼吸圧支持システム
Lulich et al. Subglottal resonances of adult male and female native speakers of American English
US20230045078A1 (en) Systems and methods for audio processing and analysis of multi-dimensional statistical signature using machine learing algorithms
Werner et al. Inhalations in Speech: Acoustic and Physiological Characteristics.
Werner et al. Acoustics of breath noises in human speech: Descriptive and three-dimensional modeling approaches
Benavides et al. Using HMM to detect speakers with severe obstructive sleep apnoea syndrome
Robb et al. Acoustic comparison of vowel articulation in normal and reverse phonation
Salas Acoustic coupling in phonation and its effect on inverse filtering of oral airflow and neck surface acceleration
Patel et al. Vocal tract shape and acoustic adjustments of children during phonation into narrow flow-resistant tubes
Pang Effects of inhaled combination corticosteroid drugs on aerodynamic measures of phonation and visual-perceptual measures of vocal fold and arytenoid tissue in excised rabbit larynges
Campo The effect of vocal fold geometry on the fluid structure acoustic interactions in an experimental model of the human airway
Zajac Speech Aerometry
Blauer The effects and reversibility of combination inhaled corticosteroids on phonation threshold pressure (PTP) and phonation threshold flow (PTF) in ex vivo rabbit larynges
WO2025085500A1 (en) Calibrating a machine learning model trained to determine a location and shape of a sound source
Tseng et al. Effects of surgery on the relationship between subglottic pressure and fundamental frequency in vocal fold dynamics in patients with benign laryngeal diseases
Carmichael Instrumental assessment of respiratory and laryngeal function in patients with neurological disorders
Schickhofer Sound Generation and Propagation in the Human Upper Airways
Montero Benavides Statistical analysis of the connection between sleep apnea and speech
KR101532828B1 (ko) 음성정보를 이용하여 한증 및 열증을 판별하는 장치 및 방법
HK40051516B (zh) 通过语音分析估计肺容量

Legal Events

Date Code Title Description
A521 Request for written amendment filed

Free format text: JAPANESE INTERMEDIATE CODE: A523

Effective date: 20150925

A621 Written request for application examination

Free format text: JAPANESE INTERMEDIATE CODE: A621

Effective date: 20150925

A131 Notification of reasons for refusal

Free format text: JAPANESE INTERMEDIATE CODE: A131

Effective date: 20160809

A977 Report on retrieval

Free format text: JAPANESE INTERMEDIATE CODE: A971007

Effective date: 20160812

A521 Request for written amendment filed

Free format text: JAPANESE INTERMEDIATE CODE: A523

Effective date: 20161024

A131 Notification of reasons for refusal

Free format text: JAPANESE INTERMEDIATE CODE: A131

Effective date: 20161201

A521 Request for written amendment filed

Free format text: JAPANESE INTERMEDIATE CODE: A523

Effective date: 20170118

RD04 Notification of resignation of power of attorney

Free format text: JAPANESE INTERMEDIATE CODE: A7424

Effective date: 20170214

A02 Decision of refusal

Free format text: JAPANESE INTERMEDIATE CODE: A02

Effective date: 20170321

A601 Written request for extension of time

Free format text: JAPANESE INTERMEDIATE CODE: A601

Effective date: 20180725

A521 Request for written amendment filed

Free format text: JAPANESE INTERMEDIATE CODE: A523

Effective date: 20181102