JP6574529B2 - 音声通信システム及び方法 - Google Patents

音声通信システム及び方法 Download PDF

Info

Publication number
JP6574529B2
JP6574529B2 JP2018541467A JP2018541467A JP6574529B2 JP 6574529 B2 JP6574529 B2 JP 6574529B2 JP 2018541467 A JP2018541467 A JP 2018541467A JP 2018541467 A JP2018541467 A JP 2018541467A JP 6574529 B2 JP6574529 B2 JP 6574529B2
Authority
JP
Japan
Prior art keywords
audio
signal
signals
equation
sensor
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Active
Application number
JP2018541467A
Other languages
English (en)
Japanese (ja)
Other versions
JP2018538765A (ja
Inventor
シンシァォ ゾン
シンシァォ ゾン
イートン ファン
イートン ファン
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
Individual
Original Assignee
Individual
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Individual filed Critical Individual
Publication of JP2018538765A publication Critical patent/JP2018538765A/ja
Application granted granted Critical
Publication of JP6574529B2 publication Critical patent/JP6574529B2/ja
Active legal-status Critical Current
Anticipated expiration legal-status Critical

Links

Classifications

    • G—PHYSICS
    • G10—MUSICAL INSTRUMENTS; ACOUSTICS
    • G10L—SPEECH ANALYSIS OR SYNTHESIS; SPEECH RECOGNITION; SPEECH OR VOICE PROCESSING; SPEECH OR AUDIO CODING OR DECODING
    • G10L15/00—Speech recognition
    • G10L15/22—Procedures used during a speech recognition process, e.g. man-machine dialogue
    • G—PHYSICS
    • G10—MUSICAL INSTRUMENTS; ACOUSTICS
    • G10L—SPEECH ANALYSIS OR SYNTHESIS; SPEECH RECOGNITION; SPEECH OR VOICE PROCESSING; SPEECH OR AUDIO CODING OR DECODING
    • G10L21/00—Processing of the speech or voice signal to produce another audible or non-audible signal, e.g. visual or tactile, in order to modify its quality or its intelligibility
    • G10L21/02—Speech enhancement, e.g. noise reduction or echo cancellation
    • G10L21/0208—Noise filtering
    • G10L21/0216—Noise filtering characterised by the method used for estimating noise
    • G10L21/0232—Processing in the frequency domain
    • G—PHYSICS
    • G10—MUSICAL INSTRUMENTS; ACOUSTICS
    • G10L—SPEECH ANALYSIS OR SYNTHESIS; SPEECH RECOGNITION; SPEECH OR VOICE PROCESSING; SPEECH OR AUDIO CODING OR DECODING
    • G10L21/00—Processing of the speech or voice signal to produce another audible or non-audible signal, e.g. visual or tactile, in order to modify its quality or its intelligibility
    • G10L21/02—Speech enhancement, e.g. noise reduction or echo cancellation
    • G10L21/0208—Noise filtering
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04R—LOUDSPEAKERS, MICROPHONES, GRAMOPHONE PICK-UPS OR LIKE ACOUSTIC ELECTROMECHANICAL TRANSDUCERS; DEAF-AID SETS; PUBLIC ADDRESS SYSTEMS
    • H04R1/00—Details of transducers, loudspeakers or microphones
    • H04R1/20—Arrangements for obtaining desired frequency or directional characteristics
    • H04R1/32—Arrangements for obtaining desired frequency or directional characteristics for obtaining desired directional characteristic only
    • H04R1/40—Arrangements for obtaining desired frequency or directional characteristics for obtaining desired directional characteristic only by combining a number of identical transducers
    • H04R1/406—Arrangements for obtaining desired frequency or directional characteristics for obtaining desired directional characteristic only by combining a number of identical transducers microphones
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04R—LOUDSPEAKERS, MICROPHONES, GRAMOPHONE PICK-UPS OR LIKE ACOUSTIC ELECTROMECHANICAL TRANSDUCERS; DEAF-AID SETS; PUBLIC ADDRESS SYSTEMS
    • H04R3/00—Circuits for transducers, loudspeakers or microphones
    • H04R3/005—Circuits for transducers, loudspeakers or microphones for combining the signals of two or more microphones
    • G—PHYSICS
    • G10—MUSICAL INSTRUMENTS; ACOUSTICS
    • G10L—SPEECH ANALYSIS OR SYNTHESIS; SPEECH RECOGNITION; SPEECH OR VOICE PROCESSING; SPEECH OR AUDIO CODING OR DECODING
    • G10L15/00—Speech recognition
    • G10L15/08—Speech classification or search
    • G10L2015/088—Word spotting
    • G—PHYSICS
    • G10—MUSICAL INSTRUMENTS; ACOUSTICS
    • G10L—SPEECH ANALYSIS OR SYNTHESIS; SPEECH RECOGNITION; SPEECH OR VOICE PROCESSING; SPEECH OR AUDIO CODING OR DECODING
    • G10L15/00—Speech recognition
    • G10L15/22—Procedures used during a speech recognition process, e.g. man-machine dialogue
    • G10L2015/223—Execution procedure of a spoken command
    • G—PHYSICS
    • G10—MUSICAL INSTRUMENTS; ACOUSTICS
    • G10L—SPEECH ANALYSIS OR SYNTHESIS; SPEECH RECOGNITION; SPEECH OR VOICE PROCESSING; SPEECH OR AUDIO CODING OR DECODING
    • G10L21/00—Processing of the speech or voice signal to produce another audible or non-audible signal, e.g. visual or tactile, in order to modify its quality or its intelligibility
    • G10L21/02—Speech enhancement, e.g. noise reduction or echo cancellation
    • G10L21/0208—Noise filtering
    • G10L2021/02082—Noise filtering the noise being echo, reverberation of the speech
    • G—PHYSICS
    • G10—MUSICAL INSTRUMENTS; ACOUSTICS
    • G10L—SPEECH ANALYSIS OR SYNTHESIS; SPEECH RECOGNITION; SPEECH OR VOICE PROCESSING; SPEECH OR AUDIO CODING OR DECODING
    • G10L21/00—Processing of the speech or voice signal to produce another audible or non-audible signal, e.g. visual or tactile, in order to modify its quality or its intelligibility
    • G10L21/02—Speech enhancement, e.g. noise reduction or echo cancellation
    • G10L21/0208—Noise filtering
    • G10L21/0216—Noise filtering characterised by the method used for estimating noise
    • G10L2021/02161—Number of inputs available containing the signal or the noise to be suppressed
    • G10L2021/02166—Microphone arrays; Beamforming
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04R—LOUDSPEAKERS, MICROPHONES, GRAMOPHONE PICK-UPS OR LIKE ACOUSTIC ELECTROMECHANICAL TRANSDUCERS; DEAF-AID SETS; PUBLIC ADDRESS SYSTEMS
    • H04R1/00—Details of transducers, loudspeakers or microphones
    • H04R1/08—Mouthpieces; Microphones; Attachments therefor
    • H04R1/083—Special constructions of mouthpieces
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04R—LOUDSPEAKERS, MICROPHONES, GRAMOPHONE PICK-UPS OR LIKE ACOUSTIC ELECTROMECHANICAL TRANSDUCERS; DEAF-AID SETS; PUBLIC ADDRESS SYSTEMS
    • H04R2201/00—Details of transducers, loudspeakers or microphones covered by H04R1/00 but not provided for in any of its subgroups
    • H04R2201/02—Details casings, cabinets or mounting therein for transducers covered by H04R1/02 but not provided for in any of its subgroups
    • H04R2201/023—Transducers incorporated in garment, rucksacks or the like
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04R—LOUDSPEAKERS, MICROPHONES, GRAMOPHONE PICK-UPS OR LIKE ACOUSTIC ELECTROMECHANICAL TRANSDUCERS; DEAF-AID SETS; PUBLIC ADDRESS SYSTEMS
    • H04R2201/00—Details of transducers, loudspeakers or microphones covered by H04R1/00 but not provided for in any of its subgroups
    • H04R2201/40—Details of arrangements for obtaining desired directional characteristic by combining a number of identical transducers covered by H04R1/40 but not provided for in any of its subgroups
    • H04R2201/401—2D or 3D arrays of transducers
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04R—LOUDSPEAKERS, MICROPHONES, GRAMOPHONE PICK-UPS OR LIKE ACOUSTIC ELECTROMECHANICAL TRANSDUCERS; DEAF-AID SETS; PUBLIC ADDRESS SYSTEMS
    • H04R2201/00—Details of transducers, loudspeakers or microphones covered by H04R1/00 but not provided for in any of its subgroups
    • H04R2201/40—Details of arrangements for obtaining desired directional characteristic by combining a number of identical transducers covered by H04R1/40 but not provided for in any of its subgroups
    • H04R2201/403—Linear arrays of transducers
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04R—LOUDSPEAKERS, MICROPHONES, GRAMOPHONE PICK-UPS OR LIKE ACOUSTIC ELECTROMECHANICAL TRANSDUCERS; DEAF-AID SETS; PUBLIC ADDRESS SYSTEMS
    • H04R2201/00—Details of transducers, loudspeakers or microphones covered by H04R1/00 but not provided for in any of its subgroups
    • H04R2201/40—Details of arrangements for obtaining desired directional characteristic by combining a number of identical transducers covered by H04R1/40 but not provided for in any of its subgroups
    • H04R2201/405—Non-uniform arrays of transducers or a plurality of uniform arrays with different transducer spacing
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04R—LOUDSPEAKERS, MICROPHONES, GRAMOPHONE PICK-UPS OR LIKE ACOUSTIC ELECTROMECHANICAL TRANSDUCERS; DEAF-AID SETS; PUBLIC ADDRESS SYSTEMS
    • H04R2410/00—Microphones
    • H04R2410/05—Noise reduction with a separate noise microphone
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04R—LOUDSPEAKERS, MICROPHONES, GRAMOPHONE PICK-UPS OR LIKE ACOUSTIC ELECTROMECHANICAL TRANSDUCERS; DEAF-AID SETS; PUBLIC ADDRESS SYSTEMS
    • H04R2430/00—Signal processing covered by H04R, not provided for in its groups
    • H04R2430/20—Processing of the output signals of the acoustic transducers of an array for obtaining a desired directivity characteristic
    • H04R2430/23—Direction finding using a sum-delay beam-former
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04R—LOUDSPEAKERS, MICROPHONES, GRAMOPHONE PICK-UPS OR LIKE ACOUSTIC ELECTROMECHANICAL TRANSDUCERS; DEAF-AID SETS; PUBLIC ADDRESS SYSTEMS
    • H04R2499/00—Aspects covered by H04R or H04S not otherwise provided for in their subgroups
    • H04R2499/10—General applications
    • H04R2499/13—Acoustic transducers and sound field adaptation in vehicles
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04R—LOUDSPEAKERS, MICROPHONES, GRAMOPHONE PICK-UPS OR LIKE ACOUSTIC ELECTROMECHANICAL TRANSDUCERS; DEAF-AID SETS; PUBLIC ADDRESS SYSTEMS
    • H04R3/00—Circuits for transducers, loudspeakers or microphones
    • H04R3/12—Circuits for transducers, loudspeakers or microphones for distributing signals to two or more loudspeakers
JP2018541467A 2016-02-04 2016-02-04 音声通信システム及び方法 Active JP6574529B2 (ja)

Applications Claiming Priority (1)

Application Number Priority Date Filing Date Title
PCT/CN2016/073553 WO2017132958A1 (en) 2016-02-04 2016-02-04 Methods, systems, and media for voice communication

Publications (2)

Publication Number Publication Date
JP2018538765A JP2018538765A (ja) 2018-12-27
JP6574529B2 true JP6574529B2 (ja) 2019-09-11

Family

ID=56872862

Family Applications (1)

Application Number Title Priority Date Filing Date
JP2018541467A Active JP6574529B2 (ja) 2016-02-04 2016-02-04 音声通信システム及び方法

Country Status (4)

Country Link
US (2) US10460744B2 (zh)
JP (1) JP6574529B2 (zh)
CN (1) CN105940445B (zh)
WO (1) WO2017132958A1 (zh)

Families Citing this family (40)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
GB2527865B (en) * 2014-10-30 2016-12-14 Imagination Tech Ltd Controlling operational characteristics of an acoustic echo canceller
DE102014017384B4 (de) * 2014-11-24 2018-10-25 Audi Ag Kraftfahrzeug-Bedienvorrichtung mit Korrekturstrategie für Spracherkennung
US10225395B2 (en) * 2015-12-09 2019-03-05 Whatsapp Inc. Techniques to dynamically engage echo cancellation
JP6670224B2 (ja) * 2016-11-14 2020-03-18 株式会社日立製作所 音声信号処理システム
US10229667B2 (en) * 2017-02-08 2019-03-12 Logitech Europe S.A. Multi-directional beamforming device for acquiring and processing audible input
US10366702B2 (en) 2017-02-08 2019-07-30 Logitech Europe, S.A. Direction detection device for acquiring and processing audible input
US10362393B2 (en) 2017-02-08 2019-07-23 Logitech Europe, S.A. Direction detection device for acquiring and processing audible input
US10366700B2 (en) * 2017-02-08 2019-07-30 Logitech Europe, S.A. Device for acquiring and processing audible input
US11133036B2 (en) * 2017-03-13 2021-09-28 Insoundz Ltd. System and method for associating audio feeds to corresponding video feeds
CN107331407B (zh) * 2017-06-21 2020-10-16 深圳市泰衡诺科技有限公司 下行通话降噪方法及装置
DE102018117557B4 (de) * 2017-07-27 2024-03-21 Harman Becker Automotive Systems Gmbh Adaptives nachfiltern
US10586534B1 (en) * 2017-09-27 2020-03-10 Amazon Technologies, Inc. Voice-controlled device control using acoustic echo cancellation statistics
CN107910011B (zh) * 2017-12-28 2021-05-04 科大讯飞股份有限公司 一种语音降噪方法、装置、服务器及存储介质
CN108022591B (zh) 2017-12-30 2021-03-16 北京百度网讯科技有限公司 车内环境中语音识别的处理方法、装置和电子设备
CN108107982A (zh) 2018-01-03 2018-06-01 京东方科技集团股份有限公司 一种可穿戴设备
CN108415904B (zh) * 2018-01-12 2022-04-19 广东思派康电子科技有限公司 一种双通道实时翻译方法
TWI708243B (zh) * 2018-03-19 2020-10-21 中央研究院 於分散式語音辨識中基於小波轉換之語音特徵壓縮及重建系統與方法
US11523212B2 (en) 2018-06-01 2022-12-06 Shure Acquisition Holdings, Inc. Pattern-forming microphone array
US11159879B2 (en) * 2018-07-16 2021-10-26 Northwestern Polytechnical University Flexible geographically-distributed differential microphone array and associated beamformer
CN113498503A (zh) * 2019-01-17 2021-10-12 苹果公司 用于感测生理状况的具有面部界面的头戴式显示器
CN113348681B (zh) * 2019-01-21 2023-02-24 外部回声公司 通过时变递归滤波器结构的虚拟声学渲染的方法与系统
US11438691B2 (en) 2019-03-21 2022-09-06 Shure Acquisition Holdings, Inc. Auto focus, auto focus within regions, and auto placement of beamformed microphone lobes with inhibition functionality
US11445294B2 (en) 2019-05-23 2022-09-13 Shure Acquisition Holdings, Inc. Steerable speaker array, system, and method for the same
KR20210073975A (ko) * 2019-12-11 2021-06-21 삼성전자주식회사 화자를 인식하는 방법 및 장치
CN111063366A (zh) * 2019-12-26 2020-04-24 紫光展锐(重庆)科技有限公司 降低噪声的方法、装置、电子设备及可读存储介质
WO2021131346A1 (ja) * 2019-12-26 2021-07-01 パナソニック インテレクチュアル プロパティ コーポレーション オブ アメリカ 収音装置、収音方法及び収音プログラム
US20210216150A1 (en) * 2020-01-09 2021-07-15 Dell Products L.P. Distributed sensing for passive pen
CN111227820A (zh) * 2020-02-21 2020-06-05 孙磊 多维通道传感器的胎心检测传感器矩阵、胎心检测设备
CN111265239A (zh) * 2020-02-21 2020-06-12 孙磊 基于邻近计算的胎心检测信号处理及信息提取系统及方法
CN111265237A (zh) * 2020-02-21 2020-06-12 孙磊 基于邻近计算的胎儿胎心监护系统、设备及方法
CN111265240A (zh) * 2020-02-21 2020-06-12 孙磊 胎心监护仪及胎心测量方法
CN111317500B (zh) * 2020-02-21 2021-05-07 孙磊 基于胎心胎动信号的智能穿戴系统
CN111227819B (zh) * 2020-02-21 2021-05-07 孙磊 多维通道传感器的胎心检测传感器矩阵的信号处理方法
CN111265241B (zh) * 2020-02-21 2021-10-22 孙磊 多维通道传感器的胎儿胎心数据可视化方法及系统
US11277689B2 (en) 2020-02-24 2022-03-15 Logitech Europe S.A. Apparatus and method for optimizing sound quality of a generated audible signal
CN111613247B (zh) * 2020-04-14 2023-03-21 云知声智能科技股份有限公司 一种基于麦克风阵列的前景语音检测方法及装置
CN112750463A (zh) * 2020-12-17 2021-05-04 云知声智能科技股份有限公司 一种误识别抑制方法
EP4285605A1 (en) 2021-01-28 2023-12-06 Shure Acquisition Holdings, Inc. Hybrid audio beamforming system
WO2023086273A1 (en) * 2021-11-10 2023-05-19 Dolby Laboratories Licensing Corporation Distributed audio device ducking
CN116232282B (zh) * 2023-01-12 2023-12-19 湖南大学无锡智能控制研究院 一种基于自适应全通滤波器的时变时延估计方法、装置和系统

Family Cites Families (21)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
DE4010815A1 (de) 1990-03-30 1991-10-02 Jens Prof Dr Ing Blauert Mikrophonanordnung zur aufnahme menschlicher lautaeusserungen
US6438247B1 (en) 1999-01-28 2002-08-20 International Business Machines Corporation Seatbelt microphone mounting
ES2228705T3 (es) 2000-07-13 2005-04-16 Paragon Ag Dispositivo de manos libres.
DE10307505B4 (de) * 2003-02-21 2005-03-03 Infineon Technologies Ag Textilgewebestruktur, Flächenverkleidungsstruktur und Verfahren zum Bestimmen eines Abstands von Mikroelektronikelementen der Textilgewebestruktur zu mindestens einer Referenzposition
DE10327753A1 (de) 2003-06-18 2005-01-27 Paragon Ag Sensoranordnung zur Anbringung an einem Gurt, insbesondere an einem Sicherheitsgurt eines Kraftfahrzeugs
CN101015001A (zh) * 2004-09-07 2007-08-08 皇家飞利浦电子股份有限公司 提高了噪声抑制能力的电话装置
CN101217828B (zh) * 2007-01-04 2011-10-12 财团法人工业技术研究院 噪音抑制装置与方法
US8600038B2 (en) * 2008-09-04 2013-12-03 Qualcomm Incorporated System and method for echo cancellation
US8855326B2 (en) * 2008-10-16 2014-10-07 Nxp, B.V. Microphone system and method of operating the same
US8489393B2 (en) * 2009-11-23 2013-07-16 Cambridge Silicon Radio Limited Speech intelligibility
EP2647221B1 (en) * 2010-12-03 2020-01-08 Fraunhofer Gesellschaft zur Förderung der Angewand Apparatus and method for spatially selective sound acquisition by acoustic triangulation
DE102011009318A1 (de) 2011-01-25 2012-07-26 Paragon Ag Sicherheitsgurt für Kraftfahrzeuge
US9711127B2 (en) * 2011-09-19 2017-07-18 Bitwave Pte Ltd. Multi-sensor signal optimization for speech communication
US9767828B1 (en) * 2012-06-27 2017-09-19 Amazon Technologies, Inc. Acoustic echo cancellation using visual cues
US9443532B2 (en) * 2012-07-23 2016-09-13 Qsound Labs, Inc. Noise reduction using direction-of-arrival information
CN104768455B (zh) 2012-09-11 2018-01-02 L.I.F.E.公司 可穿戴式通信平台
CN107172538B (zh) * 2012-11-12 2020-09-04 雅马哈株式会社 信号处理系统和信号处理方法
EP2736272A1 (en) * 2012-11-22 2014-05-28 ETH Zurich Wearable microphone array apparatus
CN103067629B (zh) * 2013-01-18 2014-10-29 苏州科达科技股份有限公司 回声消除装置
US9888317B2 (en) * 2013-10-22 2018-02-06 Nokia Technologies Oy Audio capture with multiple microphones
CN104810021B (zh) 2015-05-11 2017-08-18 百度在线网络技术（北京）有限公司 应用于远场识别的前处理方法和装置

Also Published As

Publication number Publication date
US10460744B2 (en) 2019-10-29
US20180226086A1 (en) 2018-08-09
US20200027472A1 (en) 2020-01-23
JP2018538765A (ja) 2018-12-27
CN105940445B (zh) 2018-06-12
CN105940445A (zh) 2016-09-14
WO2017132958A1 (en) 2017-08-10
US10706871B2 (en) 2020-07-07

Similar Documents

Publication Publication Date Title
JP6574529B2 (ja) 音声通信システム及び方法
CN107039045B (zh) 用于语音增强的全局优化最小二乘后滤波
US9460732B2 (en) Signal source separation
US10123113B2 (en) Selective audio source enhancement
US7171008B2 (en) Reducing noise in audio systems
Warsitz et al. Blind acoustic beamforming based on generalized eigenvalue decomposition
CN111161751A (zh) 复杂场景下的分布式麦克风拾音系统及方法
US20170140771A1 (en) Information processing apparatus, information processing method, and computer program product
Wang et al. Noise power spectral density estimation using MaxNSR blocking matrix
KR20110040855A (ko) 오디오 처리
Löllmann et al. Microphone array signal processing for robot audition
Madhu et al. Acoustic source localization with microphone arrays
Huang et al. Time delay estimation and source localization
Benesty et al. Array beamforming with linear difference equations
CN113838472A (zh) 一种语音降噪方法及装置
Buck et al. A compact microphone array system with spatial post-filtering for automotive applications
Rotaru et al. An efficient GSC VSS-APA beamformer with integrated log-energy based VAD for noise reduction in speech reinforcement systems
Thuene et al. Maximum-likelihood and maximum-a-posteriori perspectives for blind channel identification on acoustic sensor network data
US20190035416A1 (en) Single channel noise reduction
Ayrapetian et al. Asynchronous acoustic echo cancellation over wireless channels
Hioka et al. Enhancement of sound sources located within a particular area using a pair of small microphone arrays
Zheng et al. An improved combination of directional BSS and a source localizer for robust source separation in rapidly time-varying acoustic scenarios
Khayeri et al. A nested superdirective generalized sidelobe canceller for speech enhancement
Koul et al. Using intermicrophone correlation to detect speech in spatially separated noise
Li et al. Noise reduction method based on generalized subtractive beamformer

Legal Events

Date Code Title Description
A621 Written request for application examination

Free format text: JAPANESE INTERMEDIATE CODE: A621

Effective date: 20180501

A977 Report on retrieval

Free format text: JAPANESE INTERMEDIATE CODE: A971007

Effective date: 20190422

A131 Notification of reasons for refusal

Free format text: JAPANESE INTERMEDIATE CODE: A131

Effective date: 20190604

A521 Request for written amendment filed

Free format text: JAPANESE INTERMEDIATE CODE: A523

Effective date: 20190717

TRDD Decision of grant or rejection written
A01 Written decision to grant a patent or to grant a registration (utility model)

Free format text: JAPANESE INTERMEDIATE CODE: A01

Effective date: 20190806

A61 First payment of annual fees (during grant procedure)

Free format text: JAPANESE INTERMEDIATE CODE: A61

Effective date: 20190816

R150 Certificate of patent or registration of utility model

Ref document number: 6574529

Country of ref document: JP

Free format text: JAPANESE INTERMEDIATE CODE: R150

R250 Receipt of annual fees

Free format text: JAPANESE INTERMEDIATE CODE: R250

R250 Receipt of annual fees

Free format text: JAPANESE INTERMEDIATE CODE: R250