JP6205493B2 - 室内インパルス応答に従ってオーディオ信号を処理するための方法、信号処理装置、オーディオ符号化器、オーディオ復号器、及びバイノーラルレンダラ - Google Patents

室内インパルス応答に従ってオーディオ信号を処理するための方法、信号処理装置、オーディオ符号化器、オーディオ復号器、及びバイノーラルレンダラ Download PDF

Info

Publication number
JP6205493B2
JP6205493B2 JP2016528429A JP2016528429A JP6205493B2 JP 6205493 B2 JP6205493 B2 JP 6205493B2 JP 2016528429 A JP2016528429 A JP 2016528429A JP 2016528429 A JP2016528429 A JP 2016528429A JP 6205493 B2 JP6205493 B2 JP 6205493B2
Authority
JP
Japan
Prior art keywords
impulse response
audio
signal
room impulse
time
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Active
Application number
JP2016528429A
Other languages
English (en)
Japanese (ja)
Other versions
JP2016532149A (ja
Inventor
ジモーネ・フュグ
ヤン・プログスティエス
Original Assignee
フラウンホーファー−ゲゼルシャフト・ツール・フェルデルング・デル・アンゲヴァンテン・フォルシュング・アインゲトラーゲネル・フェライン
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by フラウンホーファー−ゲゼルシャフト・ツール・フェルデルング・デル・アンゲヴァンテン・フォルシュング・アインゲトラーゲネル・フェライン filed Critical フラウンホーファー−ゲゼルシャフト・ツール・フェルデルング・デル・アンゲヴァンテン・フォルシュング・アインゲトラーゲネル・フェライン
Publication of JP2016532149A publication Critical patent/JP2016532149A/ja
Application granted granted Critical
Publication of JP6205493B2 publication Critical patent/JP6205493B2/ja
Active legal-status Critical Current
Anticipated expiration legal-status Critical

Links

Classifications

    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04S—STEREOPHONIC SYSTEMS 
    • H04S7/00—Indicating arrangements; Control arrangements, e.g. balance control
    • H04S7/30—Control circuits for electronic adaptation of the sound field
    • H04S7/305—Electronic adaptation of stereophonic audio signals to reverberation of the listening space
    • G—PHYSICS
    • G01—MEASURING; TESTING
    • G01H—MEASUREMENT OF MECHANICAL VIBRATIONS OR ULTRASONIC, SONIC OR INFRASONIC WAVES
    • G01H7/00—Measuring reverberation time ; room acoustic measurements
    • G—PHYSICS
    • G10—MUSICAL INSTRUMENTS; ACOUSTICS
    • G10K—SOUND-PRODUCING DEVICES; METHODS OR DEVICES FOR PROTECTING AGAINST, OR FOR DAMPING, NOISE OR OTHER ACOUSTIC WAVES IN GENERAL; ACOUSTICS NOT OTHERWISE PROVIDED FOR
    • G10K15/00—Acoustics not otherwise provided for
    • G10K15/08—Arrangements for producing a reverberation or echo sound
    • G—PHYSICS
    • G10—MUSICAL INSTRUMENTS; ACOUSTICS
    • G10K—SOUND-PRODUCING DEVICES; METHODS OR DEVICES FOR PROTECTING AGAINST, OR FOR DAMPING, NOISE OR OTHER ACOUSTIC WAVES IN GENERAL; ACOUSTICS NOT OTHERWISE PROVIDED FOR
    • G10K15/00—Acoustics not otherwise provided for
    • G10K15/08—Arrangements for producing a reverberation or echo sound
    • G10K15/12—Arrangements for producing a reverberation or echo sound using electronic time-delay networks
    • G—PHYSICS
    • G10—MUSICAL INSTRUMENTS; ACOUSTICS
    • G10L—SPEECH ANALYSIS TECHNIQUES OR SPEECH SYNTHESIS; SPEECH RECOGNITION; SPEECH OR VOICE PROCESSING TECHNIQUES; SPEECH OR AUDIO CODING OR DECODING
    • G10L19/00—Speech or audio signals analysis-synthesis techniques for redundancy reduction, e.g. in vocoders; Coding or decoding of speech or audio signals, using source filter models or psychoacoustic analysis
    • G10L19/008—Multichannel audio signal coding or decoding using interchannel correlation to reduce redundancy, e.g. joint-stereo, intensity-coding or matrixing
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04S—STEREOPHONIC SYSTEMS 
    • H04S3/00—Systems employing more than two channels, e.g. quadraphonic
    • H04S3/002—Non-adaptive circuits, e.g. manually adjustable or static, for enhancing the sound image or the spatial distribution
    • H04S3/004—For headphones
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04S—STEREOPHONIC SYSTEMS 
    • H04S2400/00—Details of stereophonic systems covered by H04S but not provided for in its groups
    • H04S2400/01—Multi-channel, i.e. more than two input channels, sound reproduction with two speakers wherein the multi-channel information is substantially preserved
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04S—STEREOPHONIC SYSTEMS 
    • H04S2400/00—Details of stereophonic systems covered by H04S but not provided for in its groups
    • H04S2400/03—Aspects of down-mixing multi-channel audio to configurations with lower numbers of playback channels, e.g. 7.1 -> 5.1
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04S—STEREOPHONIC SYSTEMS 
    • H04S2420/00—Techniques used stereophonic systems covered by H04S but not provided for in its groups
    • H04S2420/01—Enhancing the perception of the sound image or of the spatial distribution using head related transfer functions [HRTF's] or equivalents thereof, e.g. interaural time difference [ITD] or interaural level difference [ILD]
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04S—STEREOPHONIC SYSTEMS 
    • H04S7/00—Indicating arrangements; Control arrangements, e.g. balance control
    • H04S7/30—Control circuits for electronic adaptation of the sound field
    • H04S7/301—Automatic calibration of stereophonic sound system, e.g. with test microphone

Landscapes

  • Engineering & Computer Science (AREA)
  • Physics & Mathematics (AREA)
  • Acoustics & Sound (AREA)
  • Multimedia (AREA)
  • Signal Processing (AREA)
  • General Physics & Mathematics (AREA)
  • Computational Linguistics (AREA)
  • Human Computer Interaction (AREA)
  • Audiology, Speech & Language Pathology (AREA)
  • Health & Medical Sciences (AREA)
  • Mathematical Physics (AREA)
  • Stereophonic System (AREA)
  • Circuit For Audible Band Transducer (AREA)
  • Reverberation, Karaoke And Other Acoustics (AREA)
JP2016528429A 2013-07-22 2014-07-16 室内インパルス応答に従ってオーディオ信号を処理するための方法、信号処理装置、オーディオ符号化器、オーディオ復号器、及びバイノーラルレンダラ Active JP6205493B2 (ja)

Applications Claiming Priority (5)

Application Number Priority Date Filing Date Title
EP13177362 2013-07-22
EP13177362.4 2013-07-22
EP13189230.9A EP2830043A3 (en) 2013-07-22 2013-10-18 Method for Processing an Audio Signal in accordance with a Room Impulse Response, Signal Processing Unit, Audio Encoder, Audio Decoder, and Binaural Renderer
EP13189230.9 2013-10-18
PCT/EP2014/065227 WO2015010983A1 (en) 2013-07-22 2014-07-16 Method for processing an audio signal in accordance with a room impulse response, signal processing unit, audio encoder, audio decoder, and binaural renderer

Publications (2)

Publication Number Publication Date
JP2016532149A JP2016532149A (ja) 2016-10-13
JP6205493B2 true JP6205493B2 (ja) 2017-09-27

Family

ID=48874134

Family Applications (1)

Application Number Title Priority Date Filing Date
JP2016528429A Active JP6205493B2 (ja) 2013-07-22 2014-07-16 室内インパルス応答に従ってオーディオ信号を処理するための方法、信号処理装置、オーディオ符号化器、オーディオ復号器、及びバイノーラルレンダラ

Country Status (20)

Country Link
US (6) US10433097B2 (https=)
EP (5) EP2830043A3 (https=)
JP (1) JP6205493B2 (https=)
KR (1) KR101838623B1 (https=)
CN (2) CN105580070B (https=)
AR (1) AR096995A1 (https=)
AU (1) AU2014295254B2 (https=)
BR (1) BR112016001249B1 (https=)
CA (1) CA2918855C (https=)
ES (3) ES3030266T3 (https=)
FI (1) FI3594939T3 (https=)
MX (1) MX359218B (https=)
MY (1) MY176181A (https=)
PL (3) PL3025327T3 (https=)
PT (2) PT3594939T (https=)
RU (1) RU2643867C2 (https=)
SG (1) SG11201600367RA (https=)
TW (1) TWI549119B (https=)
WO (1) WO2015010983A1 (https=)
ZA (1) ZA201601114B (https=)

Families Citing this family (42)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
KR102213895B1 (ko) 2013-01-15 2021-02-08 한국전자통신연구원 채널 신호를 처리하는 부호화/복호화 장치 및 방법
WO2014112793A1 (ko) 2013-01-15 2014-07-24 한국전자통신연구원 채널 신호를 처리하는 부호화/복호화 장치 및 방법
WO2014171791A1 (ko) 2013-04-19 2014-10-23 한국전자통신연구원 다채널 오디오 신호 처리 장치 및 방법
CN104982042B (zh) 2013-04-19 2018-06-08 韩国电子通信研究院 多信道音频信号处理装置及方法
US9319819B2 (en) 2013-07-25 2016-04-19 Etri Binaural rendering method and apparatus for decoding multi channel audio
US9584938B2 (en) * 2015-01-19 2017-02-28 Sennheiser Electronic Gmbh & Co. Kg Method of determining acoustical characteristics of a room or venue having n sound sources
CN107258091B (zh) 2015-02-12 2019-11-26 杜比实验室特许公司 用于耳机虚拟化的混响生成
CN111970630B (zh) * 2015-08-25 2021-11-02 杜比实验室特许公司 音频解码器和解码方法
CA3298877A1 (en) 2015-08-25 2026-03-02 Dolby International Ab Audio encoding and decoding using presentation transform parameters
US9786298B1 (en) 2016-04-08 2017-10-10 Source Digital, Inc. Audio fingerprinting based on audio energy characteristics
US10187740B2 (en) * 2016-09-23 2019-01-22 Apple Inc. Producing headphone driver signals in a digital audio signal processing binaural rendering environment
WO2018079254A1 (en) * 2016-10-28 2018-05-03 Panasonic Intellectual Property Corporation Of America Binaural rendering apparatus and method for playing back of multiple audio sources
WO2019004524A1 (ko) * 2017-06-27 2019-01-03 엘지전자 주식회사 6자유도 환경에서 오디오 재생 방법 및 오디오 재생 장치
JP6886890B2 (ja) * 2017-08-08 2021-06-16 株式会社竹中工務店 減衰時間分析方法、装置、及びプログラム
US10388268B2 (en) 2017-12-08 2019-08-20 Nokia Technologies Oy Apparatus and method for processing volumetric audio
JP7596146B2 (ja) 2017-12-19 2024-12-09 ドルビー・インターナショナル・アーベー 音声音響統合復号および符号化の改良のための方法、機器、およびシステム
CN111107481B (zh) * 2018-10-26 2021-06-22 华为技术有限公司 一种音频渲染方法及装置
CN109846477B (zh) * 2019-01-29 2021-08-06 北京工业大学 一种基于频带注意力残差网络的脑电分类方法
CN114402631B (zh) 2019-05-15 2024-05-31 苹果公司 用于回放捕获的声音的方法和电子设备
JP7286876B2 (ja) 2019-09-23 2023-06-05 ドルビー ラボラトリーズ ライセンシング コーポレイション 変換パラメータによるオーディオ符号化／復号化
WO2021086624A1 (en) * 2019-10-29 2021-05-06 Qsinx Management Llc Audio encoding with compressed ambience
CN111123202B (zh) * 2020-01-06 2022-01-11 北京大学 一种室内早期反射声定位方法及系统
CN111179958A (zh) * 2020-01-08 2020-05-19 厦门亿联网络技术股份有限公司 一种语音晚期混响抑制方法及系统
JP7447533B2 (ja) * 2020-02-19 2024-03-12 ヤマハ株式会社 音信号処理方法および音信号処理装置
CN120526780A (zh) * 2020-03-09 2025-08-22 日本电信电话株式会社 声音信号缩混方法、编码方法、缩混装置及程序
CN112146745B (zh) * 2020-09-09 2023-01-03 中国船舶重工集团公司第七一五研究所 一种水池混响时间的精确测量方法
KR20230084244A (ko) * 2020-10-09 2023-06-12 프라운호퍼 게젤샤프트 쭈르 푀르데룽 데어 안겐반텐 포르슝 에. 베. 대역폭 확장을 사용하여, 인코딩된 오디오 장면을 프로세싱하기 위한 장치, 방법, 또는 컴퓨터 프로그램
WO2022074202A2 (en) 2020-10-09 2022-04-14 Fraunhofer-Gesellschaft zur Förderung der angewandten Forschung e.V. Apparatus, method, or computer program for processing an encoded audio scene using a parameter smoothing
MX2023003962A (es) 2020-10-09 2023-05-25 Fraunhofer Ges Forschung Aparato, metodo, o programa de computadora para procesar una escena de audio codificada utilizando una conversion de parametros.
WO2022103290A1 (en) 2020-11-12 2022-05-19 "Stc"-Innovations Limited" Method for automatic quality evaluation of speech signals using neural networks for selecting a channel in multimicrophone systems
AT523644B1 (de) * 2020-12-01 2021-10-15 Atmoky Gmbh Verfahren für die Erzeugung eines Konvertierungsfilters für ein Konvertieren eines multidimensionalen Ausgangs-Audiosignal in ein zweidimensionales Hör-Audiosignal
CN112652290B (zh) * 2020-12-14 2023-01-20 北京达佳互联信息技术有限公司 产生混响音频信号的方法及音频处理模型的训练方法
CN115250412B (zh) * 2021-04-26 2024-12-27 Oppo广东移动通信有限公司 音频处理方法、装置、无线耳机及计算机可读介质
CN113375788B (zh) * 2021-05-31 2022-05-20 哈尔滨工程大学 一种基于矩阵填充的水声传感器网络环境数据采集方法
US11705148B2 (en) * 2021-06-11 2023-07-18 Microsoft Technology Licensing, Llc Adaptive coefficients and samples elimination for circular convolution
JP7705327B2 (ja) * 2021-09-24 2025-07-09 日本放送協会 インパルス応答生成装置及びインパルス応答生成プログラム
GB2616280A (en) * 2022-03-02 2023-09-06 Nokia Technologies Oy Spatial rendering of reverberation
US20240311474A1 (en) * 2023-03-15 2024-09-19 Pindrop Security, Inc. Presentation attacks in reverberant conditions
KR102833980B1 (ko) * 2023-04-10 2025-07-14 한국전자통신연구원 후기 잔향음 생성 방법 및 장치
CN116160955B (zh) * 2023-04-25 2023-08-29 科大讯飞(苏州)科技有限公司 一种车辆主动声浪增强方法、装置、存储介质及设备
US12408001B2 (en) * 2023-06-16 2025-09-02 Harman International Industries, Incorporated Rendering of audio signals using virtualized reverberation
GB2636429A (en) * 2023-12-14 2025-06-18 Nokia Technologies Oy Adaptive rendering of reverberation from loudspeakers

Family Cites Families (26)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US5371799A (en) * 1993-06-01 1994-12-06 Qsound Labs, Inc. Stereo headphone sound source localization system
EP1072089B1 (en) * 1998-03-25 2011-03-09 Dolby Laboratories Licensing Corp. Audio signal processing method and apparatus
US6188769B1 (en) * 1998-11-13 2001-02-13 Creative Technology Ltd. Environmental reverberation processor
US7107110B2 (en) * 2001-03-05 2006-09-12 Microsoft Corporation Audio buffers with audio effects
BRPI0516971A (pt) 2004-10-26 2008-09-30 Richard S Burwen sistema para gerar eletronicamente uma forma de onda de reverberação artificial a partir de uma forma de onda de entrada e produto de programa de computador
US8284947B2 (en) * 2004-12-01 2012-10-09 Qnx Software Systems Limited Reverberation estimation and suppression system
US7715575B1 (en) * 2005-02-28 2010-05-11 Texas Instruments Incorporated Room impulse response
US20080004729A1 (en) * 2006-06-30 2008-01-03 Nokia Corporation Direct encoding into a directional audio coding format
KR100873639B1 (ko) * 2007-01-23 2008-12-12 삼성전자주식회사 헤드폰에서 출력되는 음상을 외재화하는 장치 및 방법.
KR100899836B1 (ko) * 2007-08-24 2009-05-27 광주과학기술원 실내 충격응답 모델링 방법 및 장치
JP4769238B2 (ja) * 2007-08-24 2011-09-07 日本電信電話株式会社 信号分離装置、信号分離方法、プログラム及び記録媒体
US8150051B2 (en) * 2007-12-12 2012-04-03 Bose Corporation System and method for sound system simulation
WO2010054360A1 (en) * 2008-11-10 2010-05-14 Rensselaer Polytechnic Institute Spatially enveloping reverberation in sound fixing, processing, and room-acoustic simulations using coded sequences
WO2010000878A2 (en) * 2009-10-27 2010-01-07 Phonak Ag Speech enhancement method and system
TWI557723B (zh) * 2010-02-18 2016-11-11 杜比實驗室特許公司 解碼方法及系統
EP2389016B1 (en) * 2010-05-18 2013-07-10 Harman Becker Automotive Systems GmbH Individualization of sound signals
KR101217544B1 (ko) * 2010-12-07 2013-01-02 래드손(주) 음질 향상 효과를 가지는 오디오 신호를 생성하는 오디오 장치 및 방법
EP2656640A2 (en) * 2010-12-22 2013-10-30 Genaudio, Inc. Audio spatialization and environment simulation
BR112013017070B1 (pt) 2011-01-05 2021-03-09 Koninklijke Philips N.V Sistema de áudio e método de operação para um sistema de áudio
EP2541542A1 (en) * 2011-06-27 2013-01-02 Fraunhofer-Gesellschaft zur Förderung der angewandten Forschung e.V. Apparatus and method for determining a measure for a perceived level of reverberation, audio processor and method for processing a signal
KR101174111B1 (ko) * 2012-02-16 2012-09-03 래드손(주) 오디오 신호의 디지털 노이즈를 저감시키는 장치 및 방법
CN102592606B (zh) * 2012-03-23 2013-07-31 福建师范大学福清分校 一种补偿小空间听音声环境的均衡信号处理方法
CN102928067B (zh) * 2012-10-16 2014-12-17 华南理工大学 一种用于测量房间声学参数的系统及方法
CN104956689B (zh) * 2012-11-30 2017-07-04 Dts（英属维尔京群岛）有限公司 用于个性化音频虚拟化的方法和装置
WO2014111829A1 (en) * 2013-01-17 2014-07-24 Koninklijke Philips N.V. Binaural audio processing
US9420393B2 (en) * 2013-05-29 2016-08-16 Qualcomm Incorporated Binaural rendering of spherical harmonic coefficients

Also Published As

Publication number Publication date
ES2933375T3 (es) 2023-02-06
KR101838623B1 (ko) 2018-03-14
EP4125087A1 (en) 2023-02-01
FI3594939T3 (fi) 2023-01-31
AR096995A1 (es) 2016-02-10
PL4125087T3 (pl) 2025-08-18
US10433097B2 (en) 2019-10-01
BR112016001249B1 (pt) 2022-03-15
US20220159405A1 (en) 2022-05-19
EP3025327A1 (en) 2016-06-01
EP2830043A2 (en) 2015-01-28
CN110648651B (zh) 2023-08-25
CA2918855C (en) 2018-07-31
US20160142854A1 (en) 2016-05-19
EP3594939A1 (en) 2020-01-15
US20210289311A1 (en) 2021-09-16
ZA201601114B (en) 2017-11-29
PL3594939T3 (pl) 2023-03-06
AU2014295254A1 (en) 2016-03-10
RU2643867C2 (ru) 2018-02-06
BR112016001249A2 (https=) 2017-07-25
EP3594939B1 (en) 2022-11-02
ES3030266T3 (en) 2025-06-27
EP2830043A3 (en) 2015-02-18
TW201523585A (zh) 2015-06-16
MY176181A (en) 2020-07-24
ES2758757T3 (es) 2020-05-06
RU2016105519A (ru) 2017-08-25
US10721582B2 (en) 2020-07-21
AU2014295254B2 (en) 2017-01-19
CA2918855A1 (en) 2015-01-29
EP4539508A2 (en) 2025-04-16
WO2015010983A1 (en) 2015-01-29
TWI549119B (zh) 2016-09-11
CN110648651A (zh) 2020-01-03
US20240129687A1 (en) 2024-04-18
EP4125087B1 (en) 2025-04-16
MX2016000849A (es) 2016-04-27
PL3025327T3 (pl) 2020-04-30
US20200322750A1 (en) 2020-10-08
JP2016532149A (ja) 2016-10-13
US11265672B2 (en) 2022-03-01
KR20160039201A (ko) 2016-04-08
PT3594939T (pt) 2022-12-07
CN105580070A (zh) 2016-05-11
CN105580070B (zh) 2019-10-29
SG11201600367RA (en) 2016-02-26
US20190387353A1 (en) 2019-12-19
US12238509B2 (en) 2025-02-25
US11856388B2 (en) 2023-12-26
US10972858B2 (en) 2021-04-06
MX359218B (es) 2018-09-19
EP4125087C0 (en) 2025-04-16
PT3025327T (pt) 2020-01-06
EP4539508A3 (en) 2025-07-16
EP3025327B1 (en) 2019-10-02

Similar Documents

Publication Publication Date Title
JP6205493B2 (ja) 室内インパルス応答に従ってオーディオ信号を処理するための方法、信号処理装置、オーディオ符号化器、オーディオ復号器、及びバイノーラルレンダラ
JP7615193B2 (ja) オーディオ信号を処理するための方法、信号処理ユニット、バイノーラルレンダラ、オーディオエンコーダおよびオーディオデコーダ
HK40086480A (en) Method for processing an audio signal in accordance with a room impulse response, signal processing unit, audio encoder, audio decoder, and binaural renderer
HK40086480B (en) Method for processing an audio signal in accordance with a room impulse response, signal processing unit, audio encoder, audio decoder, and binaural renderer
HK1224794B (en) Method for processing an audio signal in accordance with a room impulse response, signal processing unit, audio encoder, audio decoder, and binaural renderer
HK1224794A1 (en) Method for processing an audio signal in accordance with a room impulse response, signal processing unit, audio encoder, audio decoder, and binaural renderer
HK1225549B (en) Method for processing an audio signal; signal processing unit, binaural renderer, audio encoder and audio decoder
HK1225549A1 (en) Method for processing an audio signal; signal processing unit, binaural renderer, audio encoder and audio decoder

Legal Events

Date Code Title Description
A521 Request for written amendment filed

Free format text: JAPANESE INTERMEDIATE CODE: A523

Effective date: 20160308

A621 Written request for application examination

Free format text: JAPANESE INTERMEDIATE CODE: A621

Effective date: 20160308

RD02 Notification of acceptance of power of attorney

Free format text: JAPANESE INTERMEDIATE CODE: A7422

Effective date: 20170306

A521 Request for written amendment filed

Free format text: JAPANESE INTERMEDIATE CODE: A523

Effective date: 20170321

A521 Request for written amendment filed

Free format text: JAPANESE INTERMEDIATE CODE: A821

Effective date: 20170321

A131 Notification of reasons for refusal

Free format text: JAPANESE INTERMEDIATE CODE: A131

Effective date: 20170523

A521 Request for written amendment filed

Free format text: JAPANESE INTERMEDIATE CODE: A523

Effective date: 20170726

TRDD Decision of grant or rejection written
A01 Written decision to grant a patent or to grant a registration (utility model)

Free format text: JAPANESE INTERMEDIATE CODE: A01

Effective date: 20170808

A61 First payment of annual fees (during grant procedure)

Free format text: JAPANESE INTERMEDIATE CODE: A61

Effective date: 20170904

R150 Certificate of patent or registration of utility model

Ref document number: 6205493

Country of ref document: JP

Free format text: JAPANESE INTERMEDIATE CODE: R150

R250 Receipt of annual fees

Free format text: JAPANESE INTERMEDIATE CODE: R250

R250 Receipt of annual fees

Free format text: JAPANESE INTERMEDIATE CODE: R250

R250 Receipt of annual fees

Free format text: JAPANESE INTERMEDIATE CODE: R250

R250 Receipt of annual fees

Free format text: JAPANESE INTERMEDIATE CODE: R250

R250 Receipt of annual fees

Free format text: JAPANESE INTERMEDIATE CODE: R250

R250 Receipt of annual fees

Free format text: JAPANESE INTERMEDIATE CODE: R250