KR101175553B1 - 소리 신호 부호화 방법, 소리 신호 복호 방법, 부호화 장치, 복호 장치, 소리 신호 처리 시스템, 소리 신호 부호화 프로그램, 및 소리 신호 복호 프로그램 - Google Patents

소리 신호 부호화 방법, 소리 신호 복호 방법, 부호화 장치, 복호 장치, 소리 신호 처리 시스템, 소리 신호 부호화 프로그램, 및 소리 신호 복호 프로그램 Download PDF

Info

Publication number
KR101175553B1
KR101175553B1 KR1020127017742A KR20127017742A KR101175553B1 KR 101175553 B1 KR101175553 B1 KR 101175553B1 KR 1020127017742 A KR1020127017742 A KR 1020127017742A KR 20127017742 A KR20127017742 A KR 20127017742A KR 101175553 B1 KR101175553 B1 KR 101175553B1
Authority
KR
South Korea
Prior art keywords
decoding
encoding
frame
linear prediction
internal state
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Active
Application number
KR1020127017742A
Other languages
English (en)
Korean (ko)
Other versions
KR20120084339A (ko
Inventor
고스케 쓰지노
게이 기쿠이리
노부히코 나카
Original Assignee
가부시키가이샤 엔.티.티.도코모
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by 가부시키가이샤 엔.티.티.도코모 filed Critical 가부시키가이샤 엔.티.티.도코모
Publication of KR20120084339A publication Critical patent/KR20120084339A/ko
Application granted granted Critical
Publication of KR101175553B1 publication Critical patent/KR101175553B1/ko
Active legal-status Critical Current
Anticipated expiration legal-status Critical

Links

Images

Classifications

    • G—PHYSICS
    • G10—MUSICAL INSTRUMENTS; ACOUSTICS
    • G10L—SPEECH ANALYSIS TECHNIQUES OR SPEECH SYNTHESIS; SPEECH RECOGNITION; SPEECH OR VOICE PROCESSING TECHNIQUES; SPEECH OR AUDIO CODING OR DECODING
    • G10L19/00—Speech or audio signals analysis-synthesis techniques for redundancy reduction, e.g. in vocoders; Coding or decoding of speech or audio signals, using source filter models or psychoacoustic analysis
    • G10L19/04—Speech or audio signals analysis-synthesis techniques for redundancy reduction, e.g. in vocoders; Coding or decoding of speech or audio signals, using source filter models or psychoacoustic analysis using predictive techniques
    • G10L19/26—Pre-filtering or post-filtering
    • G—PHYSICS
    • G10—MUSICAL INSTRUMENTS; ACOUSTICS
    • G10L—SPEECH ANALYSIS TECHNIQUES OR SPEECH SYNTHESIS; SPEECH RECOGNITION; SPEECH OR VOICE PROCESSING TECHNIQUES; SPEECH OR AUDIO CODING OR DECODING
    • G10L19/00—Speech or audio signals analysis-synthesis techniques for redundancy reduction, e.g. in vocoders; Coding or decoding of speech or audio signals, using source filter models or psychoacoustic analysis
    • G10L19/04—Speech or audio signals analysis-synthesis techniques for redundancy reduction, e.g. in vocoders; Coding or decoding of speech or audio signals, using source filter models or psychoacoustic analysis using predictive techniques
    • G10L19/08—Determination or coding of the excitation function; Determination or coding of the long-term prediction parameters
    • G10L19/12—Determination or coding of the excitation function; Determination or coding of the long-term prediction parameters the excitation function being a code excitation, e.g. in code excited linear prediction [CELP] vocoders
    • G—PHYSICS
    • G10—MUSICAL INSTRUMENTS; ACOUSTICS
    • G10L—SPEECH ANALYSIS TECHNIQUES OR SPEECH SYNTHESIS; SPEECH RECOGNITION; SPEECH OR VOICE PROCESSING TECHNIQUES; SPEECH OR AUDIO CODING OR DECODING
    • G10L19/00—Speech or audio signals analysis-synthesis techniques for redundancy reduction, e.g. in vocoders; Coding or decoding of speech or audio signals, using source filter models or psychoacoustic analysis
    • G10L19/04—Speech or audio signals analysis-synthesis techniques for redundancy reduction, e.g. in vocoders; Coding or decoding of speech or audio signals, using source filter models or psychoacoustic analysis using predictive techniques
    • G10L19/16—Vocoder architecture
    • G10L19/18—Vocoders using multiple modes
    • G—PHYSICS
    • G10—MUSICAL INSTRUMENTS; ACOUSTICS
    • G10L—SPEECH ANALYSIS TECHNIQUES OR SPEECH SYNTHESIS; SPEECH RECOGNITION; SPEECH OR VOICE PROCESSING TECHNIQUES; SPEECH OR AUDIO CODING OR DECODING
    • G10L19/00—Speech or audio signals analysis-synthesis techniques for redundancy reduction, e.g. in vocoders; Coding or decoding of speech or audio signals, using source filter models or psychoacoustic analysis
    • G10L19/04—Speech or audio signals analysis-synthesis techniques for redundancy reduction, e.g. in vocoders; Coding or decoding of speech or audio signals, using source filter models or psychoacoustic analysis using predictive techniques
    • G10L19/16—Vocoder architecture
    • G10L19/18—Vocoders using multiple modes
    • G10L19/20—Vocoders using multiple modes using sound class specific coding, hybrid encoders or object based coding
    • G—PHYSICS
    • G10—MUSICAL INSTRUMENTS; ACOUSTICS
    • G10L—SPEECH ANALYSIS TECHNIQUES OR SPEECH SYNTHESIS; SPEECH RECOGNITION; SPEECH OR VOICE PROCESSING TECHNIQUES; SPEECH OR AUDIO CODING OR DECODING
    • G10L19/00—Speech or audio signals analysis-synthesis techniques for redundancy reduction, e.g. in vocoders; Coding or decoding of speech or audio signals, using source filter models or psychoacoustic analysis
    • G10L19/04—Speech or audio signals analysis-synthesis techniques for redundancy reduction, e.g. in vocoders; Coding or decoding of speech or audio signals, using source filter models or psychoacoustic analysis using predictive techniques
    • G10L19/16—Vocoder architecture
    • G10L19/18—Vocoders using multiple modes
    • G10L19/22—Mode decision, i.e. based on audio signal content versus external parameters
    • G—PHYSICS
    • G10—MUSICAL INSTRUMENTS; ACOUSTICS
    • G10L—SPEECH ANALYSIS TECHNIQUES OR SPEECH SYNTHESIS; SPEECH RECOGNITION; SPEECH OR VOICE PROCESSING TECHNIQUES; SPEECH OR AUDIO CODING OR DECODING
    • G10L19/00—Speech or audio signals analysis-synthesis techniques for redundancy reduction, e.g. in vocoders; Coding or decoding of speech or audio signals, using source filter models or psychoacoustic analysis
    • G10L19/002—Dynamic bit allocation
    • G—PHYSICS
    • G10—MUSICAL INSTRUMENTS; ACOUSTICS
    • G10L—SPEECH ANALYSIS TECHNIQUES OR SPEECH SYNTHESIS; SPEECH RECOGNITION; SPEECH OR VOICE PROCESSING TECHNIQUES; SPEECH OR AUDIO CODING OR DECODING
    • G10L19/00—Speech or audio signals analysis-synthesis techniques for redundancy reduction, e.g. in vocoders; Coding or decoding of speech or audio signals, using source filter models or psychoacoustic analysis
    • G10L19/04—Speech or audio signals analysis-synthesis techniques for redundancy reduction, e.g. in vocoders; Coding or decoding of speech or audio signals, using source filter models or psychoacoustic analysis using predictive techniques
    • G10L19/16—Vocoder architecture
    • G10L19/18—Vocoders using multiple modes
    • G10L19/24—Variable rate codecs, e.g. for generating different qualities using a scalable representation such as hierarchical encoding or layered encoding

Landscapes

  • Engineering & Computer Science (AREA)
  • Computational Linguistics (AREA)
  • Signal Processing (AREA)
  • Health & Medical Sciences (AREA)
  • Audiology, Speech & Language Pathology (AREA)
  • Human Computer Interaction (AREA)
  • Physics & Mathematics (AREA)
  • Acoustics & Sound (AREA)
  • Multimedia (AREA)
  • Compression, Expansion, Code Conversion, And Decoders (AREA)
  • Compression Or Coding Systems Of Tv Signals (AREA)
KR1020127017742A 2009-03-06 2010-03-03 소리 신호 부호화 방법, 소리 신호 복호 방법, 부호화 장치, 복호 장치, 소리 신호 처리 시스템, 소리 신호 부호화 프로그램, 및 소리 신호 복호 프로그램 Active KR101175553B1 (ko)

Applications Claiming Priority (3)

Application Number Priority Date Filing Date Title
JPJP-P-2009-053693 2009-03-06
JP2009053693A JP4977157B2 (ja) 2009-03-06 2009-03-06 音信号符号化方法、音信号復号方法、符号化装置、復号装置、音信号処理システム、音信号符号化プログラム、及び、音信号復号プログラム
PCT/JP2010/053454 WO2010101190A1 (ja) 2009-03-06 2010-03-03 音信号符号化方法、音信号復号方法、符号化装置、復号装置、音信号処理システム、音信号符号化プログラム、及び、音信号復号プログラム

Related Parent Applications (1)

Application Number Title Priority Date Filing Date
KR1020117020793A Division KR101256542B1 (ko) 2009-03-06 2010-03-03 소리 신호 부호화 방법, 소리 신호 복호 방법, 부호화 장치, 복호 장치, 소리 신호 처리 시스템, 및 소리 신호 부호화 프로그램 및 소리 신호 복호 프로그램을 기록한 컴퓨터로 읽을 수 있는 매체

Publications (2)

Publication Number Publication Date
KR20120084339A KR20120084339A (ko) 2012-07-27
KR101175553B1 true KR101175553B1 (ko) 2012-08-23

Family

ID=42709745

Family Applications (3)

Application Number Title Priority Date Filing Date
KR1020127017742A Active KR101175553B1 (ko) 2009-03-06 2010-03-03 소리 신호 부호화 방법, 소리 신호 복호 방법, 부호화 장치, 복호 장치, 소리 신호 처리 시스템, 소리 신호 부호화 프로그램, 및 소리 신호 복호 프로그램
KR1020127017741A Active KR101175555B1 (ko) 2009-03-06 2010-03-03 소리 신호 부호화 방법, 소리 신호 복호 방법, 부호화 장치, 복호 장치, 소리 신호 처리 시스템, 소리 신호 부호화 프로그램, 및 소리 신호 복호 프로그램
KR1020117020793A Active KR101256542B1 (ko) 2009-03-06 2010-03-03 소리 신호 부호화 방법, 소리 신호 복호 방법, 부호화 장치, 복호 장치, 소리 신호 처리 시스템, 및 소리 신호 부호화 프로그램 및 소리 신호 복호 프로그램을 기록한 컴퓨터로 읽을 수 있는 매체

Family Applications After (2)

Application Number Title Priority Date Filing Date
KR1020127017741A Active KR101175555B1 (ko) 2009-03-06 2010-03-03 소리 신호 부호화 방법, 소리 신호 복호 방법, 부호화 장치, 복호 장치, 소리 신호 처리 시스템, 소리 신호 부호화 프로그램, 및 소리 신호 복호 프로그램
KR1020117020793A Active KR101256542B1 (ko) 2009-03-06 2010-03-03 소리 신호 부호화 방법, 소리 신호 복호 방법, 부호화 장치, 복호 장치, 소리 신호 처리 시스템, 및 소리 신호 부호화 프로그램 및 소리 신호 복호 프로그램을 기록한 컴퓨터로 읽을 수 있는 매체

Country Status (22)

Country Link
US (3) US8751245B2 (enExample)
EP (3) EP2405426B1 (enExample)
JP (1) JP4977157B2 (enExample)
KR (3) KR101175553B1 (enExample)
CN (3) CN102737642B (enExample)
AU (1) AU2010219643C1 (enExample)
BR (3) BR122013014741B1 (enExample)
CA (1) CA2754404C (enExample)
CY (1) CY1114649T1 (enExample)
DK (1) DK2405426T3 (enExample)
ES (1) ES2434125T3 (enExample)
HR (1) HRP20131056T1 (enExample)
MX (1) MX2011009333A (enExample)
PH (2) PH12012501446A1 (enExample)
PL (1) PL2405426T3 (enExample)
PT (1) PT2405426E (enExample)
RU (3) RU2482554C1 (enExample)
SG (1) SG174241A1 (enExample)
SI (1) SI2405426T1 (enExample)
SM (1) SMT201400025B (enExample)
TW (3) TWI385649B (enExample)
WO (1) WO2010101190A1 (enExample)

Families Citing this family (21)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
JP5395649B2 (ja) * 2009-12-24 2014-01-22 日本電信電話株式会社 符号化方法、復号方法、符号化装置、復号装置及びプログラム
FR2969805A1 (fr) * 2010-12-23 2012-06-29 France Telecom Codage bas retard alternant codage predictif et codage par transformee
EP2772914A4 (en) * 2011-10-28 2015-07-15 Panasonic Corp DECODER FOR HYBRID SOUND SIGNALS, COORDINATORS FOR HYBRID SOUND SIGNALS, DECODING PROCEDURE FOR SOUND SIGNALS AND CODING SIGNALING PROCESSES
US9043201B2 (en) 2012-01-03 2015-05-26 Google Technology Holdings LLC Method and apparatus for processing audio frames to transition between different codecs
AU2013345615B2 (en) * 2012-11-13 2017-05-04 Samsung Electronics Co., Ltd. Method and apparatus for determining encoding mode, method and apparatus for encoding audio signals, and method and apparatus for decoding audio signals
EP2830061A1 (en) 2013-07-22 2015-01-28 Fraunhofer Gesellschaft zur Förderung der angewandten Forschung e.V. Apparatus and method for encoding and decoding an encoded audio signal using temporal noise/patch shaping
JP5981408B2 (ja) * 2013-10-29 2016-08-31 株式会社Ｎｔｔドコモ 音声信号処理装置、音声信号処理方法、及び音声信号処理プログラム
FR3013496A1 (fr) * 2013-11-15 2015-05-22 Orange Transition d'un codage/decodage par transformee vers un codage/decodage predictif
US11589172B2 (en) 2014-01-06 2023-02-21 Shenzhen Shokz Co., Ltd. Systems and methods for suppressing sound leakage
EP2980797A1 (en) * 2014-07-28 2016-02-03 Fraunhofer-Gesellschaft zur Förderung der angewandten Forschung e.V. Audio decoder, method and computer program using a zero-input-response to obtain a smooth transition
US9685164B2 (en) * 2014-03-31 2017-06-20 Qualcomm Incorporated Systems and methods of switching coding technologies at a device
EP2980794A1 (en) * 2014-07-28 2016-02-03 Fraunhofer-Gesellschaft zur Förderung der angewandten Forschung e.V. Audio encoder and decoder using a frequency domain processor and a time domain processor
EP2980795A1 (en) * 2014-07-28 2016-02-03 Fraunhofer-Gesellschaft zur Förderung der angewandten Forschung e.V. Audio encoding and decoding using a frequency domain processor, a time domain processor and a cross processor for initialization of the time domain processor
FR3024582A1 (fr) 2014-07-29 2016-02-05 Orange Gestion de la perte de trame dans un contexte de transition fd/lpd
CN104485112B (zh) * 2014-12-08 2017-12-08 福建联迪商用设备有限公司 一种基于音频通讯中的音频解码方法及其装置
WO2016142002A1 (en) 2015-03-09 2016-09-15 Fraunhofer-Gesellschaft Zur Foerderung Der Angewandten Forschung E.V. Audio encoder, audio decoder, method for encoding an audio signal and method for decoding an encoded audio signal
EP3231393B1 (de) 2016-04-13 2023-06-21 Christian Vallbracht Minimal-invasiv implantierbare mitral- und trikuspidalklappe
CN109215667B (zh) 2017-06-29 2020-12-22 华为技术有限公司 时延估计方法及装置
CN110556118B (zh) * 2018-05-31 2022-05-10 华为技术有限公司 立体声信号的编码方法和装置
JP7137694B2 (ja) 2018-09-12 2022-09-14 シェンチェン ショックス カンパニー リミテッド 複数の音響電気変換器を有する信号処理装置
CN115881140B (zh) * 2021-09-29 2025-09-26 华为技术有限公司 编解码方法、装置、设备、存储介质及计算机程序产品

Citations (1)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
JP2004053676A (ja) 2002-07-16 2004-02-19 Mitsubishi Electric Corp 音声符号化装置および復号装置

Family Cites Families (21)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
JPH0352899A (ja) * 1989-07-20 1991-03-07 Asahi Glass Co Ltd カルシトニン類似体
SE504010C2 (sv) * 1995-02-08 1996-10-14 Ericsson Telefon Ab L M Förfarande och anordning för prediktiv kodning av tal- och datasignaler
JP2904083B2 (ja) * 1995-11-29 1999-06-14 日本電気株式会社 音声符号化切替えシステム
US6134518A (en) * 1997-03-04 2000-10-17 International Business Machines Corporation Digital audio signal coding using a CELP coder and a transform coder
JP4216364B2 (ja) * 1997-08-29 2009-01-28 株式会社東芝 音声符号化／復号化方法および音声信号の成分分離方法
JP3487158B2 (ja) * 1998-02-26 2004-01-13 三菱電機株式会社 音声符号化伝送システム
SE0004187D0 (sv) * 2000-11-15 2000-11-15 Coding Technologies Sweden Ab Enhancing the performance of coding systems that use high frequency reconstruction methods
JP4551555B2 (ja) * 2000-11-29 2010-09-29 株式会社東芝 符号化データ伝送装置
US6658383B2 (en) * 2001-06-26 2003-12-02 Microsoft Corporation Method for coding speech and music signals
JP4290917B2 (ja) * 2002-02-08 2009-07-08 株式会社エヌ・ティ・ティ・ドコモ 復号装置、符号化装置、復号方法、及び、符号化方法
US20050228648A1 (en) * 2002-04-22 2005-10-13 Ari Heikkinen Method and device for obtaining parameters for parametric speech coding of frames
US7876966B2 (en) * 2003-03-11 2011-01-25 Spyder Navigations L.L.C. Switching between coding schemes
JP4546464B2 (ja) 2004-04-27 2010-09-15 パナソニック株式会社 スケーラブル符号化装置、スケーラブル復号化装置、およびこれらの方法
CA2566372A1 (en) * 2004-05-17 2005-11-24 Nokia Corporation Audio encoding with different coding models
ES2338117T3 (es) * 2004-05-17 2010-05-04 Nokia Corporation Codificacion de audio con diferentes longitudes de trama de codificacion.
US7596486B2 (en) * 2004-05-19 2009-09-29 Nokia Corporation Encoding an audio signal using different audio coder modes
RU2007139784A (ru) * 2005-04-28 2009-05-10 Мацусита Электрик Индастриал Ко., Лтд. (Jp) Устройство кодирования звука и способ кодирования звука
EP1883067A1 (en) * 2006-07-24 2008-01-30 Deutsche Thomson-Brandt Gmbh Method and apparatus for lossless encoding of a source signal, using a lossy encoded data stream and a lossless extension data stream
PL2311034T3 (pl) 2008-07-11 2016-04-29 Fraunhofer Ges Forschung Koder i dekoder audio do kodowania ramek próbkowanego sygnału audio
PL2491556T3 (pl) * 2009-10-20 2024-08-26 Fraunhofer-Gesellschaft zur Förderung der angewandten Forschung e.V. Dekoder sygnału audio, odpowiadający mu sposób oraz program komputerowy
FR2969805A1 (fr) * 2010-12-23 2012-06-29 France Telecom Codage bas retard alternant codage predictif et codage par transformee

Patent Citations (1)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
JP2004053676A (ja) 2002-07-16 2004-02-19 Mitsubishi Electric Corp 音声符号化装置および復号装置

Also Published As

Publication number Publication date
PT2405426E (pt) 2013-10-17
US20110320212A1 (en) 2011-12-29
EP2405426B1 (en) 2013-08-28
CA2754404C (en) 2016-04-26
CN102737641B (zh) 2014-07-02
DK2405426T3 (da) 2013-11-11
TW201246191A (en) 2012-11-16
US8751245B2 (en) 2014-06-10
CN102737642A (zh) 2012-10-17
SI2405426T1 (sl) 2013-12-31
TWI390504B (zh) 2013-03-21
CY1114649T1 (el) 2016-12-14
TWI385649B (zh) 2013-02-11
CN102341851A (zh) 2012-02-01
BR122013014741A2 (pt) 2016-05-24
BR122013014741B1 (pt) 2020-10-27
SMT201400025B (it) 2014-05-07
WO2010101190A1 (ja) 2010-09-10
HRP20131056T1 (hr) 2013-12-06
BR122013014739B1 (pt) 2020-10-13
JP2010210680A (ja) 2010-09-24
CN102737641A (zh) 2012-10-17
AU2010219643B2 (en) 2012-10-25
AU2010219643C1 (en) 2013-03-14
US20130185075A1 (en) 2013-07-18
KR101256542B1 (ko) 2013-04-19
EP2511907A1 (en) 2012-10-17
RU2493619C1 (ru) 2013-09-20
PL2405426T3 (pl) 2014-01-31
KR20120084338A (ko) 2012-07-27
KR20120084339A (ko) 2012-07-27
ES2434125T3 (es) 2013-12-13
TWI385648B (zh) 2013-02-11
PH12012501446B1 (en) 2015-07-20
BRPI1016262B1 (pt) 2020-11-10
PH12012501447A1 (en) 2014-08-27
SG174241A1 (en) 2011-10-28
MX2011009333A (es) 2011-09-29
EP2405426A1 (en) 2012-01-11
JP4977157B2 (ja) 2012-07-18
EP2511906A1 (en) 2012-10-17
KR101175555B1 (ko) 2012-08-21
BRPI1016262A2 (pt) 2016-05-03
US20130185085A1 (en) 2013-07-18
CN102341851B (zh) 2013-09-04
TW201246192A (en) 2012-11-16
AU2010219643A1 (en) 2011-10-06
TW201126513A (en) 2011-08-01
RU2482554C1 (ru) 2013-05-20
CA2754404A1 (en) 2010-09-10
RU2493620C1 (ru) 2013-09-20
CN102737642B (zh) 2014-07-30
US8666754B2 (en) 2014-03-04
US9214161B2 (en) 2015-12-15
KR20110124279A (ko) 2011-11-16
PH12012501447B1 (en) 2014-08-27
EP2405426A4 (en) 2012-10-17
PH12012501446A1 (en) 2015-07-20
BR122013014739A2 (pt) 2016-05-24
RU2011140533A (ru) 2013-05-10

Similar Documents

Publication Publication Date Title
KR101175553B1 (ko) 소리 신호 부호화 방법, 소리 신호 복호 방법, 부호화 장치, 복호 장치, 소리 신호 처리 시스템, 소리 신호 부호화 프로그램, 및 소리 신호 복호 프로그램
KR102171293B1 (ko) 음성 부호화 장치, 음성 부호화 방법, 음성 부호화 프로그램, 음성 복호 장치, 음성 복호 방법 및 음성 복호 프로그램
JP5197838B2 (ja) 音信号符号化方法、音信号復号方法、符号化装置、復号装置、音信号処理システム、音信号符号化プログラム、及び、音信号復号プログラム
JP4977268B2 (ja) 音信号符号化方法、音信号復号方法、符号化装置、復号装置、音信号処理システム、音信号符号化プログラム、及び、音信号復号プログラム

Legal Events

Date Code Title Description
A107 Divisional application of patent
A201 Request for examination
A302 Request for accelerated examination
PA0104 Divisional application for international application

Comment text: Divisional Application for International Patent

Patent event code: PA01041R01D

Patent event date: 20120709

PA0201 Request for examination
PA0302 Request for accelerated examination

Patent event date: 20120709

Patent event code: PA03022R01D

Comment text: Request for Accelerated Examination

E701 Decision to grant or registration of patent right
PE0701 Decision of registration

Patent event code: PE07011S01D

Comment text: Decision to Grant Registration

Patent event date: 20120725

PG1501 Laying open of application
GRNT Written decision to grant
PR0701 Registration of establishment

Comment text: Registration of Establishment

Patent event date: 20120814

Patent event code: PR07011E01D

PR1002 Payment of registration fee

Payment date: 20120814

End annual number: 3

Start annual number: 1

PG1601 Publication of registration
FPAY Annual fee payment

Payment date: 20150716

Year of fee payment: 4

PR1001 Payment of annual fee

Payment date: 20150716

Start annual number: 4

End annual number: 4

FPAY Annual fee payment

Payment date: 20160720

Year of fee payment: 5

PR1001 Payment of annual fee

Payment date: 20160720

Start annual number: 5

End annual number: 5

FPAY Annual fee payment

Payment date: 20170720

Year of fee payment: 6

PR1001 Payment of annual fee

Payment date: 20170720

Start annual number: 6

End annual number: 6

FPAY Annual fee payment

Payment date: 20180719

Year of fee payment: 7

PR1001 Payment of annual fee

Payment date: 20180719

Start annual number: 7

End annual number: 7

FPAY Annual fee payment

Payment date: 20190722

Year of fee payment: 8

PR1001 Payment of annual fee

Payment date: 20190722

Start annual number: 8

End annual number: 8

PR1001 Payment of annual fee

Payment date: 20200720

Start annual number: 9

End annual number: 9

PR1001 Payment of annual fee

Payment date: 20220720

Start annual number: 11

End annual number: 11