KR101492826B1 - 다수의 출력 오디오 채널들을 생성하기 위한 장치 및 방법과, 그 장치를 포함하는 수신기 및 오디오 재생 디바이스, 데이터 스트림 수신 방법, 및 컴퓨터 판독가능 기록매체 - Google Patents

다수의 출력 오디오 채널들을 생성하기 위한 장치 및 방법과, 그 장치를 포함하는 수신기 및 오디오 재생 디바이스, 데이터 스트림 수신 방법, 및 컴퓨터 판독가능 기록매체 Download PDF

Info

Publication number
KR101492826B1
KR101492826B1 KR1020107024547A KR20107024547A KR101492826B1 KR 101492826 B1 KR101492826 B1 KR 101492826B1 KR 1020107024547 A KR1020107024547 A KR 1020107024547A KR 20107024547 A KR20107024547 A KR 20107024547A KR 101492826 B1 KR101492826 B1 KR 101492826B1
Authority
KR
South Korea
Prior art keywords
matrix
decoder
data
hierarchical
channel
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Expired - Lifetime
Application number
KR1020107024547A
Other languages
English (en)
Korean (ko)
Other versions
KR20100134084A (ko
Inventor
에릭 지. 피. 슈이예르스
제럴드 에이치. 호토
하이코 푸른하겐
울프강 에이. 쉴드바흐
홀거 홀리치
한스 엠. 케이. 크졸링
카를 제이. 로덴
Original Assignee
코닌클리케 필립스 엔.브이.
돌비 인터네셔널 에이비
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by 코닌클리케 필립스 엔.브이., 돌비 인터네셔널 에이비 filed Critical 코닌클리케 필립스 엔.브이.
Publication of KR20100134084A publication Critical patent/KR20100134084A/ko
Application granted granted Critical
Publication of KR101492826B1 publication Critical patent/KR101492826B1/ko
Anticipated expiration legal-status Critical
Expired - Lifetime legal-status Critical Current

Links

Images

Classifications

    • G—PHYSICS
    • G10—MUSICAL INSTRUMENTS; ACOUSTICS
    • G10L—SPEECH ANALYSIS TECHNIQUES OR SPEECH SYNTHESIS; SPEECH RECOGNITION; SPEECH OR VOICE PROCESSING TECHNIQUES; SPEECH OR AUDIO CODING OR DECODING
    • G10L19/00—Speech or audio signals analysis-synthesis techniques for redundancy reduction, e.g. in vocoders; Coding or decoding of speech or audio signals, using source filter models or psychoacoustic analysis
    • G10L19/008—Multichannel audio signal coding or decoding using interchannel correlation to reduce redundancy, e.g. joint-stereo, intensity-coding or matrixing
    • G—PHYSICS
    • G10—MUSICAL INSTRUMENTS; ACOUSTICS
    • G10L—SPEECH ANALYSIS TECHNIQUES OR SPEECH SYNTHESIS; SPEECH RECOGNITION; SPEECH OR VOICE PROCESSING TECHNIQUES; SPEECH OR AUDIO CODING OR DECODING
    • G10L19/00—Speech or audio signals analysis-synthesis techniques for redundancy reduction, e.g. in vocoders; Coding or decoding of speech or audio signals, using source filter models or psychoacoustic analysis
    • G10L19/04—Speech or audio signals analysis-synthesis techniques for redundancy reduction, e.g. in vocoders; Coding or decoding of speech or audio signals, using source filter models or psychoacoustic analysis using predictive techniques
    • G10L19/16—Vocoder architecture
    • G10L19/18—Vocoders using multiple modes
    • G10L19/24—Variable rate codecs, e.g. for generating different qualities using a scalable representation such as hierarchical encoding or layered encoding
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
    • H04N21/20—Servers specifically adapted for the distribution of content, e.g. VOD servers; Operations thereof
    • H04N21/23—Processing of content or additional data; Elementary server operations; Server middleware
    • H04N21/233—Processing of audio elementary streams
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04S—STEREOPHONIC SYSTEMS 
    • H04S2420/00—Techniques used stereophonic systems covered by H04S but not provided for in its groups
    • H04S2420/03—Application of parametric coding in stereophonic audio systems

Landscapes

  • Engineering & Computer Science (AREA)
  • Physics & Mathematics (AREA)
  • Signal Processing (AREA)
  • Multimedia (AREA)
  • Acoustics & Sound (AREA)
  • Health & Medical Sciences (AREA)
  • Audiology, Speech & Language Pathology (AREA)
  • Human Computer Interaction (AREA)
  • Computational Linguistics (AREA)
  • Mathematical Physics (AREA)
  • Quality & Reliability (AREA)
  • Stereophonic System (AREA)
  • Compression, Expansion, Code Conversion, And Decoders (AREA)
  • Signal Processing Not Specific To The Method Of Recording And Reproducing (AREA)
  • Reduction Or Emphasis Of Bandwidth Of Signals (AREA)
  • Diaphragms For Electromechanical Transducers (AREA)
  • Amplifiers (AREA)
KR1020107024547A 2005-07-14 2006-07-07 다수의 출력 오디오 채널들을 생성하기 위한 장치 및 방법과, 그 장치를 포함하는 수신기 및 오디오 재생 디바이스, 데이터 스트림 수신 방법, 및 컴퓨터 판독가능 기록매체 Expired - Lifetime KR101492826B1 (ko)

Applications Claiming Priority (3)

Application Number Priority Date Filing Date Title
EP05106466 2005-07-14
EP05106466.5 2005-07-14
PCT/IB2006/052309 WO2007007263A2 (en) 2005-07-14 2006-07-07 Audio encoding and decoding

Related Parent Applications (1)

Application Number Title Priority Date Filing Date
KR1020087003599A Division KR101496193B1 (ko) 2005-07-14 2006-07-07 출력 오디오 채널들 및 출력 오디오 채널들을 포함하는 데이터 스트림을 발생시키기 위한 장치 및 방법, 데이터 스트림을 송신 및 수신하는 방법 및 장치, 및 오디오 재생 및 기록 장치

Publications (2)

Publication Number Publication Date
KR20100134084A KR20100134084A (ko) 2010-12-22
KR101492826B1 true KR101492826B1 (ko) 2015-02-13

Family

ID=37467582

Family Applications (2)

Application Number Title Priority Date Filing Date
KR1020107024547A Expired - Lifetime KR101492826B1 (ko) 2005-07-14 2006-07-07 다수의 출력 오디오 채널들을 생성하기 위한 장치 및 방법과, 그 장치를 포함하는 수신기 및 오디오 재생 디바이스, 데이터 스트림 수신 방법, 및 컴퓨터 판독가능 기록매체
KR1020087003599A Expired - Lifetime KR101496193B1 (ko) 2005-07-14 2006-07-07 출력 오디오 채널들 및 출력 오디오 채널들을 포함하는 데이터 스트림을 발생시키기 위한 장치 및 방법, 데이터 스트림을 송신 및 수신하는 방법 및 장치, 및 오디오 재생 및 기록 장치

Family Applications After (1)

Application Number Title Priority Date Filing Date
KR1020087003599A Expired - Lifetime KR101496193B1 (ko) 2005-07-14 2006-07-07 출력 오디오 채널들 및 출력 오디오 채널들을 포함하는 데이터 스트림을 발생시키기 위한 장치 및 방법, 데이터 스트림을 송신 및 수신하는 방법 및 장치, 및 오디오 재생 및 기록 장치

Country Status (13)

Country Link
US (1) US7966191B2 (enExample)
EP (2) EP1902443B1 (enExample)
JP (2) JP5097702B2 (enExample)
KR (2) KR101492826B1 (enExample)
CN (2) CN102013256B (enExample)
AT (2) ATE433182T1 (enExample)
BR (1) BRPI0613469A2 (enExample)
DE (1) DE602006007139D1 (enExample)
ES (2) ES2327158T3 (enExample)
MX (1) MX2008000504A (enExample)
PL (2) PL1902443T3 (enExample)
RU (2) RU2418385C2 (enExample)
WO (1) WO2007007263A2 (enExample)

Families Citing this family (27)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN102013256B (zh) * 2005-07-14 2013-12-18 皇家飞利浦电子股份有限公司 用于生成多个输出音频通道的方法及设备
JP5113050B2 (ja) * 2005-07-29 2013-01-09 エルジー エレクトロニクス インコーポレイティド 符号化されたオーディオ信号の生成方法及びオーディオ信号の処理方法
KR101218776B1 (ko) * 2006-01-11 2013-01-18 삼성전자주식회사 다운믹스된 신호로부터 멀티채널 신호 생성방법 및 그 기록매체
CN101361122B (zh) * 2006-04-03 2012-12-19 Lg电子株式会社 处理媒体信号的装置及其方法
WO2008084427A2 (en) * 2007-01-10 2008-07-17 Koninklijke Philips Electronics N.V. Audio decoder
EP2093757A4 (en) * 2007-02-20 2012-02-22 Panasonic Corp MULTI-CHANNEL DECODING DEVICE, MULTI-CHANNEL DECODING METHOD, PROGRAM AND INTEGRATED SEMICONDUCTOR SWITCHING
WO2008114982A1 (en) 2007-03-16 2008-09-25 Lg Electronics Inc. A method and an apparatus for processing an audio signal
KR101464977B1 (ko) * 2007-10-01 2014-11-25 삼성전자주식회사 메모리 관리 방법, 및 멀티 채널 데이터의 복호화 방법 및장치
US20100228554A1 (en) * 2007-10-22 2010-09-09 Electronics And Telecommunications Research Institute Multi-object audio encoding and decoding method and apparatus thereof
EP4528726B1 (en) * 2008-10-29 2026-03-18 Dolby International AB Signal clipping protection using pre-existing audio gain metadata
KR20110022251A (ko) * 2009-08-27 2011-03-07 삼성전자주식회사 스테레오 오디오의 부호화, 복호화 방법 및 장치
EP2491553B1 (en) 2009-10-20 2016-10-12 Fraunhofer-Gesellschaft zur Förderung der angewandten Forschung e.V. Audio encoder, audio decoder, method for encoding an audio information, method for decoding an audio information and computer program using an iterative interval size reduction
CA2779388C (en) * 2009-12-16 2015-11-10 Dolby International Ab Sbr bitstream parameter downmix
CN102142924B (zh) * 2010-02-03 2014-04-09 中兴通讯股份有限公司 一种多用途语音频编码传输方法和装置
MY166267A (en) 2011-03-28 2018-06-22 Dolby Laboratories Licensing Corp Reduced complexity transform for a low-frequency-effects channel
WO2014126688A1 (en) 2013-02-14 2014-08-21 Dolby Laboratories Licensing Corporation Methods for audio signal transient detection and decorrelation control
WO2014126689A1 (en) * 2013-02-14 2014-08-21 Dolby Laboratories Licensing Corporation Methods for controlling the inter-channel coherence of upmixed audio signals
TWI618050B (zh) 2013-02-14 2018-03-11 杜比實驗室特許公司 用於音訊處理系統中之訊號去相關的方法及設備
WO2014187987A1 (en) 2013-05-24 2014-11-27 Dolby International Ab Methods for audio encoding and decoding, corresponding computer-readable media and corresponding audio encoder and decoder
TWI847206B (zh) * 2013-09-12 2024-07-01 瑞典商杜比國際公司 多聲道音訊系統中之解碼方法、解碼裝置、包含用於執行解碼方法的指令之非暫態電腦可讀取的媒體之電腦程式產品、包含解碼裝置的音訊系統
CN111192592B (zh) 2013-10-21 2023-09-15 杜比国际公司 音频信号的参数化重构
KR101805327B1 (ko) 2013-10-21 2017-12-05 돌비 인터네셔널 에이비 오디오 신호들의 파라메트릭 재구성을 위한 역상관기 구조
EP2866475A1 (en) 2013-10-23 2015-04-29 Thomson Licensing Method for and apparatus for decoding an audio soundfield representation for audio playback using 2D setups
KR102486338B1 (ko) * 2014-10-31 2023-01-10 돌비 인터네셔널 에이비 멀티채널 오디오 신호의 파라메트릭 인코딩 및 디코딩
KR101930671B1 (ko) * 2015-06-24 2018-12-18 소니 주식회사 음성 처리 장치 및 방법, 그리고 기록 매체
US10416954B2 (en) 2017-04-28 2019-09-17 Microsoft Technology Licensing, Llc Streaming of augmented/virtual reality spatial audio/video
EP3719799A1 (en) 2019-04-04 2020-10-07 FRAUNHOFER-GESELLSCHAFT zur Förderung der angewandten Forschung e.V. A multi-channel audio encoder, decoder, methods and computer program for switching between a parametric multi-channel operation and an individual channel operation

Citations (2)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
WO2003090208A1 (en) * 2002-04-22 2003-10-30 Koninklijke Philips Electronics N.V. pARAMETRIC REPRESENTATION OF SPATIAL AUDIO
WO2004008805A1 (en) 2002-07-12 2004-01-22 Koninklijke Philips Electronics N.V. Audio coding

Family Cites Families (20)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
DE3943881B4 (de) * 1989-04-17 2008-07-17 Fraunhofer-Gesellschaft zur Förderung der angewandten Forschung e.V. Digitales Codierverfahren
DE4236989C2 (de) * 1992-11-02 1994-11-17 Fraunhofer Ges Forschung Verfahren zur Übertragung und/oder Speicherung digitaler Signale mehrerer Kanäle
JP3298478B2 (ja) * 1997-11-10 2002-07-02 日本電気株式会社 Mpeg復号装置
JPH11330980A (ja) * 1998-05-13 1999-11-30 Matsushita Electric Ind Co Ltd 復号装置及びその復号方法、並びにその復号の手順を記録した記録媒体
US6539357B1 (en) * 1999-04-29 2003-03-25 Agere Systems Inc. Technique for parametric coding of a signal containing information
JP2001268697A (ja) * 2000-03-22 2001-09-28 Sony Corp データ伝送システム、データ伝送装置、データ伝送方法
WO2004019656A2 (en) 2001-02-07 2004-03-04 Dolby Laboratories Licensing Corporation Audio channel spatial translation
US6996523B1 (en) * 2001-02-13 2006-02-07 Hughes Electronics Corporation Prototype waveform magnitude quantization for a frequency domain interpolative speech codec system
SE0202159D0 (sv) * 2001-07-10 2002-07-09 Coding Technologies Sweden Ab Efficientand scalable parametric stereo coding for low bitrate applications
US7542896B2 (en) * 2002-07-16 2009-06-02 Koninklijke Philips Electronics N.V. Audio coding/decoding with spatial parameters and non-uniform segmentation for transients
US7502743B2 (en) * 2002-09-04 2009-03-10 Microsoft Corporation Multi-channel audio encoding and decoding with multi-channel transform selection
JP4676140B2 (ja) * 2002-09-04 2011-04-27 マイクロソフト コーポレーション オーディオの量子化および逆量子化
FR2852172A1 (fr) * 2003-03-04 2004-09-10 France Telecom Procede et dispositif de reconstruction spectrale d'un signal audio
US7447317B2 (en) * 2003-10-02 2008-11-04 Fraunhofer-Gesellschaft Zur Foerderung Der Angewandten Forschung E.V Compatible multi-channel coding/decoding by weighting the downmix channel
KR100571824B1 (ko) * 2003-11-26 2006-04-17 삼성전자주식회사 부가정보 삽입된 mpeg-4 오디오 bsac부호화/복호화 방법 및 장치
CN1906664A (zh) * 2004-02-25 2007-01-31 松下电器产业株式会社 音频编码器和音频解码器
US9992599B2 (en) * 2004-04-05 2018-06-05 Koninklijke Philips N.V. Method, device, encoder apparatus, decoder apparatus and audio system
ATE403217T1 (de) * 2004-04-28 2008-08-15 Matsushita Electric Industrial Co Ltd Hierarchische kodierungsanordnung und hierarchisches kodierungsverfahren
CN102013256B (zh) * 2005-07-14 2013-12-18 皇家飞利浦电子股份有限公司 用于生成多个输出音频通道的方法及设备
JP5321820B2 (ja) * 2009-04-23 2013-10-23 セイコーエプソン株式会社 用紙搬送装置

Patent Citations (2)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
WO2003090208A1 (en) * 2002-04-22 2003-10-30 Koninklijke Philips Electronics N.V. pARAMETRIC REPRESENTATION OF SPATIAL AUDIO
WO2004008805A1 (en) 2002-07-12 2004-01-22 Koninklijke Philips Electronics N.V. Audio coding

Non-Patent Citations (3)

* Cited by examiner, † Cited by third party
Title
Breebaart, J. et al. MPEG Spatial Audio Coding/MPEG Surround: Overview and Current Status. Audio Engineering Society 119th Convention Paper. 2005.10.07. (제1면 내지 제17면) *
HERRE, J. et al. The Reference Model Architecture for MPEG Spatial Audio Coding. Proceeding of Audio Engineering Society 118th Convention. 2005.05.28. (제1면 내지 제13면) *
HERRE, J. et al. The Reference Model Architecture for MPEG Spatial Audio Coding. Proceeding of Audio Engineering Society 118th Convention. 2005.05.28. (제1면 내지 제13면)*

Also Published As

Publication number Publication date
PL2088580T3 (pl) 2012-07-31
KR20080037672A (ko) 2008-04-30
JP5097702B2 (ja) 2012-12-12
EP2088580A3 (en) 2009-08-19
EP1902443B1 (en) 2009-06-03
ATE523877T1 (de) 2011-09-15
CN101223575A (zh) 2008-07-16
BRPI0613469A2 (pt) 2012-11-06
RU2010137467A (ru) 2012-03-20
JP5269039B2 (ja) 2013-08-21
CN101223575B (zh) 2011-09-21
JP2011059711A (ja) 2011-03-24
ES2327158T3 (es) 2009-10-26
RU2461078C2 (ru) 2012-09-10
EP2088580A2 (en) 2009-08-12
WO2007007263A2 (en) 2007-01-18
US20080255856A1 (en) 2008-10-16
RU2418385C2 (ru) 2011-05-10
KR20100134084A (ko) 2010-12-22
CN102013256A (zh) 2011-04-13
HK1154984A1 (en) 2012-05-04
KR101496193B1 (ko) 2015-02-26
MX2008000504A (es) 2008-03-07
WO2007007263A3 (en) 2007-03-29
ATE433182T1 (de) 2009-06-15
DE602006007139D1 (de) 2009-07-16
RU2008105556A (ru) 2009-08-20
US7966191B2 (en) 2011-06-21
PL1902443T3 (pl) 2009-12-31
EP2088580B1 (en) 2011-09-07
JP2009501354A (ja) 2009-01-15
CN102013256B (zh) 2013-12-18
EP1902443A2 (en) 2008-03-26
ES2374309T3 (es) 2012-02-15

Similar Documents

Publication Publication Date Title
KR101496193B1 (ko) 출력 오디오 채널들 및 출력 오디오 채널들을 포함하는 데이터 스트림을 발생시키기 위한 장치 및 방법, 데이터 스트림을 송신 및 수신하는 방법 및 장치, 및 오디오 재생 및 기록 장치
US7961890B2 (en) Multi-channel hierarchical audio coding with compact side information
US8433583B2 (en) Audio decoding
KR101303441B1 (ko) 다운믹스를 이용한 오디오 코딩
US9966080B2 (en) Audio object encoding and decoding
KR101346120B1 (ko) 오디오 인코딩 및 디코딩
JP6479786B2 (ja) オーディオ信号のパラメトリック再構成
KR101356586B1 (ko) 다중 채널 오디오 신호를 생성하기 위한 디코더, 수신기 및 방법
US8626503B2 (en) Audio encoding and decoding
CN108206022B (zh) 利用aes/ebu信道传输三维声信号的编解码器及其编解码方法
KR20160101692A (ko) 다채널 신호 처리 방법 및 상기 방법을 수행하는 다채널 신호 처리 장치
HK1154984B (en) Method and apparatus for generating a number of output audio channels

Legal Events

Date Code Title Description
A107 Divisional application of patent
PA0104 Divisional application for international application

St.27 status event code: A-0-1-A10-A18-div-PA0104

St.27 status event code: A-0-1-A10-A16-div-PA0104

PG1501 Laying open of application

St.27 status event code: A-1-1-Q10-Q12-nap-PG1501

A201 Request for examination
AMND Amendment
P11-X000 Amendment of application requested

St.27 status event code: A-2-2-P10-P11-nap-X000

P13-X000 Application amended

St.27 status event code: A-2-2-P10-P13-nap-X000

PA0201 Request for examination

St.27 status event code: A-1-2-D10-D11-exm-PA0201

R18-X000 Changes to party contact information recorded

St.27 status event code: A-3-3-R10-R18-oth-X000

E902 Notification of reason for refusal
PE0902 Notice of grounds for rejection

St.27 status event code: A-1-2-D10-D21-exm-PE0902

T11-X000 Administrative time limit extension requested

St.27 status event code: U-3-3-T10-T11-oth-X000

AMND Amendment
P11-X000 Amendment of application requested

St.27 status event code: A-2-2-P10-P11-nap-X000

P13-X000 Application amended

St.27 status event code: A-2-2-P10-P13-nap-X000

P22-X000 Classification modified

St.27 status event code: A-2-2-P10-P22-nap-X000

E902 Notification of reason for refusal
PE0902 Notice of grounds for rejection

St.27 status event code: A-1-2-D10-D21-exm-PE0902

R18-X000 Changes to party contact information recorded

St.27 status event code: A-3-3-R10-R18-oth-X000

T11-X000 Administrative time limit extension requested

St.27 status event code: U-3-3-T10-T11-oth-X000

T11-X000 Administrative time limit extension requested

St.27 status event code: U-3-3-T10-T11-oth-X000

AMND Amendment
P11-X000 Amendment of application requested

St.27 status event code: A-2-2-P10-P11-nap-X000

P13-X000 Application amended

St.27 status event code: A-2-2-P10-P13-nap-X000

P22-X000 Classification modified

St.27 status event code: A-2-2-P10-P22-nap-X000

E601 Decision to refuse application
PE0601 Decision on rejection of patent

St.27 status event code: N-2-6-B10-B15-exm-PE0601

PN2301 Change of applicant

St.27 status event code: A-3-3-R10-R13-asn-PN2301

St.27 status event code: A-3-3-R10-R11-asn-PN2301

T11-X000 Administrative time limit extension requested

St.27 status event code: U-3-3-T10-T11-oth-X000

PJ0201 Trial against decision of rejection

St.27 status event code: A-3-3-V10-V11-apl-PJ0201

AMND Amendment
P11-X000 Amendment of application requested

St.27 status event code: A-2-2-P10-P11-nap-X000

P13-X000 Application amended

St.27 status event code: A-2-2-P10-P13-nap-X000

PB0901 Examination by re-examination before a trial

St.27 status event code: A-6-3-E10-E12-rex-PB0901

E902 Notification of reason for refusal
PE0902 Notice of grounds for rejection

St.27 status event code: A-1-2-D10-D21-exm-PE0902

T11-X000 Administrative time limit extension requested

St.27 status event code: U-3-3-T10-T11-oth-X000

E13-X000 Pre-grant limitation requested

St.27 status event code: A-2-3-E10-E13-lim-X000

P11-X000 Amendment of application requested

St.27 status event code: A-2-2-P10-P11-nap-X000

P13-X000 Application amended

St.27 status event code: A-2-2-P10-P13-nap-X000

B701 Decision to grant
PB0701 Decision of registration after re-examination before a trial

St.27 status event code: A-3-4-F10-F13-rex-PB0701

PR0701 Registration of establishment

St.27 status event code: A-2-4-F10-F11-exm-PR0701

PR1002 Payment of registration fee

St.27 status event code: A-2-2-U10-U12-oth-PR1002

Fee payment year number: 1

PG1601 Publication of registration

St.27 status event code: A-4-4-Q10-Q13-nap-PG1601

FPAY Annual fee payment

Payment date: 20180131

Year of fee payment: 4

PR1001 Payment of annual fee

St.27 status event code: A-4-4-U10-U11-oth-PR1001

Fee payment year number: 4

FPAY Annual fee payment

Payment date: 20190130

Year of fee payment: 5

PR1001 Payment of annual fee

St.27 status event code: A-4-4-U10-U11-oth-PR1001

Fee payment year number: 5

FPAY Annual fee payment

Payment date: 20200130

Year of fee payment: 6

PR1001 Payment of annual fee

St.27 status event code: A-4-4-U10-U11-oth-PR1001

Fee payment year number: 6

R18-X000 Changes to party contact information recorded

St.27 status event code: A-5-5-R10-R18-oth-X000

PR1001 Payment of annual fee

St.27 status event code: A-4-4-U10-U11-oth-PR1001

Fee payment year number: 7

PR1001 Payment of annual fee

St.27 status event code: A-4-4-U10-U11-oth-PR1001

Fee payment year number: 8

R18-X000 Changes to party contact information recorded

St.27 status event code: A-5-5-R10-R18-oth-X000

R18-X000 Changes to party contact information recorded

St.27 status event code: A-5-5-R10-R18-oth-X000

PR1001 Payment of annual fee

St.27 status event code: A-4-4-U10-U11-oth-PR1001

Fee payment year number: 9

PR1001 Payment of annual fee

St.27 status event code: A-4-4-U10-U11-oth-PR1001

Fee payment year number: 10

R18-X000 Changes to party contact information recorded

St.27 status event code: A-5-5-R10-R18-oth-X000

R18-X000 Changes to party contact information recorded

St.27 status event code: A-5-5-R10-R18-oth-X000

PR1001 Payment of annual fee

St.27 status event code: A-4-4-U10-U11-oth-PR1001

Fee payment year number: 11

PR1001 Payment of annual fee

St.27 status event code: A-4-4-U10-U11-oth-PR1001

Fee payment year number: 12

U11 Full renewal or maintenance fee paid

Free format text: ST27 STATUS EVENT CODE: A-4-4-U10-U11-OTH-PR1001 (AS PROVIDED BY THE NATIONAL OFFICE)

Year of fee payment: 12

R18 Changes to party contact information recorded

Free format text: ST27 STATUS EVENT CODE: A-5-5-R10-R18-OTH-X000 (AS PROVIDED BY THE NATIONAL OFFICE)

R18-X000 Changes to party contact information recorded

St.27 status event code: A-5-5-R10-R18-oth-X000