KR101809390B1 - 오디오 디코더, 인코딩된 오디오 출력 데이터를 생성하기 위한 장치 및 디코더의 초기화를 가능하게 하는 방법들 - Google Patents

오디오 디코더, 인코딩된 오디오 출력 데이터를 생성하기 위한 장치 및 디코더의 초기화를 가능하게 하는 방법들 Download PDF

Info

Publication number
KR101809390B1
KR101809390B1 KR1020167010248A KR20167010248A KR101809390B1 KR 101809390 B1 KR101809390 B1 KR 101809390B1 KR 1020167010248 A KR1020167010248 A KR 1020167010248A KR 20167010248 A KR20167010248 A KR 20167010248A KR 101809390 B1 KR101809390 B1 KR 101809390B1
Authority
KR
South Korea
Prior art keywords
frame
sample values
special frame
encoded
audio
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Active
Application number
KR1020167010248A
Other languages
English (en)
Korean (ko)
Other versions
KR20160060686A (ko
Inventor
다니엘 피셔
베른트 첼한
막스 노이엔도르프
니콜라우스 레텔바흐
인고 호프만
하랄드 훅스
스테판 돌라
니콜라우스 페르버
Original Assignee
프라운호퍼 게젤샤프트 쭈르 푀르데룽 데어 안겐반텐 포르슝 에. 베.
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Family has litigation
First worldwide family litigation filed litigation Critical https://patents.darts-ip.com/?family=49378190&utm_source=google_patent&utm_medium=platform_link&utm_campaign=public_patent_search&patent=KR101809390(B1) "Global patent litigation dataset” by Darts-ip is licensed under a Creative Commons Attribution 4.0 International License.
Application filed by 프라운호퍼 게젤샤프트 쭈르 푀르데룽 데어 안겐반텐 포르슝 에. 베. filed Critical 프라운호퍼 게젤샤프트 쭈르 푀르데룽 데어 안겐반텐 포르슝 에. 베.
Publication of KR20160060686A publication Critical patent/KR20160060686A/ko
Application granted granted Critical
Publication of KR101809390B1 publication Critical patent/KR101809390B1/ko
Active legal-status Critical Current
Anticipated expiration legal-status Critical

Links

Images

Classifications

    • G—PHYSICS
    • G10—MUSICAL INSTRUMENTS; ACOUSTICS
    • G10L—SPEECH ANALYSIS TECHNIQUES OR SPEECH SYNTHESIS; SPEECH RECOGNITION; SPEECH OR VOICE PROCESSING TECHNIQUES; SPEECH OR AUDIO CODING OR DECODING
    • G10L19/00—Speech or audio signals analysis-synthesis techniques for redundancy reduction, e.g. in vocoders; Coding or decoding of speech or audio signals, using source filter models or psychoacoustic analysis
    • G—PHYSICS
    • G10—MUSICAL INSTRUMENTS; ACOUSTICS
    • G10L—SPEECH ANALYSIS TECHNIQUES OR SPEECH SYNTHESIS; SPEECH RECOGNITION; SPEECH OR VOICE PROCESSING TECHNIQUES; SPEECH OR AUDIO CODING OR DECODING
    • G10L19/00—Speech or audio signals analysis-synthesis techniques for redundancy reduction, e.g. in vocoders; Coding or decoding of speech or audio signals, using source filter models or psychoacoustic analysis
    • G10L19/04—Speech or audio signals analysis-synthesis techniques for redundancy reduction, e.g. in vocoders; Coding or decoding of speech or audio signals, using source filter models or psychoacoustic analysis using predictive techniques
    • G10L19/16—Vocoder architecture
    • G10L19/167—Audio streaming, i.e. formatting and decoding of an encoded audio signal representation into a data stream for transmission or storage purposes
    • G—PHYSICS
    • G10—MUSICAL INSTRUMENTS; ACOUSTICS
    • G10L—SPEECH ANALYSIS TECHNIQUES OR SPEECH SYNTHESIS; SPEECH RECOGNITION; SPEECH OR VOICE PROCESSING TECHNIQUES; SPEECH OR AUDIO CODING OR DECODING
    • G10L19/00—Speech or audio signals analysis-synthesis techniques for redundancy reduction, e.g. in vocoders; Coding or decoding of speech or audio signals, using source filter models or psychoacoustic analysis
    • G10L19/0017—Lossless audio signal coding; Perfect reconstruction of coded audio signal by transmission of coding error
    • G—PHYSICS
    • G10—MUSICAL INSTRUMENTS; ACOUSTICS
    • G10L—SPEECH ANALYSIS TECHNIQUES OR SPEECH SYNTHESIS; SPEECH RECOGNITION; SPEECH OR VOICE PROCESSING TECHNIQUES; SPEECH OR AUDIO CODING OR DECODING
    • G10L19/00—Speech or audio signals analysis-synthesis techniques for redundancy reduction, e.g. in vocoders; Coding or decoding of speech or audio signals, using source filter models or psychoacoustic analysis
    • G10L19/002—Dynamic bit allocation
    • G—PHYSICS
    • G10—MUSICAL INSTRUMENTS; ACOUSTICS
    • G10L—SPEECH ANALYSIS TECHNIQUES OR SPEECH SYNTHESIS; SPEECH RECOGNITION; SPEECH OR VOICE PROCESSING TECHNIQUES; SPEECH OR AUDIO CODING OR DECODING
    • G10L19/00—Speech or audio signals analysis-synthesis techniques for redundancy reduction, e.g. in vocoders; Coding or decoding of speech or audio signals, using source filter models or psychoacoustic analysis
    • G10L19/008—Multichannel audio signal coding or decoding using interchannel correlation to reduce redundancy, e.g. joint-stereo, intensity-coding or matrixing
    • G—PHYSICS
    • G10—MUSICAL INSTRUMENTS; ACOUSTICS
    • G10L—SPEECH ANALYSIS TECHNIQUES OR SPEECH SYNTHESIS; SPEECH RECOGNITION; SPEECH OR VOICE PROCESSING TECHNIQUES; SPEECH OR AUDIO CODING OR DECODING
    • G10L19/00—Speech or audio signals analysis-synthesis techniques for redundancy reduction, e.g. in vocoders; Coding or decoding of speech or audio signals, using source filter models or psychoacoustic analysis
    • G10L19/04—Speech or audio signals analysis-synthesis techniques for redundancy reduction, e.g. in vocoders; Coding or decoding of speech or audio signals, using source filter models or psychoacoustic analysis using predictive techniques
    • G10L19/16—Vocoder architecture
    • G10L19/18—Vocoders using multiple modes
    • G10L19/20—Vocoders using multiple modes using sound class specific coding, hybrid encoders or object based coding
    • G—PHYSICS
    • G10—MUSICAL INSTRUMENTS; ACOUSTICS
    • G10L—SPEECH ANALYSIS TECHNIQUES OR SPEECH SYNTHESIS; SPEECH RECOGNITION; SPEECH OR VOICE PROCESSING TECHNIQUES; SPEECH OR AUDIO CODING OR DECODING
    • G10L19/00—Speech or audio signals analysis-synthesis techniques for redundancy reduction, e.g. in vocoders; Coding or decoding of speech or audio signals, using source filter models or psychoacoustic analysis
    • G10L19/04—Speech or audio signals analysis-synthesis techniques for redundancy reduction, e.g. in vocoders; Coding or decoding of speech or audio signals, using source filter models or psychoacoustic analysis using predictive techniques
    • G10L19/16—Vocoder architecture
    • G10L19/18—Vocoders using multiple modes
    • G10L19/22—Mode decision, i.e. based on audio signal content versus external parameters
    • G—PHYSICS
    • G10—MUSICAL INSTRUMENTS; ACOUSTICS
    • G10L—SPEECH ANALYSIS TECHNIQUES OR SPEECH SYNTHESIS; SPEECH RECOGNITION; SPEECH OR VOICE PROCESSING TECHNIQUES; SPEECH OR AUDIO CODING OR DECODING
    • G10L19/00—Speech or audio signals analysis-synthesis techniques for redundancy reduction, e.g. in vocoders; Coding or decoding of speech or audio signals, using source filter models or psychoacoustic analysis
    • G10L19/04—Speech or audio signals analysis-synthesis techniques for redundancy reduction, e.g. in vocoders; Coding or decoding of speech or audio signals, using source filter models or psychoacoustic analysis using predictive techniques
    • G10L19/16—Vocoder architecture
    • G10L19/18—Vocoders using multiple modes
    • G10L19/24—Variable rate codecs, e.g. for generating different qualities using a scalable representation such as hierarchical encoding or layered encoding
    • H—ELECTRICITY
    • H03—ELECTRONIC CIRCUITRY
    • H03M—CODING; DECODING; CODE CONVERSION IN GENERAL
    • H03M7/00—Conversion of a code where information is represented by a given sequence or number of digits to a code where the same, similar or subset of information is represented by a different sequence or number of digits
    • H03M7/30—Compression; Expansion; Suppression of unnecessary data, e.g. redundancy reduction

Landscapes

  • Engineering & Computer Science (AREA)
  • Physics & Mathematics (AREA)
  • Health & Medical Sciences (AREA)
  • Signal Processing (AREA)
  • Audiology, Speech & Language Pathology (AREA)
  • Human Computer Interaction (AREA)
  • Computational Linguistics (AREA)
  • Acoustics & Sound (AREA)
  • Multimedia (AREA)
  • Quality & Reliability (AREA)
  • Theoretical Computer Science (AREA)
  • Compression, Expansion, Code Conversion, And Decoders (AREA)
  • Compression Or Coding Systems Of Tv Signals (AREA)
  • Mathematical Physics (AREA)
KR1020167010248A 2013-10-18 2014-10-14 오디오 디코더, 인코딩된 오디오 출력 데이터를 생성하기 위한 장치 및 디코더의 초기화를 가능하게 하는 방법들 Active KR101809390B1 (ko)

Applications Claiming Priority (3)

Application Number Priority Date Filing Date Title
EP13189328.1 2013-10-18
EP13189328.1A EP2863386A1 (en) 2013-10-18 2013-10-18 Audio decoder, apparatus for generating encoded audio output data and methods permitting initializing a decoder
PCT/EP2014/072063 WO2015055683A1 (en) 2013-10-18 2014-10-14 Audio decoder, apparatus for generating encoded audio output data and methods permitting initializing a decoder

Publications (2)

Publication Number Publication Date
KR20160060686A KR20160060686A (ko) 2016-05-30
KR101809390B1 true KR101809390B1 (ko) 2018-01-18

Family

ID=49378190

Family Applications (1)

Application Number Title Priority Date Filing Date
KR1020167010248A Active KR101809390B1 (ko) 2013-10-18 2014-10-14 오디오 디코더, 인코딩된 오디오 출력 데이터를 생성하기 위한 장치 및 디코더의 초기화를 가능하게 하는 방법들

Country Status (19)

Country Link
US (11) US9928845B2 (https=)
EP (2) EP2863386A1 (https=)
JP (1) JP6214765B2 (https=)
KR (1) KR101809390B1 (https=)
CN (2) CN110444218B (https=)
AR (1) AR098075A1 (https=)
AU (1) AU2014336243B2 (https=)
BR (4) BR122021004485B1 (https=)
CA (1) CA2925653C (https=)
ES (1) ES2644370T3 (https=)
MX (1) MX355274B (https=)
MY (1) MY177213A (https=)
PL (1) PL3044782T3 (https=)
PT (1) PT3044782T (https=)
RU (1) RU2651190C2 (https=)
SG (1) SG11201602971SA (https=)
TW (1) TWI579832B (https=)
WO (1) WO2015055683A1 (https=)
ZA (1) ZA201603154B (https=)

Cited By (1)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
WO2021015484A1 (ko) * 2019-07-19 2021-01-28 인텔렉추얼디스커버리 주식회사 무선 통신 시스템에서 적응적인 오디오 처리 방법, 장치, 컴퓨터 프로그램 및 그 기록 매체

Families Citing this family (22)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
EP2863386A1 (en) * 2013-10-18 2015-04-22 Fraunhofer-Gesellschaft zur Förderung der angewandten Forschung e.V. Audio decoder, apparatus for generating encoded audio output data and methods permitting initializing a decoder
CN117037805B (zh) * 2017-01-10 2025-11-07 弗劳恩霍夫应用研究促进协会 音频解码器和编码器、提供解码的音频信号的方法、提供编码的音频信号的方法、使用流标识符的音频流、音频流提供器和计算机程序
CN115691517A (zh) * 2018-02-22 2023-02-03 杜比国际公司 用于处理嵌入在mpeg-h 3d音频流中的辅媒体流的方法及设备
US10586546B2 (en) 2018-04-26 2020-03-10 Qualcomm Incorporated Inversely enumerated pyramid vector quantizers for efficient rate adaptation in audio coding
US10734006B2 (en) 2018-06-01 2020-08-04 Qualcomm Incorporated Audio coding based on audio pattern recognition
US10580424B2 (en) * 2018-06-01 2020-03-03 Qualcomm Incorporated Perceptual audio coding as sequential decision-making problems
BR112021003104A2 (pt) * 2018-08-21 2021-05-11 Dolby International Ab métodos, aparelho e sistemas para geração, transporte e processamento de quadros de reprodução imediata (ipfs)
CA3145444A1 (en) 2019-07-02 2021-01-07 Dolby International Ab Methods, apparatus and systems for representation, encoding, and decoding of discrete directivity data
EP4014236B1 (en) * 2019-08-15 2023-03-22 Dolby Laboratories Licensing Corporation Methods and devices for generation and processing of modified bitstreams
CN113518322B (zh) * 2020-04-10 2024-09-17 华为技术有限公司 无线通信方法和通信装置
US12512106B2 (en) 2020-05-20 2025-12-30 Dolby International Ab Methods and apparatus for unified speech and audio decoding improvements
US12380904B2 (en) * 2020-09-25 2025-08-05 Apple Inc. Seamless scalable decoding of channels, objects, and HOA audio content
CN116648913A (zh) * 2020-12-23 2023-08-25 抖音视界有限公司 视频解码器初始化信息约束
CN114093375B (zh) 2021-03-02 2025-09-12 北京沃东天骏信息技术有限公司 解码方法、装置和计算机可读存储介质
WO2022220541A1 (ko) * 2021-04-12 2022-10-20 엘지전자 주식회사 디코더 초기화 관련 정보의 시그널링 기반 영상 코딩 방법
EP4388530B1 (en) 2021-08-19 2025-08-13 Fraunhofer-Gesellschaft zur Förderung der angewandten Forschung e.V. Audio encoder, method for providing an encoded representation of an audio information, computer program and encoded audio representation using immediate playout frames
US12184425B2 (en) * 2021-09-21 2024-12-31 Qualcomm Incorporated Lossy compressed feedback for multiple incremental redundancy scheme (MIRS)
DE102021006419A1 (de) 2021-12-30 2023-07-06 Fraunhofer-Gesellschaft zur Förderung der angewandten Forschung eingetragener Verein Streaming-Techniken
CN115240692A (zh) * 2022-06-30 2022-10-25 哲库科技(上海)有限公司 接收音频数据的方法、装置以及音频播放设备
CN121794991A (zh) * 2023-08-29 2026-04-03 三星电子株式会社 用于沉浸式画面的显示装置及其控制方法
US20250086956A1 (en) * 2023-09-13 2025-03-13 Qualcomm Incorporated Multi-view convolutional neural networks for video processing
GB2636866A (en) * 2023-12-28 2025-07-02 Nokia Technologies Oy An apparatus and method for immersive audio rendering

Citations (1)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
WO2010003563A1 (en) * 2008-07-11 2010-01-14 Fraunhofer-Gesellschaft zur Förderung der angewandten Forschung e.V. Audio encoder and decoder for encoding and decoding audio samples

Family Cites Families (21)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
KR100304092B1 (ko) * 1998-03-11 2001-09-26 마츠시타 덴끼 산교 가부시키가이샤 오디오 신호 부호화 장치, 오디오 신호 복호화 장치 및 오디오 신호 부호화/복호화 장치
US6604070B1 (en) * 1999-09-22 2003-08-05 Conexant Systems, Inc. System of encoding and decoding speech signals
US7315815B1 (en) * 1999-09-22 2008-01-01 Microsoft Corporation LPC-harmonic vocoder with superframe structure
US7460629B2 (en) * 2001-06-29 2008-12-02 Agere Systems Inc. Method and apparatus for frame-based buffer control in a communication system
JP2003273939A (ja) * 2002-03-13 2003-09-26 Nec Corp 多重伝送システムおよび変換装置と警報転送方法
US7536305B2 (en) * 2002-09-04 2009-05-19 Microsoft Corporation Mixed lossless audio compression
US7392195B2 (en) * 2004-03-25 2008-06-24 Dts, Inc. Lossless multi-channel audio codec
US20070223660A1 (en) * 2004-04-09 2007-09-27 Hiroaki Dei Audio Communication Method And Device
US7596486B2 (en) 2004-05-19 2009-09-29 Nokia Corporation Encoding an audio signal using different audio coder modes
DE102004043521A1 (de) * 2004-09-08 2006-03-23 Fraunhofer-Gesellschaft zur Förderung der angewandten Forschung e.V. Vorrichtung und Verfahren zum Erzeugen eines Multikanalsignals oder eines Parameterdatensatzes
US7610195B2 (en) 2006-06-01 2009-10-27 Nokia Corporation Decoding of predictively coded data using buffer adaptation
KR20100134623A (ko) * 2008-03-04 2010-12-23 엘지전자 주식회사 오디오 신호 처리 방법 및 장치
EP2131590A1 (en) * 2008-06-02 2009-12-09 Deutsche Thomson OHG Method and apparatus for generating or cutting or changing a frame based bit stream format file including at least one header section, and a corresponding data structure
US8380523B2 (en) * 2008-07-07 2013-02-19 Lg Electronics Inc. Method and an apparatus for processing an audio signal
EP2224433B1 (en) * 2008-09-25 2020-05-27 Lg Electronics Inc. An apparatus for processing an audio signal and method thereof
US9237387B2 (en) * 2009-10-06 2016-01-12 Microsoft Technology Licensing, Llc Low latency cacheable media streaming
US8428936B2 (en) 2010-03-05 2013-04-23 Motorola Mobility Llc Decoder for audio signal including generic audio and speech frames
JP5882895B2 (ja) * 2010-06-14 2016-03-09 パナソニック株式会社 復号装置
WO2013028565A1 (en) * 2011-08-19 2013-02-28 General Instrument Corporation Encoder-aided segmentation for adaptive streaming
US20140109153A1 (en) * 2012-10-11 2014-04-17 Affirmed Networks, Inc. Expansion of a Stream Set and Transcoding of HTTP Adaptive Streaming Videos in a Mobile Network
EP2863386A1 (en) * 2013-10-18 2015-04-22 Fraunhofer-Gesellschaft zur Förderung der angewandten Forschung e.V. Audio decoder, apparatus for generating encoded audio output data and methods permitting initializing a decoder

Patent Citations (1)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
WO2010003563A1 (en) * 2008-07-11 2010-01-14 Fraunhofer-Gesellschaft zur Förderung der angewandten Forschung e.V. Audio encoder and decoder for encoding and decoding audio samples

Non-Patent Citations (1)

* Cited by examiner, † Cited by third party
Title
Definition of the Opus Audio Codec. Internet Engineering Task Force (IETF) RFC 6716, 2012.09.*

Cited By (2)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
WO2021015484A1 (ko) * 2019-07-19 2021-01-28 인텔렉추얼디스커버리 주식회사 무선 통신 시스템에서 적응적인 오디오 처리 방법, 장치, 컴퓨터 프로그램 및 그 기록 매체
US12120165B2 (en) 2019-07-19 2024-10-15 Intellectual Discovery Co., Ltd. Adaptive audio processing method, device, computer program, and recording medium thereof in wireless communication system

Also Published As

Publication number Publication date
US20240212697A1 (en) 2024-06-27
KR20160060686A (ko) 2016-05-30
TWI579832B (zh) 2017-04-21
MX2016004845A (es) 2016-07-26
EP3044782A1 (en) 2016-07-20
BR122021004494B1 (pt) 2023-02-23
US12080309B2 (en) 2024-09-03
ZA201603154B (en) 2017-11-29
US20180197556A1 (en) 2018-07-12
US20240203433A1 (en) 2024-06-20
PT3044782T (pt) 2017-12-04
EP3044782B1 (en) 2017-09-06
BR112016008415A2 (https=) 2017-08-22
US11670314B2 (en) 2023-06-06
US20200234726A1 (en) 2020-07-23
US20240203432A1 (en) 2024-06-20
CN110444218B (zh) 2023-10-24
US20220215850A1 (en) 2022-07-07
US12094478B2 (en) 2024-09-17
US20250061906A1 (en) 2025-02-20
ES2644370T3 (es) 2017-11-28
US20160232910A1 (en) 2016-08-11
BR122021004490B1 (pt) 2023-02-23
MX355274B (es) 2018-04-13
CN105745704A (zh) 2016-07-06
MY177213A (en) 2020-09-09
RU2016118985A (ru) 2017-11-23
PL3044782T3 (pl) 2018-02-28
WO2015055683A1 (en) 2015-04-23
US20190156844A1 (en) 2019-05-23
US12165664B2 (en) 2024-12-10
US12170093B2 (en) 2024-12-17
TW201523587A (zh) 2015-06-16
US11423919B2 (en) 2022-08-23
CA2925653A1 (en) 2015-04-23
CN110444218A (zh) 2019-11-12
JP2016539357A (ja) 2016-12-15
US10614824B2 (en) 2020-04-07
BR122021004485B1 (pt) 2023-02-28
EP2863386A1 (en) 2015-04-22
US10229694B2 (en) 2019-03-12
RU2651190C2 (ru) 2018-04-18
CA2925653C (en) 2018-07-24
US9928845B2 (en) 2018-03-27
US20230335146A1 (en) 2023-10-19
US12094479B2 (en) 2024-09-17
AU2014336243B2 (en) 2017-02-02
BR112016008415B1 (pt) 2022-11-29
AR098075A1 (es) 2016-04-27
AU2014336243A1 (en) 2016-05-26
CN105745704B (zh) 2019-08-23
JP6214765B2 (ja) 2017-10-18
US20240203434A1 (en) 2024-06-20
SG11201602971SA (en) 2016-05-30

Similar Documents

Publication Publication Date Title
US12094479B2 (en) Audio decoder, apparatus for generating encoded audio output data and methods permitting initializing a decoder
CN113038172B (zh) 音频数据流拼接以及播出方法、音频解码器和音频解码方法
HK1226549A1 (en) Audio decoder, apparatus for generating encoded audio output data and methods permitting initializing a decoder
HK1226549B (en) Audio decoder, apparatus for generating encoded audio output data and methods permitting initializing a decoder
HK40020053A (en) Method and apparatus for encoding and decoding audio data
HK40020053B (zh) 用於编码和解码音频数据的装置以及方法

Legal Events

Date Code Title Description
A201 Request for examination
E13-X000 Pre-grant limitation requested

St.27 status event code: A-2-3-E10-E13-lim-X000

P11-X000 Amendment of application requested

St.27 status event code: A-2-2-P10-P11-nap-X000

P13-X000 Application amended

St.27 status event code: A-2-2-P10-P13-nap-X000

PA0105 International application

St.27 status event code: A-0-1-A10-A15-nap-PA0105

PA0201 Request for examination

St.27 status event code: A-1-2-D10-D11-exm-PA0201

P11-X000 Amendment of application requested

St.27 status event code: A-2-2-P10-P11-nap-X000

P18-X000 Priority claim added or amended

St.27 status event code: A-2-2-P10-P18-nap-X000

PG1501 Laying open of application

St.27 status event code: A-1-1-Q10-Q12-nap-PG1501

E902 Notification of reason for refusal
PE0902 Notice of grounds for rejection

St.27 status event code: A-1-2-D10-D21-exm-PE0902

T11-X000 Administrative time limit extension requested

St.27 status event code: U-3-3-T10-T11-oth-X000

P11-X000 Amendment of application requested

St.27 status event code: A-2-2-P10-P11-nap-X000

P13-X000 Application amended

St.27 status event code: A-2-2-P10-P13-nap-X000

E701 Decision to grant or registration of patent right
PE0701 Decision of registration

St.27 status event code: A-1-2-D10-D22-exm-PE0701

GRNT Written decision to grant
PR0701 Registration of establishment

St.27 status event code: A-2-4-F10-F11-exm-PR0701

PR1002 Payment of registration fee

St.27 status event code: A-2-2-U10-U12-oth-PR1002

Fee payment year number: 1

PG1601 Publication of registration

St.27 status event code: A-4-4-Q10-Q13-nap-PG1601

R18-X000 Changes to party contact information recorded

St.27 status event code: A-5-5-R10-R18-oth-X000

PR1001 Payment of annual fee

St.27 status event code: A-4-4-U10-U11-oth-PR1001

Fee payment year number: 4

PR1001 Payment of annual fee

St.27 status event code: A-4-4-U10-U11-oth-PR1001

Fee payment year number: 5

PR1001 Payment of annual fee

St.27 status event code: A-4-4-U10-U11-oth-PR1001

Fee payment year number: 6

PR1001 Payment of annual fee

St.27 status event code: A-4-4-U10-U11-oth-PR1001

Fee payment year number: 7

PR1001 Payment of annual fee

St.27 status event code: A-4-4-U10-U11-oth-PR1001

Fee payment year number: 8

PR1001 Payment of annual fee

St.27 status event code: A-4-4-U10-U11-oth-PR1001

Fee payment year number: 9

U11 Full renewal or maintenance fee paid

Free format text: ST27 STATUS EVENT CODE: A-4-4-U10-U11-OTH-PR1001 (AS PROVIDED BY THE NATIONAL OFFICE)

Year of fee payment: 9