EP1889488A2 - Equipment for audio-video processing system - Google Patents
Equipment for audio-video processing systemInfo
- Publication number
- EP1889488A2 EP1889488A2 EP06765672A EP06765672A EP1889488A2 EP 1889488 A2 EP1889488 A2 EP 1889488A2 EP 06765672 A EP06765672 A EP 06765672A EP 06765672 A EP06765672 A EP 06765672A EP 1889488 A2 EP1889488 A2 EP 1889488A2
- Authority
- EP
- European Patent Office
- Prior art keywords
- video signal
- signal processing
- delay
- audio
- processing unit
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Granted
Links
- 230000005236 sound signal Effects 0.000 claims abstract description 19
- 238000003672 processing method Methods 0.000 claims 1
- 239000000872 buffer Substances 0.000 description 12
- 230000001419 dependent effect Effects 0.000 description 6
- 230000001934 delay Effects 0.000 description 5
- 238000004891 communication Methods 0.000 description 3
- 230000003044 adaptive effect Effects 0.000 description 1
- 230000006835 compression Effects 0.000 description 1
- 238000007906 compression Methods 0.000 description 1
- 238000000034 method Methods 0.000 description 1
- 230000000750 progressive effect Effects 0.000 description 1
- 238000011084 recovery Methods 0.000 description 1
Classifications
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
- H04N21/40—Client devices specifically adapted for the reception of or interaction with content, e.g. set-top-box [STB]; Operations thereof
- H04N21/43—Processing of content or additional data, e.g. demultiplexing additional data from a digital video stream; Elementary client operations, e.g. monitoring of home network or synchronising decoder's clock; Client middleware
- H04N21/44—Processing of video elementary streams, e.g. splicing a video clip retrieved from local storage with an incoming video stream or rendering scenes according to encoded video stream scene graphs
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
- H04N21/20—Servers specifically adapted for the distribution of content, e.g. VOD servers; Operations thereof
- H04N21/23—Processing of content or additional data; Elementary server operations; Server middleware
- H04N21/236—Assembling of a multiplex stream, e.g. transport stream, by combining a video stream with other content or additional data, e.g. inserting a URL [Uniform Resource Locator] into a video stream, multiplexing software data into a video stream; Remultiplexing of multiplex streams; Insertion of stuffing bits into the multiplex stream, e.g. to obtain a constant bit-rate; Assembling of a packetised elementary stream
- H04N21/2368—Multiplexing of audio and video streams
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
- H04N21/40—Client devices specifically adapted for the reception of or interaction with content, e.g. set-top-box [STB]; Operations thereof
- H04N21/43—Processing of content or additional data, e.g. demultiplexing additional data from a digital video stream; Elementary client operations, e.g. monitoring of home network or synchronising decoder's clock; Client middleware
- H04N21/4302—Content synchronisation processes, e.g. decoder synchronisation
- H04N21/4307—Synchronising the rendering of multiple content streams or additional data on devices, e.g. synchronisation of audio on a mobile phone with the video output on the TV screen
- H04N21/43072—Synchronising the rendering of multiple content streams or additional data on devices, e.g. synchronisation of audio on a mobile phone with the video output on the TV screen of multiple content streams on the same device
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
- H04N21/40—Client devices specifically adapted for the reception of or interaction with content, e.g. set-top-box [STB]; Operations thereof
- H04N21/43—Processing of content or additional data, e.g. demultiplexing additional data from a digital video stream; Elementary client operations, e.g. monitoring of home network or synchronising decoder's clock; Client middleware
- H04N21/434—Disassembling of a multiplex stream, e.g. demultiplexing audio and video streams, extraction of additional data from a video stream; Remultiplexing of multiplex streams; Extraction or processing of SI; Disassembling of packetised elementary stream
- H04N21/4341—Demultiplexing of audio and video streams
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
- H04N21/40—Client devices specifically adapted for the reception of or interaction with content, e.g. set-top-box [STB]; Operations thereof
- H04N21/43—Processing of content or additional data, e.g. demultiplexing additional data from a digital video stream; Elementary client operations, e.g. monitoring of home network or synchronising decoder's clock; Client middleware
- H04N21/439—Processing of audio elementary streams
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N5/00—Details of television systems
- H04N5/04—Synchronising
- H04N5/06—Generation of synchronising signals
- H04N5/067—Arrangements or circuits at the transmitter end
- H04N5/073—Arrangements or circuits at the transmitter end for mutually locking plural sources of synchronising signals, e.g. studios or relay stations
- H04N5/0736—Arrangements or circuits at the transmitter end for mutually locking plural sources of synchronising signals, e.g. studios or relay stations using digital storage buffer techniques
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N5/00—Details of television systems
- H04N5/44—Receiver circuitry for the reception of television signals according to analogue transmission standards
- H04N5/60—Receiver circuitry for the reception of television signals according to analogue transmission standards for the sound signals
- H04N5/602—Receiver circuitry for the reception of television signals according to analogue transmission standards for the sound signals for digital sound signals
Definitions
- the invention relates to equipment for use in an audio-video processing system.
- US 5,202,761 discloses an audio synchronizer apparatus having a delay detector for accurately measuring the delay of a video apparatus, coupled with a controllable, variable delay audio delay circuit for accurately delaying an audio frequency signal by substantially the same amount as the video signal delay.
- a typical connection to the audio synchronizer is shown where an alternate delay input from an external video processing device is input through an optional interface.
- the invention provides a video delay control for controlling the video signal processing in dependence on a maximum allowed value for the video signal processing delay. Based on this maximum allowable delay, the video signal processing can be limited to modes that do not entail video processing delays exceeding the maximum allowable delay.
- the invention thus provides a processing system, comprising a video signal processing unit for processing a video signal, the video signal processing entailing a video signal processing delay, and video delay control for controlling said video signal processing unit in dependence on a maximum allowed value for the video signal processing delay.
- the invention also provides an audio-video signal source, comprising an output for sending a video signal to a video signal processing unit, and an output for communicating to the video signal processing unit a maximum allowed value for a video signal processing delay entailed by video signal processing in the video signal processing unit.
- the invention further provides an audio signal processing unit, comprising an audio signal processing unit, said audio signal processing entailing an audio signal processing delay not exceeding a maximum audio delay, and an output for communicating to the video signal processing unit a maximum allowed value for a video signal processing delay entailed by video signal processing in the video signal processing unit, the maximum allowed value for the video signal processing delay depending on the maximum audio delay.
- Fig. 1 shows an embodiment of a system in accordance with the present invention
- Fig. 2 shows an embodiment of a video processing unit in accordance with the present invention.
- Fig. 3 shows an embodiment of an audio-video signal source in accordance with the present invention.
- An audio video signal source AVSS for example a content system
- AVSS will decode and/or generates audio and video.
- This can be a DVD player, a home-cinema set, but also a Set-Top box or a game console. So, the content may originate from a DVD, a network, or be locally generated.
- the user will hear the audio signal AS via the loudspeakers LS with an optional amplifier AMP in-between. This amplifier is optional, because a home- cinema system may have a direct connection to the loudspeakers.
- the video signal is going directly to a video signal processing unit VSPU formed by a TV-set or monitor via an analog or digital interface.
- a communication channel CC for instance CEC, DDC as in DVI and HDMI or an AV- link as in some analog TV systems.
- the video signal processing unit VSPU will process the video signal, and associated to that it may introduce delay in the presentation of the video on the display. This delay is dependent on the processing in the video signal processing unit VSPU (e.g. a TV system), which may be dependent on the video content (film, video, interlaced, progressive, etc.), but also on the user preference (who can force the processing in a specified mode/preferences).
- the information about the delay that is associated with a certain mode/user preference, is stored in the capabilities / status information block VSSIB, which could be accessible via the communication channel from the content system. That information can be used to change the audio processing delay in the content system.
- the audio video signal source AVSS could read the capabilities from the video signal processing unit VSPU indicating the delays in certain modes when it starts to output content on the video signal. If the audio video signal source AVSS is a game console, it could force the video signal processing unit VSPU (by writing to a control location) into the lowest delay mode (needed for games). If the audio video signal source AVSS is a DVD player or a set-top box (STB), it could force the video signal processing unit VSPU into a mode that yields the best quality result on the display, or in a mode that depends on a maximum audio delay that the audio video signal source AVSS (STB/DVD) can compensate.
- STB set-top box
- the video signal processing unit VSPU receives the video content and will dynamically change the processing mode (dependent on content and user settings), as such it will update the capabilities / status information in the memory AVSIB which is accessible from the audio video signal source AVSS.
- video signal processing unit VSPU may generate an interrupt to the audio video signal source AVSS (using the communication channel) to indicate the change.
- the audio video signal source AVSS can periodically sense the status register or optionally respond to the interrupt and change the audio delay according the status and closest to the associated delay.
- the video signal processing unit VSPU In case the video signal processing unit VSPU is not the last unit in a processing chain (if there are additional systems behind it with the same interface), the video signal processing unit VSPU will need to add its delay to the delay of the other devices, or the content system has to read all delays in the chain and add them. Forced TV system mode:
- the video signal processing unit VSPU reads the capabilities from the audio video signal source AVSS (on delay possibilities) and will force the audio video signal source AVSS to additionally delay the audio dependent of its own video processing delay.
- Fig. 2 shows an embodiment of a video processing unit in accordance with the present invention.
- An input video signal is applied to a video input buffer VIB.
- An output of the video input buffer VIB is connected to a memory MEM for processing and additional delay, and to a processing unit PROC for e.g. de-interlacing and scaling.
- the processing unit PROC is controlled by a processing control signal PROCCONT.
- Outputs of the memory MEM and the processing unit PROC are connected to a video output buffer VOB.
- the following processing modes are available:
- Fig. 3 shows an embodiment of an audio-video signal source AVSS in accordance with the present invention.
- TS Transport stream input (for a set top box)
- PS Program stream input (for a DVD or a set top box)
- PTS Presentation Time Stamp (indicates when the picture or audio samples have to be presented on screen or speakers)
- DTS decoding time stamp (indicates when do you need to decode the images/sound, used for reordering)
- PCR program clock recovery (is used to synchronize the receiver clock to the encoder clock).
- the signals TS and PS are applied to a demultiplexer DEMUX for generating an audio elementary stream A-ES, a video elementary stream V-ES, and signals PTS, DTS and PCR.
- a demultiplexer DEMUX for generating an audio elementary stream A-ES, a video elementary stream V-ES, and signals PTS, DTS and PCR.
- a compressed domain CD there is an audio buffer A-buff receiving the audio elementary stream A-ES, and a video buffer V-buff receiving the video elementary stream V- ES.
- the audio and video buffers A-buff and V-buff are controlled by a PLL/sync processing and delay control unit CTRL that receives the signals PTS, DTS and PCR.
- Signals from the audio and video buffers A-buff and V-buff are respectively applied to an audio decoder A- dec and a video decoder V-dec, controlled by the PLL/sync processing and delay control unit CTRL.
- Signals from the audio and video decoders A-dec and V-dec are respectively applied to an audio output buffer A-outbuf and a video output buffer V-outbuf in an uncompressed domain UCD.
- the audio and video output buffers A-outbuf and V-outbuf are also controlled by the PLL/sync processing and delay control unit CTRL.
- the clock control CTRL can delay depending on the requested output delay.
- the control CTRL also controls the decoder (using the decoding timestamps), and also the output (using the presentation time stamp), and it can be possible that at the output the buffers A- outbuf and V-outbuf are used to delay also the video and audio signals before presenting them to the display unit.
- the control unit CTRL is also used to communicate with the display unit on the settings, and a capabilities control memory MEM can be used by the display unit to read out the capabilities of the player.
- the control unit CTRL may also have a connection C for reading TV capabilities and write control.
Landscapes
- Engineering & Computer Science (AREA)
- Multimedia (AREA)
- Signal Processing (AREA)
- Television Receiver Circuits (AREA)
- Two-Way Televisions, Distribution Of Moving Picture Or The Like (AREA)
- Studio Circuits (AREA)
- Picture Signal Circuits (AREA)
- Television Signal Processing For Recording (AREA)
Abstract
Description
Claims
Priority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| EP06765672A EP1889488B1 (en) | 2005-05-24 | 2006-05-08 | Audio-video processing system |
Applications Claiming Priority (3)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| EP05104377 | 2005-05-24 | ||
| PCT/IB2006/051433 WO2006126113A2 (en) | 2005-05-24 | 2006-05-08 | Equipment for audio-video processing system |
| EP06765672A EP1889488B1 (en) | 2005-05-24 | 2006-05-08 | Audio-video processing system |
Publications (2)
| Publication Number | Publication Date |
|---|---|
| EP1889488A2 true EP1889488A2 (en) | 2008-02-20 |
| EP1889488B1 EP1889488B1 (en) | 2012-10-31 |
Family
ID=37188964
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| EP06765672A Expired - Lifetime EP1889488B1 (en) | 2005-05-24 | 2006-05-08 | Audio-video processing system |
Country Status (5)
| Country | Link |
|---|---|
| US (1) | US20080211963A1 (en) |
| EP (1) | EP1889488B1 (en) |
| JP (1) | JP2008543149A (en) |
| CN (1) | CN101180887B (en) |
| WO (1) | WO2006126113A2 (en) |
Families Citing this family (5)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| KR100684999B1 (en) * | 2005-05-27 | 2007-02-20 | 삼성전자주식회사 | Display device and control method |
| JP4360400B2 (en) * | 2006-12-05 | 2009-11-11 | セイコーエプソン株式会社 | Content reproduction system, reproduction apparatus used therefor, and content reproduction method |
| TWI395476B (en) * | 2006-12-20 | 2013-05-01 | Princeton Technology Corp | Method and related device for determining timing sequence of video and audio data for high density multimedia interface |
| US20110164182A1 (en) * | 2010-01-06 | 2011-07-07 | Takashi Wada | Video Processing Apparatus and Video Processing Method |
| CN117795965A (en) * | 2021-10-05 | 2024-03-29 | 三星电子株式会社 | Electronic device and method for controlling the same |
Family Cites Families (13)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| US5202761A (en) * | 1984-11-26 | 1993-04-13 | Cooper J Carl | Audio synchronization apparatus |
| US4703355A (en) * | 1985-09-16 | 1987-10-27 | Cooper J Carl | Audio to video timing equalizer method and apparatus |
| US5387943A (en) * | 1992-12-21 | 1995-02-07 | Tektronix, Inc. | Semiautomatic lip sync recovery system |
| JPH0787080A (en) * | 1993-06-30 | 1995-03-31 | Sony Corp | Decoder device and satellite broadcast receiving system |
| US5530483A (en) * | 1994-10-11 | 1996-06-25 | Pixel Instruments Corp. | Delay detector apparatus and method for plural image sequences |
| US5623483A (en) * | 1995-05-11 | 1997-04-22 | Lucent Technologies Inc. | Synchronization system for networked multimedia streams |
| US6285405B1 (en) * | 1998-10-14 | 2001-09-04 | Vtel Corporation | System and method for synchronizing data signals |
| EP1139665A1 (en) * | 2000-03-29 | 2001-10-04 | Deutsche Thomson-Brandt Gmbh | Method and apparatus for changing the output delay of audio or video data encoding |
| US6906755B2 (en) * | 2002-01-04 | 2005-06-14 | Microsoft Corporation | Method and apparatus for synchronizing audio and video data |
| EP1439712A1 (en) * | 2002-12-17 | 2004-07-21 | Visiowave S.A. | Method of selecting among "Spatial Video CODEC's" the optimum CODEC for a same input signal |
| JP2005338605A (en) * | 2004-05-28 | 2005-12-08 | Toshiba Corp | Display device and display method |
| KR100694060B1 (en) * | 2004-10-12 | 2007-03-12 | 삼성전자주식회사 | Audio video synchronization device and method |
| US7636126B2 (en) * | 2005-06-22 | 2009-12-22 | Sony Computer Entertainment Inc. | Delay matching in audio/video systems |
-
2006
- 2006-05-08 EP EP06765672A patent/EP1889488B1/en not_active Expired - Lifetime
- 2006-05-08 US US11/915,401 patent/US20080211963A1/en not_active Abandoned
- 2006-05-08 JP JP2008512962A patent/JP2008543149A/en active Pending
- 2006-05-08 CN CN2006800177217A patent/CN101180887B/en not_active Expired - Fee Related
- 2006-05-08 WO PCT/IB2006/051433 patent/WO2006126113A2/en not_active Ceased
Non-Patent Citations (1)
| Title |
|---|
| See references of WO2006126113A2 * |
Also Published As
| Publication number | Publication date |
|---|---|
| US20080211963A1 (en) | 2008-09-04 |
| JP2008543149A (en) | 2008-11-27 |
| CN101180887B (en) | 2010-09-29 |
| CN101180887A (en) | 2008-05-14 |
| WO2006126113A2 (en) | 2006-11-30 |
| EP1889488B1 (en) | 2012-10-31 |
| WO2006126113A3 (en) | 2007-02-15 |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| KR100912212B1 (en) | Audiovisualav device and control method thereof | |
| EP1619902A2 (en) | Video apparatus and method for controlling the same | |
| US20190221186A1 (en) | Display device and image signal processing method of the same | |
| KR101168612B1 (en) | Device and method for synchronizing data in digital television receiver | |
| US20070248123A1 (en) | Method and apparatus for compensating audio/video synchronization | |
| US20070024746A1 (en) | Video delay stabilization system and method | |
| EP1889488B1 (en) | Audio-video processing system | |
| JP5283914B2 (en) | Display control apparatus and display control method | |
| JP2017147594A (en) | Audio equipment | |
| US20100166382A1 (en) | Video and audio reproduction system, distribution device, and synchronization adjustment method | |
| KR102729948B1 (en) | Display device and operating method thereof | |
| KR101806901B1 (en) | Apparatus and method for receiving broadcasting | |
| KR100423129B1 (en) | Method for controling data output timing in digital broadcasting receiver | |
| KR102709016B1 (en) | Multimedia device for processing audio/video data and method thereof | |
| US10694240B2 (en) | Method for decoding an audio/video stream and corresponding device | |
| KR20210103114A (en) | Audio apparatus and method of controlling the same | |
| KR101660730B1 (en) | Method for displaying of image and system for displaying of image thereof | |
| KR20100027315A (en) | Display apparatus and control method thereof | |
| JP2009282273A (en) | Video display | |
| JP2017050677A (en) | Content processing apparatus, content processing method, and program | |
| KR20070021083A (en) | Apparatus and method for processing information signals | |
| KR20070101036A (en) | Video processing delay compensation device and method | |
| JP2007274161A (en) | Lip-sync device | |
| KR20070078571A (en) | Apparatus and method for synchronizing video and audio signals in AV system | |
| KR20060090099A (en) | Video equipment and video / audio matching method |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| PUAI | Public reference made under article 153(3) epc to a published international application that has entered the european phase |
Free format text: ORIGINAL CODE: 0009012 |
|
| 17P | Request for examination filed |
Effective date: 20071227 |
|
| AK | Designated contracting states |
Kind code of ref document: A2 Designated state(s): AT BE BG CH CY CZ DE DK EE ES FI FR GB GR HU IE IS IT LI LT LU LV MC NL PL PT RO SE SI SK TR |
|
| 17Q | First examination report despatched |
Effective date: 20080515 |
|
| DAX | Request for extension of the european patent (deleted) | ||
| RAP1 | Party data changed (applicant data changed or rights of an application transferred) |
Owner name: TRIDENT MICROSYSTEMS (FAR EAST) LTD. |
|
| GRAP | Despatch of communication of intention to grant a patent |
Free format text: ORIGINAL CODE: EPIDOSNIGR1 |
|
| RTI1 | Title (correction) |
Free format text: AUDIO-VIDEO PROCESSING SYSTEM |
|
| GRAS | Grant fee paid |
Free format text: ORIGINAL CODE: EPIDOSNIGR3 |
|
| GRAA | (expected) grant |
Free format text: ORIGINAL CODE: 0009210 |
|
| AK | Designated contracting states |
Kind code of ref document: B1 Designated state(s): AT BE BG CH CY CZ DE DK EE ES FI FR GB GR HU IE IS IT LI LT LU LV MC NL PL PT RO SE SI SK TR |
|
| REG | Reference to a national code |
Ref country code: GB Ref legal event code: FG4D Ref country code: CH Ref legal event code: EP |
|
| REG | Reference to a national code |
Ref country code: AT Ref legal event code: REF Ref document number: 582556 Country of ref document: AT Kind code of ref document: T Effective date: 20121115 |
|
| RAP2 | Party data changed (patent owner data changed or rights of a patent transferred) |
Owner name: ENTROPIC COMMUNICATIONS, INC. |
|
| REG | Reference to a national code |
Ref country code: IE Ref legal event code: FG4D |
|
| REG | Reference to a national code |
Ref country code: DE Ref legal event code: R096 Ref document number: 602006032803 Country of ref document: DE Effective date: 20121227 |
|
| REG | Reference to a national code |
Ref country code: AT Ref legal event code: MK05 Ref document number: 582556 Country of ref document: AT Kind code of ref document: T Effective date: 20121031 |
|
| REG | Reference to a national code |
Ref country code: LT Ref legal event code: MG4D |
|
| REG | Reference to a national code |
Ref country code: NL Ref legal event code: VDEP Effective date: 20121031 |
|
| PG25 | Lapsed in a contracting state [announced via postgrant information from national office to epo] |
Ref country code: NL Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT Effective date: 20121031 Ref country code: IS Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT Effective date: 20130228 Ref country code: LT Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT Effective date: 20121031 Ref country code: ES Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT Effective date: 20130211 Ref country code: SE Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT Effective date: 20121031 Ref country code: FI Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT Effective date: 20121031 |
|
| PG25 | Lapsed in a contracting state [announced via postgrant information from national office to epo] |
Ref country code: BE Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT Effective date: 20121031 Ref country code: SI Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT Effective date: 20121031 Ref country code: LV Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT Effective date: 20121031 Ref country code: PT Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT Effective date: 20130228 Ref country code: CY Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT Effective date: 20121031 Ref country code: GR Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT Effective date: 20130201 Ref country code: PL Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT Effective date: 20121031 |
|
| PG25 | Lapsed in a contracting state [announced via postgrant information from national office to epo] |
Ref country code: AT Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT Effective date: 20121031 |
|
| PG25 | Lapsed in a contracting state [announced via postgrant information from national office to epo] |
Ref country code: DK Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT Effective date: 20121031 Ref country code: CZ Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT Effective date: 20121031 Ref country code: EE Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT Effective date: 20121031 Ref country code: SK Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT Effective date: 20121031 Ref country code: BG Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT Effective date: 20130131 |
|
| PG25 | Lapsed in a contracting state [announced via postgrant information from national office to epo] |
Ref country code: IT Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT Effective date: 20121031 Ref country code: RO Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT Effective date: 20121031 |
|
| PLBE | No opposition filed within time limit |
Free format text: ORIGINAL CODE: 0009261 |
|
| STAA | Information on the status of an ep patent application or granted ep patent |
Free format text: STATUS: NO OPPOSITION FILED WITHIN TIME LIMIT |
|
| 26N | No opposition filed |
Effective date: 20130801 |
|
| REG | Reference to a national code |
Ref country code: DE Ref legal event code: R097 Ref document number: 602006032803 Country of ref document: DE Effective date: 20130801 |
|
| PG25 | Lapsed in a contracting state [announced via postgrant information from national office to epo] |
Ref country code: MC Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT Effective date: 20121031 |
|
| REG | Reference to a national code |
Ref country code: CH Ref legal event code: PL |
|
| PG25 | Lapsed in a contracting state [announced via postgrant information from national office to epo] |
Ref country code: CH Free format text: LAPSE BECAUSE OF NON-PAYMENT OF DUE FEES Effective date: 20130531 Ref country code: LI Free format text: LAPSE BECAUSE OF NON-PAYMENT OF DUE FEES Effective date: 20130531 |
|
| REG | Reference to a national code |
Ref country code: IE Ref legal event code: MM4A |
|
| PG25 | Lapsed in a contracting state [announced via postgrant information from national office to epo] |
Ref country code: IE Free format text: LAPSE BECAUSE OF NON-PAYMENT OF DUE FEES Effective date: 20130508 |
|
| REG | Reference to a national code |
Ref country code: FR Ref legal event code: PLFP Year of fee payment: 10 |
|
| PG25 | Lapsed in a contracting state [announced via postgrant information from national office to epo] |
Ref country code: TR Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT Effective date: 20121031 |
|
| PG25 | Lapsed in a contracting state [announced via postgrant information from national office to epo] |
Ref country code: LU Free format text: LAPSE BECAUSE OF NON-PAYMENT OF DUE FEES Effective date: 20130508 Ref country code: HU Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT; INVALID AB INITIO Effective date: 20060508 |
|
| PGFP | Annual fee paid to national office [announced via postgrant information from national office to epo] |
Ref country code: GB Payment date: 20150527 Year of fee payment: 10 |
|
| PGFP | Annual fee paid to national office [announced via postgrant information from national office to epo] |
Ref country code: FR Payment date: 20150519 Year of fee payment: 10 |
|
| PGFP | Annual fee paid to national office [announced via postgrant information from national office to epo] |
Ref country code: DE Payment date: 20160527 Year of fee payment: 11 |
|
| GBPC | Gb: european patent ceased through non-payment of renewal fee |
Effective date: 20160508 |
|
| REG | Reference to a national code |
Ref country code: FR Ref legal event code: ST Effective date: 20170131 |
|
| PG25 | Lapsed in a contracting state [announced via postgrant information from national office to epo] |
Ref country code: FR Free format text: LAPSE BECAUSE OF NON-PAYMENT OF DUE FEES Effective date: 20160531 |
|
| PG25 | Lapsed in a contracting state [announced via postgrant information from national office to epo] |
Ref country code: GB Free format text: LAPSE BECAUSE OF NON-PAYMENT OF DUE FEES Effective date: 20160508 |
|
| REG | Reference to a national code |
Ref country code: DE Ref legal event code: R119 Ref document number: 602006032803 Country of ref document: DE |
|
| PG25 | Lapsed in a contracting state [announced via postgrant information from national office to epo] |
Ref country code: DE Free format text: LAPSE BECAUSE OF NON-PAYMENT OF DUE FEES Effective date: 20171201 |