EP2744129B1 - Verteilungs- und Auswahlsystem von multiplen Audio- und/oder Videoströmen zu aktiven Peripheriegeräten von einem Heimservergerät aus - Google Patents

Verteilungs- und Auswahlsystem von multiplen Audio- und/oder Videoströmen zu aktiven Peripheriegeräten von einem Heimservergerät aus Download PDF

Info

Publication number
EP2744129B1
EP2744129B1 EP13193371.5A EP13193371A EP2744129B1 EP 2744129 B1 EP2744129 B1 EP 2744129B1 EP 13193371 A EP13193371 A EP 13193371A EP 2744129 B1 EP2744129 B1 EP 2744129B1
Authority
EP
European Patent Office
Prior art keywords
group
peripheral
stream
streams
active
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Active
Application number
EP13193371.5A
Other languages
English (en)
French (fr)
Other versions
EP2744129A1 (de
Inventor
Nicolas Pouillon
Romain Fliedel
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
Freebox SAS
Original Assignee
Freebox SAS
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Freebox SAS filed Critical Freebox SAS
Publication of EP2744129A1 publication Critical patent/EP2744129A1/de
Application granted granted Critical
Publication of EP2744129B1 publication Critical patent/EP2744129B1/de
Active legal-status Critical Current
Anticipated expiration legal-status Critical

Links

Images

Classifications

    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04H—BROADCAST COMMUNICATION
    • H04H60/00—Arrangements for broadcast applications with a direct linking to broadcast information or broadcast space-time; Broadcast-related systems
    • H04H60/76—Arrangements characterised by transmission systems other than for broadcast, e.g. the Internet
    • H04H60/78—Arrangements characterised by transmission systems other than for broadcast, e.g. the Internet characterised by source locations or destination locations
    • H04H60/80—Arrangements characterised by transmission systems other than for broadcast, e.g. the Internet characterised by source locations or destination locations characterised by transmission among terminal devices
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04H—BROADCAST COMMUNICATION
    • H04H60/00—Arrangements for broadcast applications with a direct linking to broadcast information or broadcast space-time; Broadcast-related systems
    • H04H60/76—Arrangements characterised by transmission systems other than for broadcast, e.g. the Internet
    • H04H60/81—Arrangements characterised by transmission systems other than for broadcast, e.g. the Internet characterised by the transmission system itself
    • H04H60/82—Arrangements characterised by transmission systems other than for broadcast, e.g. the Internet characterised by the transmission system itself the transmission system being the Internet

Definitions

  • the invention relates to the distribution of multiple audio and / or video streams in the same house, house or apartment.
  • audio and / or video stream or “AV stream”
  • AV stream we mean content that can be audio only (music, radio %), only video (slideshow %) or both audio and video (television , cinema ).
  • the streams can be received live (conventional TV multicast) or can be present as recordings stored on one of the equipment present in the home or remote.
  • the present invention is mainly exposed in the context of an audio stream broadcast, it will be understood that this application is not limiting and that the invention applies equally well to the broadcasting of video or audio and video streams.
  • the selection by a user of the stream that he wishes to receive in the room where he is located requires the application of selection commands of source. These commands can be applied directly to the server, but this requires a movement of the user between the listening location and the server, or indirectly by a remote control, which may be a specific object or a smartphone with a remote control application.
  • the US 2006/0248557 A1 describes a control interface for grouping multiple media devices into separate sets that can be associated with particular playlists .
  • This interface uses conventional means with movement keys, navigation in menus, etc. which in practice prove to be rather inconvenient to use.
  • the EP 1 998 566 A1 describes another technique, adapted to the transmission of multimedia broadcast multicast data by a wireless telecommunications network, where the incorporation of a marker to a packet header makes it possible to restrict the broadcast to a restricted set of selected recipients .
  • the object of the invention is to propose a simplified interface, using neither display nor movement keys to modify the "assignment" parameters of the groups, that is to say the parameters defining the distribution of peripherals between separate groups to reproduce different respective AV streams.
  • the object of the invention is to provide the user with a simplified ergonomic interface, essentially by means of a single key dedicated to the aforementioned function of managing the assignment parameters.
  • the invention will provide a system for tracking the movement and the wishes of the user in different rooms of the house, with a quick reconfiguration of active devices.
  • the invention makes it possible to control these different actions directly from the active device, without complex interface and without the use of any dedicated or programmed remote control in a smartphone.
  • the invention proposes a system of the general type disclosed by the US 2006/0248557 A1 above, that is to say comprising the elements set forth in the preamble of claim 1.
  • the present invention is remarkable in that it comprises, to achieve the purposes indicated above, the elements set forth in the characterizing part of claim 1.
  • the Figure 1 schematically represents the AV flow distribution system according to the invention, installed in the same house (house or apartment) and organized around a centralized equipment 10 forming domestic server.
  • the AV streams are audio streams (music, radio %), but as we explained in the introduction this example is not limiting and the description below can be transposed to the broadcast of stream both audio and video (television, cinema %), or purely video stream (slideshow ).
  • the server equipment 10 is a box-type equipment (box) connected to an Internet access provider by an ADSL wired link or by an FTTH-type fiber optic link.
  • An example of such a box is the equipment distributed by the operator Free, Paris, France under the name Freebox HD or Freebox V6.
  • It is a multifunctional interface box comprising an ADSL / FTTH modem and implementing telephony, IP network (wired Ethernet or Wi-Fi wireless network), television and mobile (for example at the same time). using a femtocell technology).
  • the IP network makes it possible to connect the housing 10 to a plurality of active peripherals here of the "active speaker" type 14 arranged in different rooms of the dwelling, each of these speakers being connected to the box 10 by a link 16 which can be a wired link, via an Ethernet network installed in the home, or a link via CPL boxes (in-line carrier lines) for exchanging digital data via the pre-existing power lines 230 V-50 Hz by passing the information between the server 10 and the active speakers 14 by modulation of one or more carriers (an example of such a CPL box is the combined power supply / module CPL module) called Freeplug manufactured by the Free Internet Service Provider , Paris, France, which is intended to supply the box- type equipment of this access provider).
  • Another possibility of data exchange between the server 10 and the active speakers is a wireless transmission type Wi-Fi, if the house does not have too many obstacles to radio transmission.
  • the active device 14 may be in a form other than an active speaker, for example a box-type equipment, intended to be connected to a TV but knowing as well as restoring only audio and on which would be added the necessary control keys, or equipment equipped with a processor and a "line" audio output but without speaker, intended to be connected to a Hi-Fi system.
  • the server 10 can also be connected to a television 18 via a multimedia box 20, for example the equipment distributed by the operator Free under the name Freebox HD or Freebox Player : such a box integrates video decoder, hard disk, digital video recorder, and software for graphical display on the television and reception and processing of commands sent by the user, in particular for the configuration of the multimedia box 20 and the server 10.
  • a multimedia box 20 for example the equipment distributed by the operator Free under the name Freebox HD or Freebox Player : such a box integrates video decoder, hard disk, digital video recorder, and software for graphical display on the television and reception and processing of commands sent by the user, in particular for the configuration of the multimedia box 20 and the server 10.
  • the Figure 2 illustrates more precisely, in the form of functional blocks, the various elements implemented by the server equipment 10.
  • This may in particular comprise an interface 22 with the remote access provider to which it is connected by the ADSL / FTTH link 12, enabling it in particular to receive audio streams from outside, intended to be broadcast to the various occupants of the dwelling.
  • it may be an interfacing with a server local source of audio stream, for example via a web browser configured appropriately.
  • the generally limited capabilities of the technologies used do not allow a simultaneous broadcast multicast of all audio streams to the different active speakers.
  • the links between the server 10 and the active speakers 14 are in fact point-to-point links, with a single audio stream broadcast to each device at a given time, but functionally each speaker can have access to any of the streams potentially accessible audio, by an appropriate stream selection command addressed to the server.
  • the audio streams collected, downloaded and / or stored in memory are processed by a microcontroller 26 which delivers in parallel a certain number of audio streams 28 simultaneously generated and multiplexed in 30 for broadcasting to the different active speakers on the broadcast links 16 by the via a Wi-Fi 32 or Ethernet 34 interface.
  • the Figure 3 illustrates in the form of a functional block diagram the internal structure of an active loudspeaker 14.
  • This is an "amplified loudspeaker" type apparatus devoid of an own audio source (at least for the implementation of the invention ), which receives the audio streams broadcast by the server 10 via the link 16.
  • the active speaker 14 comprises Wi-Fi reception circuits 36 or Ethernet 38 for collecting the audio streams for application to a microcontroller 40.
  • This microcontroller selects one of the audio streams received from those that are broadcast by the server, and applies this flux to an amplifier 42 for driving a loudspeaker 44.
  • the active speaker is further provided with a control interface comprising, as illustrated in more detail Figure 4 , a set 46 of control keys, in themselves conventional (volume +/-, speaker cut, playback / pause, accelerated forward / backward or previous / next track).
  • each active speaker is further provided with a specific control interface 48 comprising a change of assignment key 52, the role and operation of which will be explained later, in particular with reference to FIGS. Figures 6 and 7 , this key 52 being coupled with a colored indicator 54 may take a plurality of different colors each corresponding to one of the audio stream broadcast by the central server.
  • control interface of the active speaker is in a very simplified form, and thus allows an extremely convenient and intuitive use by any user.
  • This interface is in particular devoid of graphical interface with display, drop-down menu, etc.
  • the Figures 5a to 5d illustrate an example of evolution of the audio streaming patterns over time in a dwelling.
  • the dwelling is an apartment including a living room (SEJ), a kitchen (CUI), a terrace (TER), three bedrooms (CH1, CH2, CH3) and a bathroom (SDB).
  • SEJ living room
  • CLI kitchen
  • TER terrace
  • CH1, CH2, CH3 three bedrooms
  • SDB bathroom
  • each of these rooms is installed an active speaker 14 coupled to a single server equipment disposed at any point of the dwelling and simultaneously broadcasting a plurality of audio streams that can be received by each of the active speakers 14, all the audio streams being from the same equipment, namely the central server, unique for housing.
  • the server was previously set to select the audio streams to be broadcast, by any conventional appropriate means: by the TV remote control 18 via the multimedia box 20, by a computer coupled to the server 10, by a smartphone on which was loaded a remote control application, etc.
  • this broadcast table is to answer the question "Which speakers broadcast which stream?" , knowing that it is possible to define several groups each corresponding to a broadcast of a different audio stream, and that a speaker belongs to at most only one group (a speaker only broadcasts a single stream, or no flow).
  • This broadcasting table is an evolutive table, modifiable over time according to the different selections made by the users at each active speaker.
  • a sound environment can also exist virtually, that is to say be broadcast by the server but not reproduced by any active speaker, as in the case of the Figure 5a where the parental sound is not present on any of the active speakers.
  • Sound environment changes are controlled by the illustrated interface Figure 4 , thanks in particular to the change of assignment key 52 which makes it possible to join an existing group or to create a new one, the colored indicator light 54 providing a return as to the current choice of the group.
  • pressing the "play" button 56 triggers the listening of a new sound environment, which is still not reproduced by any of the active speakers of the house.
  • pressing the key 52 makes it possible to successively explore all the groups present, that is to say those that are broadcast on at least one active speaker of the dwelling (block 60), with control of the indicator colored 54 which has a multicolored LED, each color corresponding to a different group.
  • the Figure 7 illustrates the main steps to determine a group to create or join.
  • the speaker After pressing the key 52 (block 70), it is determined whether the speaker is the only one of the current group (block 72). If this is the case, the group is deleted (block 74), possibly with a delay. In any case, the next group is selected (block 76): if this group has already been presented to the user (block 78) a new group is created (block 80). Then the active speaker joins either this new group created or the current group selected (block 82), and waits for a command from the user (block 84), including a press of the play button 56.
  • persistent groups that is to say groups that will survive the last constituent element and therefore can not be deleted.
  • These groups can, for example, correspond to a favorite radio station, a personal playlist , etc., so that the corresponding sound environment can be reached by pressing the key 52 without any new setting of the server.
  • the formation of persistent groups makes it possible to provide users with a quick way of recovering their favorite sound environment, and a particular color can be assigned to these groups for the colored indicator 54, which will be used systematically to designate them, thus making it possible to do without GUI for current use.

Landscapes

  • Engineering & Computer Science (AREA)
  • Signal Processing (AREA)
  • Two-Way Televisions, Distribution Of Moving Picture Or The Like (AREA)

Claims (6)

  1. System zur Verteilung von Audio- und/oder Video-, AV-, Strömen, umfassend:
    - eine Mehrzahl von aktiven Peripheriegeräten (14), jedes umfassend:
    • Mittel (36, 38) zum Empfang von einer Mehrzahl von Kanälen zur Verteilung einer entsprechenden Mehrzahl von AV-Strömen;
    • Steuermittel (40, 46, 48), die Mittel zur Auswahl eines der Kanäle aus der Mehrzahl von Kanälen umfassen;
    • eine Schnittstelle (46, 48) zur Überwachung der Wiedergabe des AV-Stroms; und
    • Mittel zur Audio- und/oder Video-Wiedergabe zur Verstärkung (42, 44) des AV-Stroms des gewählten Kanals durch die Steuermittel,
    - eine Heim-Serverausrüstung (10), umfassend:
    • Mittel (22, 24, 26) zum Empfang und/oder zur Speicherung einer Mehrzahl von AV-Strömen; und
    • Mittel (30, 32, 34) zur Verteilung der AV-Ströme zu den aktiven Peripheriegeräten hin über eine Mehrzahl von jeweiligen aktiven Kanälen,
    wobei diese Serverausrüstung (10) eine Verteilungstabelle speichert, die eine Konfiguration einer oder mehreren Gruppen definiert, die jede mindestens ein aktives Peripheriegerät verbinden, wobei ein Peripheriegerät höchstens nur einer einzigen Gruppe zugehörig ist, wobei jede Gruppe einem unterschiedlichen AV-Strom zugeordnet ist und die Gruppen auf dynamische Weise definiert sind, die nach Belieben im Laufe der Zeit veränderbar ist, dadurch gekennzeichnet, dass die Mittel zum Steuern jedes aktiven Peripheriegerätes (14) Folgendes aufweisen:
    • die Schnittstelle (46, 48) zur Überwachung der Wiedergabe des AV-Stroms, umfassend eine spezifische Multifunktionstaste (52) zur Zuweisungsänderung:
    • Mittel für den Zugriff auf die durch die Serverausrüstung gespeicherte Verteilungstabelle, in der Form, dass die vorhandenen Gruppen durch Auswahl der Kanäle entsprechend den in der Verteilungstabelle angegebenen AV-Strömen abgefragt werden; und
    • Mittel, um, wahlweise:
    a) mit einer Wiedergabe-/Pause-Taste (56) der Schnittstelle (46, 48) zur Überwachung der Wiedergabe des AV-Stroms und ohne Drücken der spezifischen Multifunktionstaste (52) zur Zuweisungsänderung die Verteilung des AV-Stroms der Gruppe, dem das Peripheriegerät zugehörig ist, zu beginnen,
    b) durch einfaches oder mehrfaches Drücken der spezifischen Multifunktionstaste (52) zur Zuweisungsänderung bis zur Auswahl des Kanals, der einer vorhandenen Gruppe entspricht, die Verbindung zu der vorhandenen Gruppe herzustellen, der das Peripheriegerät nicht zugehörig ist;
    c) durch einfaches oder mehrfaches Drücken der spezifischen Multifunktionstaste (52) zur Zuweisungsänderung, nachdem alle Kanäle der vorhandenen Gruppen nacheinander ausgewählt wurden, eine neue Gruppe zu erstellen; und
    d) durch Drücken der spezifischen Multifunktionstaste (52) zur Zuweisungsänderung, wenn die Gruppe, der das Peripheriegerät zugehörig ist, eine Gruppe ist, die nur dieses einzige Peripheriegerät enthält, die Gruppe, der das Peripheriegerät zugehörig ist, zu löschen,
    wobei die Aktionen b), c) und d) mit der Versendung, an die Serverausrüstung, eines entsprechenden Befehls zur Neukonfiguration der Gruppen, die in der Lage sind, eine Aktualisierung der Verteilungstabelle durchzuführen, durchgeführt werden.
  2. System nach Anspruch 1, wobei die Mittel zum d) Löschen der Gruppe, der das Peripheriegerät zugehörig ist, Mittel sind, die mit Abwarten einer Zeitverzögerung nach dem Drücken der spezifischen Multifunktionstaste (52) ohne weitere externe Aktion eines Benutzers auf die Überwachungsschnittstelle aktivierbar sind.
  3. System nach Anspruch 1, wobei die Mittel zum a) Beginnen der Verteilung des AV-Stroms der Gruppe, der das Peripheriegerät zugehörig ist, Mittel sind, die durch Drücken einer Wiedergabetaste (56) der Überwachungsschnittstelle aktivierbar sind.
  4. System nach Anspruch 1, wobei jedes aktive Peripheriegerät Mittel zur Anzeige (54) des aktuellen gewählten Verteilungskanals umfasst.
  5. System nach Anspruch 4, wobei die Anzeigemittel (54) ein farbiges Anzeigeelement umfassen, das in der Lage ist, für jeden unterschiedlichen gewählten Verteilungskanal eine unterschiedliche Farbe zu erzeugen.
  6. System nach Anspruch 1, wobei die Heim-Serverausrüstung ferner Mittel (22) für die Schnittstellenverbindung mit einem entlegenen oder lokalen Server für den Zugriff auf die Mehrzahl von AV-Strömen umfasst.
EP13193371.5A 2012-12-11 2013-11-18 Verteilungs- und Auswahlsystem von multiplen Audio- und/oder Videoströmen zu aktiven Peripheriegeräten von einem Heimservergerät aus Active EP2744129B1 (de)

Applications Claiming Priority (1)

Application Number Priority Date Filing Date Title
FR1261861A FR2999365B1 (fr) 2012-12-11 2012-12-11 Systeme de distribution et de selection de flux audio et/ou video multiples vers des peripheriques actifs a partir d'un equipement serveur domestique

Publications (2)

Publication Number Publication Date
EP2744129A1 EP2744129A1 (de) 2014-06-18
EP2744129B1 true EP2744129B1 (de) 2019-01-09

Family

ID=47754746

Family Applications (1)

Application Number Title Priority Date Filing Date
EP13193371.5A Active EP2744129B1 (de) 2012-12-11 2013-11-18 Verteilungs- und Auswahlsystem von multiplen Audio- und/oder Videoströmen zu aktiven Peripheriegeräten von einem Heimservergerät aus

Country Status (3)

Country Link
EP (1) EP2744129B1 (de)
ES (1) ES2719695T3 (de)
FR (1) FR2999365B1 (de)

Family Cites Families (3)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US20060248557A1 (en) * 2005-04-01 2006-11-02 Vulcan Inc. Interface for controlling device groups
KR100800690B1 (ko) * 2006-02-10 2008-02-01 삼성전자주식회사 디지털 방송 서비스 시스템에서 방송 데이터 전송 장치 및방법
WO2008032371A1 (en) * 2006-09-13 2008-03-20 Kddi Corporation Broadcast contents transmitting device, and broadcast contents transmitting method

Non-Patent Citations (1)

* Cited by examiner, † Cited by third party
Title
None *

Also Published As

Publication number Publication date
FR2999365B1 (fr) 2018-04-27
FR2999365A1 (fr) 2014-06-13
ES2719695T3 (es) 2019-07-12
EP2744129A1 (de) 2014-06-18

Similar Documents

Publication Publication Date Title
US11467799B2 (en) Guest access to a media playback system
US9213230B1 (en) Collaborative configuration of a media environment
CN110335631B (zh) 用于媒体体验社交界面的系统和方法
US9374607B2 (en) Media playback system with guest access
FR2895869A1 (fr) Systeme de distribution sans fil d'un signal audio entre une pluralite d'enceintes actices
EP3826316B1 (de) Decodiergerät, das eine anweisung eines anzuwendenden audioprofils erzeugt
JP2015529879A (ja) ローカル再生システム情報の収集および提供
WO2014089077A1 (en) Mobile source media content access
EP4059224A1 (de) Wiedergabewarteschlangen für gemeinsame erfahrungen
US20060136960A1 (en) System for providing a distributed audience response to a broadcast
US20250088720A1 (en) Content Playback Reminders
FR3111040A1 (fr) Traitement centralisé d’un flux audio d’entrée
EP1579691B1 (de) Verfahren zum hervorbringen einer liste von inhalten in einermit einem nationalen netzwerk verbundenen einrichtung und mit dem verfahrenassoziierte einrichtung
EP2744129B1 (de) Verteilungs- und Auswahlsystem von multiplen Audio- und/oder Videoströmen zu aktiven Peripheriegeräten von einem Heimservergerät aus
CA3176129C (en) Priority media content
EP3889762B1 (de) Verfahren zur verwaltung mindestens einer gruppe von tonwiedergabegeräten
EP3890348B1 (de) Audioinstallation und verfahren zur anwendung eines satzes von ausgleichsparametern
FR3114677A1 (fr) Procédé de restitution sonore
EP3001412A1 (de) Tonwiedergabesystem mit audio-headsets, die mit klangprozessoren ausgestattet sind, komponenten eines solchen systems und entsprechendes verfahren
EP2854415A1 (de) Dynamisches Übertragungsverfahren von Informationsdaten über ein Audio- und/oder Videoprogramm
JP2017225151A (ja) メディアシステムにおけるマルチチャンネルペアリング
JP2016076974A (ja) メディアシステムにおけるマルチチャンネルペアリング
FR2938145A1 (fr) Traitement d'une requete destinee a un serveur interactif de guide des programmes, equipement de reception et serveur interactif associes

Legal Events

Date Code Title Description
PUAI Public reference made under article 153(3) epc to a published international application that has entered the european phase

Free format text: ORIGINAL CODE: 0009012

17P Request for examination filed

Effective date: 20131118

AK Designated contracting states

Kind code of ref document: A1

Designated state(s): AL AT BE BG CH CY CZ DE DK EE ES FI FR GB GR HR HU IE IS IT LI LT LU LV MC MK MT NL NO PL PT RO RS SE SI SK SM TR

AX Request for extension of the european patent

Extension state: BA ME

R17P Request for examination filed (corrected)

Effective date: 20141216

RBV Designated contracting states (corrected)

Designated state(s): AL AT BE BG CH CY CZ DE DK EE ES FI FR GB GR HR HU IE IS IT LI LT LU LV MC MK MT NL NO PL PT RO RS SE SI SK SM TR

STAA Information on the status of an ep patent application or granted ep patent

Free format text: STATUS: EXAMINATION IS IN PROGRESS

17Q First examination report despatched

Effective date: 20170908

GRAP Despatch of communication of intention to grant a patent

Free format text: ORIGINAL CODE: EPIDOSNIGR1

STAA Information on the status of an ep patent application or granted ep patent

Free format text: STATUS: GRANT OF PATENT IS INTENDED

INTG Intention to grant announced

Effective date: 20180719

GRAS Grant fee paid

Free format text: ORIGINAL CODE: EPIDOSNIGR3

GRAA (expected) grant

Free format text: ORIGINAL CODE: 0009210

STAA Information on the status of an ep patent application or granted ep patent

Free format text: STATUS: THE PATENT HAS BEEN GRANTED

AK Designated contracting states

Kind code of ref document: B1

Designated state(s): AL AT BE BG CH CY CZ DE DK EE ES FI FR GB GR HR HU IE IS IT LI LT LU LV MC MK MT NL NO PL PT RO RS SE SI SK SM TR

REG Reference to a national code

Ref country code: GB

Ref legal event code: FG4D

Free format text: NOT ENGLISH

REG Reference to a national code

Ref country code: CH

Ref legal event code: EP

Ref country code: AT

Ref legal event code: REF

Ref document number: 1088643

Country of ref document: AT

Kind code of ref document: T

Effective date: 20190115

REG Reference to a national code

Ref country code: DE

Ref legal event code: R096

Ref document number: 602013049483

Country of ref document: DE

REG Reference to a national code

Ref country code: IE

Ref legal event code: FG4D

Free format text: LANGUAGE OF EP DOCUMENT: FRENCH

REG Reference to a national code

Ref country code: CH

Ref legal event code: NV

Representative=s name: VALIPAT S.A. C/O BOVARD SA NEUCHATEL, CH

REG Reference to a national code

Ref country code: NL

Ref legal event code: FP

REG Reference to a national code

Ref country code: LT

Ref legal event code: MG4D

REG Reference to a national code

Ref country code: ES

Ref legal event code: FG2A

Ref document number: 2719695

Country of ref document: ES

Kind code of ref document: T3

Effective date: 20190712

REG Reference to a national code

Ref country code: AT

Ref legal event code: MK05

Ref document number: 1088643

Country of ref document: AT

Kind code of ref document: T

Effective date: 20190109

PG25 Lapsed in a contracting state [announced via postgrant information from national office to epo]

Ref country code: PT

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20190509

Ref country code: FI

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20190109

Ref country code: PL

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20190109

Ref country code: LT

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20190109

Ref country code: SE

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20190109

Ref country code: NO

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20190409

PG25 Lapsed in a contracting state [announced via postgrant information from national office to epo]

Ref country code: HR

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20190109

Ref country code: GR

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20190410

Ref country code: LV

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20190109

Ref country code: IS

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20190509

Ref country code: BG

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20190409

Ref country code: RS

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20190109

REG Reference to a national code

Ref country code: DE

Ref legal event code: R097

Ref document number: 602013049483

Country of ref document: DE

PG25 Lapsed in a contracting state [announced via postgrant information from national office to epo]

Ref country code: CZ

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20190109

Ref country code: EE

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20190109

Ref country code: AT

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20190109

Ref country code: RO

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20190109

Ref country code: DK

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20190109

Ref country code: AL

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20190109

Ref country code: SK

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20190109

PLBE No opposition filed within time limit

Free format text: ORIGINAL CODE: 0009261

STAA Information on the status of an ep patent application or granted ep patent

Free format text: STATUS: NO OPPOSITION FILED WITHIN TIME LIMIT

PG25 Lapsed in a contracting state [announced via postgrant information from national office to epo]

Ref country code: SM

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20190109

26N No opposition filed

Effective date: 20191010

PG25 Lapsed in a contracting state [announced via postgrant information from national office to epo]

Ref country code: SI

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20190109

PG25 Lapsed in a contracting state [announced via postgrant information from national office to epo]

Ref country code: TR

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20190109

PG25 Lapsed in a contracting state [announced via postgrant information from national office to epo]

Ref country code: MC

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20190109

Ref country code: LU

Free format text: LAPSE BECAUSE OF NON-PAYMENT OF DUE FEES

Effective date: 20191118

PG25 Lapsed in a contracting state [announced via postgrant information from national office to epo]

Ref country code: IE

Free format text: LAPSE BECAUSE OF NON-PAYMENT OF DUE FEES

Effective date: 20191118

PG25 Lapsed in a contracting state [announced via postgrant information from national office to epo]

Ref country code: CY

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20190109

PG25 Lapsed in a contracting state [announced via postgrant information from national office to epo]

Ref country code: MT

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20190109

Ref country code: HU

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT; INVALID AB INITIO

Effective date: 20131118

PG25 Lapsed in a contracting state [announced via postgrant information from national office to epo]

Ref country code: MK

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20190109

REG Reference to a national code

Ref country code: CH

Ref legal event code: U11

Free format text: ST27 STATUS EVENT CODE: U-0-0-U10-U11 (AS PROVIDED BY THE NATIONAL OFFICE)

Effective date: 20251201

PGFP Annual fee paid to national office [announced via postgrant information from national office to epo]

Ref country code: NL

Payment date: 20251119

Year of fee payment: 13

PGFP Annual fee paid to national office [announced via postgrant information from national office to epo]

Ref country code: DE

Payment date: 20251118

Year of fee payment: 13

PGFP Annual fee paid to national office [announced via postgrant information from national office to epo]

Ref country code: GB

Payment date: 20251120

Year of fee payment: 13

PGFP Annual fee paid to national office [announced via postgrant information from national office to epo]

Ref country code: IT

Payment date: 20251128

Year of fee payment: 13

PGFP Annual fee paid to national office [announced via postgrant information from national office to epo]

Ref country code: FR

Payment date: 20251112

Year of fee payment: 13

PGFP Annual fee paid to national office [announced via postgrant information from national office to epo]

Ref country code: BE

Payment date: 20251118

Year of fee payment: 13

PGFP Annual fee paid to national office [announced via postgrant information from national office to epo]

Ref country code: CH

Payment date: 20251201

Year of fee payment: 13

PGFP Annual fee paid to national office [announced via postgrant information from national office to epo]

Ref country code: ES

Payment date: 20251216

Year of fee payment: 13