EP3317868B1 - Virtuelle fernsteuerung - Google Patents

Virtuelle fernsteuerung Download PDF

Info

Publication number
EP3317868B1
EP3317868B1 EP16741881.3A EP16741881A EP3317868B1 EP 3317868 B1 EP3317868 B1 EP 3317868B1 EP 16741881 A EP16741881 A EP 16741881A EP 3317868 B1 EP3317868 B1 EP 3317868B1
Authority
EP
European Patent Office
Prior art keywords
touch
zones
zone
remote equipment
remote
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Active
Application number
EP16741881.3A
Other languages
English (en)
French (fr)
Other versions
EP3317868A1 (de
Inventor
David SOUHAMI
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
Softathome SA
Original Assignee
Softathome SA
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Softathome SA filed Critical Softathome SA
Priority to PL16741881T priority Critical patent/PL3317868T3/pl
Publication of EP3317868A1 publication Critical patent/EP3317868A1/de
Application granted granted Critical
Publication of EP3317868B1 publication Critical patent/EP3317868B1/de
Active legal-status Critical Current
Anticipated expiration legal-status Critical

Links

Images

Classifications

    • GPHYSICS
    • G08SIGNALLING
    • G08CTRANSMISSION SYSTEMS FOR MEASURED VALUES, CONTROL OR SIMILAR SIGNALS
    • G08C17/00Arrangements for transmitting signals characterised by the use of a wireless electrical link
    • G08C17/02Arrangements for transmitting signals characterised by the use of a wireless electrical link using a radio link
    • GPHYSICS
    • G08SIGNALLING
    • G08CTRANSMISSION SYSTEMS FOR MEASURED VALUES, CONTROL OR SIMILAR SIGNALS
    • G08C2201/00Transmission systems of control signals via wireless link
    • G08C2201/30User interface

Definitions

  • the present invention relates to a portable electronic device used as a remote control for remote equipment such as a television set-top box connected to a television set.
  • the interaction between a user and the television is based on the conventional use of a remote control making it possible to control the desired actions such as zapping, going to standby, access to the program guide, configuration, etc. ..
  • the user adapts to his remote control, the number of keys of which varies according to the ergonomics associated with the interface of the television.
  • the way to use the keys of this remote control, their actions are all things predefined by the supplier of the TV screen, Set Top Box or other device controlling the display on the TV screen.
  • remote controls where a key is associated with a function (EPG, VOD, source selection, ...)
  • remote controls where a combination of several presses is necessary to access a function.
  • the user In the first case, the user must carefully look at his remote control to read the functions to launch, in the last case, the Human Machine interface is crucial to minimize the number of key presses to allow access to services.
  • the conventional remote control is not visible and the virtual remote control requires a backlight to be visible, therefore a non-negligible consumption of energy.
  • the present invention relates to a virtual remote control which can be used without necessarily visually verifying where it is pressed.
  • the present invention also relates to a virtual remote control capable of operating on a tactile object without a screen.
  • Another object of the invention is a virtual remote control usable in the dark.
  • the arrangement of the zones according to the invention allows a user to easily place his finger on the desired zone without looking at the tactile surface. Overall, it is simple to mechanically locate the upper part, the lower part and the central part of a tactile surface.
  • the device according to the invention makes it possible to reconsider the principle of a remote control, by using tactile zones rather than buttons, associated with gestures.
  • it can be a “smartphone” type mobile phone, a touchscreen tablet or mouse, a touchpad or any other device having a touchscreen and a processing unit (detection, filtering, recognition, conversion, ...) able to process actions performed on the touch surface.
  • the processing unit is therefore configured to carry out a correspondence between on the one hand predefined and parameterized gestures in the software application and on the other hand control signals understandable by the remote equipment.
  • You can define simple gestures, each gesture being associated with a TV control function.
  • the software application can integrate several correspondence tables between gestures and a set of commands for each TV manufacturer.
  • the support zones according to the invention are designed to receive the thumb of the user. Their arrangement at the ends of the touch surface allows easy and error-free use. For example, one support area can be set for incrementing TV channels, while the other support area can be set for decrement.
  • the processing unit is configured to process only punctual actions, that is to say short or long presses making it possible to generate a command to increase or decrease one or more arbitrary units.
  • the central zone is capable of receiving instructions in the form of gestures made by a finger or several fingers of a user.
  • the central area is wide enough for the user to carry out his gestures without having to observe the tactile surface.
  • the division into three zones of the tactile surface with two support zones at the end is particularly judicious because these three zones, two for specific commands and one for gestures, make it possible to address all the commands of a classic remote control without representation of a multitude of active keys on the touch surface. The commands can thus be carried out without looking at the tactile surface.
  • the touch surface can be a touch screen, for example like that of a mobile telephone of the “smartphone” type or of a tablet.
  • the pressing actions on keys perfectly calibrated to the size of a finger, on a conventional remote control in particular, are transformed into local gestures making it possible to have the same remote actions. These gestures must make it possible to keep your eyes fixed only on a screen, the one you control.
  • a sound unit capable of being activated in response to the generation of a control signal to the remote equipment.
  • an audible signal alerts the user when a press has been validated on one of the two support zones or when a gesture has been made on the central zone.
  • the device according to the invention can comprise a vibratory unit able to be activated in response to the generation of a control signal to the remote equipment.
  • the device vibrates in the event of an order validated on the touch surface.
  • the vibration mode can be combined with the sound mode.
  • the device according to the invention may comprise a visual unit capable of being activated in response to the generation of a control signal to the remote equipment.
  • the visual unit can advantageously be the screen of the device which can be in unlit mode except when a command (a press or a gesture) has been validated by the processing unit.
  • the screen In lit mode, the screen can be lit on the entire surface or simply on the part concerned by the identified command: that is to say on the central part when a gesture has been identified in this central zone, on the '' one of the support zones when support has been identified in the affected area.
  • the lighting can last a certain time or be repetitive.
  • the screen of the device can be in illuminated mode when performing the gestures or the support.
  • the validation of an order can be done by flashing all or part of the screen.
  • the device according to the invention can comprise at least one transmitter for wireless transmission of the control signals with the remote equipment.
  • the remote equipment is a transceiver for two-way wireless communication of the control signals with the remote equipment.
  • the remote equipment also includes directional communications means. It can also be envisaged that an acknowledgment of receipt is sent by the remote equipment when an order has been correctly received by the latter.
  • the two support zones are located on the upper part and the lower part respectively.
  • the two support zones are far enough apart that the user is not mistaken between them.
  • the one at the top can correspond to an increment.
  • the one at the bottom may correspond to a decrement.
  • each support zone is a strip over the entire length of the side where it is located.
  • the support zone has a length greater than that of the region between the two corners on the same side of the touch surface. In this way, the thumb can more easily reach the support areas.
  • the decoder unit 2 transmits to the television set 4 one or more video streams such as television channels to be viewed.
  • the signals generated are transported between the set-top box 2 and the television set 4 by an HDMI cable 5.
  • the decoder unit 2 further comprises a BLE signal transmitter (not shown).
  • the smartphone 3 also includes a BLE signal transmitter and can thus be in communication over a wireless link L with the decoder unit 2.
  • the smartphone 3 is used as a remote control for the set-top box 2, a remote control which therefore has the function of controlling changes of channels, variation of the volume, navigation in different menus, commands for video playback ...
  • the present invention can also be implemented by using the smartphone as a remote control for the television only or possibly both devices.
  • the touch screen or touch surface 8 of the smartphone 3 will be used as an input interface for commands from the remote equipment. Using his finger, the user will make gestures and presses on the touch screen 8. Unlike the prior art, the user does not press graphic objects symbolizing the keys of a remote control classic. It is no longer a simple emulation or software reproduction of a classic remote control but a new design, a new interpretation of the remote control.
  • buttons on a conventional remote control are as follows: Button Type of support Associated action P + Short Program +: Allows you to zap to the next channel Long Fast channel scrolling P- Short Program -: Allows you to zap on the previous channel Long Fast channel scrolling MENU or HOME Short Access to the main application menu Long okay Short Validation Long 0 1 ... 9 Short Numbers to jump directly to a specific channel ⁇ ⁇ ⁇ ⁇ Short Navigation arrows Long Fast scrolling ⁇ ⁇ Short Actions to play video content
  • the object of the present invention is in particular to reconsider the principle of a remote control, by using tactile zones rather than buttons, these tactile zones being associated with gestures, and by using feedbacks by vibration and / or sound ensuring the good catch. in action account, to cover most of the desired actions.
  • the present invention proposes to use a touch surface such as the touch screen 8 of the smartphone 3 and to cut it virtually into three zones. It can be a partition, i.e. only three zones or there can be other functional zones or not. Ideally, these are three zones only with visible separation (by light lines of separation) or not.
  • Zone 1 is a support zone generally forming a band on the upper part of the touch surface.
  • this band can represent between 5 and 20% of the total surface.
  • a short press ideally corresponds to the increment of a unit while a long press can correspond to an incremental scrolling of the chains.
  • zone1 extends over the lower surface at the corners.
  • a right chamfer 6 is produced on each lateral end of the zone 1, close to a corner of the tactile surface.
  • zone1 is in the form of a straight strip in the center, terminated at each end by a wider zone facilitating access by the thumb. The two ends are thus arranged so that the device is compatible for left-handers and right-handers.
  • Zone 3 is also a support zone similar to zone 1 but located at the bottom of the touch surface, at the lower end when the touch surface is held vertically as illustrated on the figure 2 .
  • Zone1 and zone3 are symmetrical with respect to a horizontal axis passing through the middle of the tactile surface.
  • the chamfers 7 make it possible to create wider zones at the ends of the strip forming the zone 3.
  • Zone1 and zone3 are structured to make it possible to define "pressing zones” over a full width without representing a graphic object of a limited button on a small area of the screen. These areas define the "high” and “low” areas of the screen. They are therefore accessible with the thumb, they are symmetrical to adapt to a holding in hand that one is right-handed or left-handed. They also make it possible to respond to the fact that the screens can have different sizes, and must adapt in relation to the ergonomics of the hand.
  • the central zone is zone2 corresponding to the surface left free by zone1 and zone3, generally at the center of the touch screen 8. Its shape is therefore complementary to the shapes of the support zones.
  • This zone2 provides access to a certain number of remote action commands, by simple gestures that do not require looking at the screen. These gestures can be performed with the thumb for simple gestures, and with several fingers for less common actions. They all involve a remote action on the equipment which is controlled. No gesture has a local action, that is to say a control of the smartphone. It is possible to add a visual, sound and / or vibration feedback to the virtual remote control following the gesture to confirm that the command has been taken into account.
  • the proposed actions can: Gesture Number of fingers Associated remote action Possible return Visual Sound Vibration horizontal slide to the right 1 Right arrow ( ⁇ ) trace horizontal slide to the left 1 Left arrow ( ⁇ ) trace vertical slide up 1 Up arrow ( ⁇ ) trace vertical sliding down 1 Down arrow ( ⁇ ) trace horizontal slide to the right and hold 1 Long press right arrow ( ⁇ ) trace Yes horizontal slide to the left and hold 1 Long press left arrow ( ⁇ ) trace Yes vertical sliding up and holding 1 Long press up arrow ( ⁇ ) trace Yes vertical sliding down and holding 1 Long press down arrow ( ⁇ ) trace Yes Short press 1 OK button Double short press 1 MENU button horizontal slide to the right 2 Button ( ) trace Yes horizontal slide to the left 2 Button ( ) trace Yes Short press 2 Button ( ) click Yes Short press 3 Button ( ⁇ ) click Yes Yes Yes Yes Yes
  • This table very schematically constitutes a conversion table between the gestures performed on zone 2 and the usual control keys of the remote equipment.
  • the associations between gestures and control keys described above are given only by way of nonlimiting example. It is possible to imagine other combinations allowing to make natural the use of a tactile object to control the commands sent to a television set or a decoder displaying on a screen. More elaborate gestures can be considered.
  • the device according to the invention can be a smartphone 3 comprising a processing unit 9, typically a microcontroller or microprocessor associated with adequate memory spaces.
  • This smartphone 3 includes conventional software and hardware components for its proper functioning.
  • the hardware components there is in particular a supply battery 10, a transceiver 11 for communicating wirelessly with the remote equipment, a vibrator 12 for vibrating feedback, the touch screen 8 for among other things visual feedback, and a speaker 13 for sound feedback.
  • These elements are connected to each other in a conventional manner, in particular they are all controlled by the microprocessor.
  • the processing unit 9 implements a software application which performs the steps described on the figure 4 . Namely, a detection of a gesture in zone 2 or a press in zone 1 or zone 3. When a gesture or a press is identified, the conversion table described above is used in particular to identify the corresponding television control. The latter is then sent to the remote television 4 or the remote decoder 2, in parallel with the generation of a validation, which can be of sound type via the loudspeaker 13, visual by mission for example of lighting via the screen 8, or vibrating via the vibrator 12.
  • the present invention thus makes it possible to facilitate the use of remote controls of the virtual type. It allows tactile sensations associated with a vibrator, auditory sensations acknowledging the use of the device. It allows you to control a TV screen using an application running on another screen that does not include physical keys, without having to look at each of these screens alternately to find out what you press and what is the result following support.

Landscapes

  • Engineering & Computer Science (AREA)
  • Computer Networks & Wireless Communication (AREA)
  • Physics & Mathematics (AREA)
  • General Physics & Mathematics (AREA)
  • Selective Calling Equipment (AREA)
  • User Interface Of Digital Computer (AREA)
  • Details Of Television Systems (AREA)

Claims (15)

  1. Tragbares elektronisches Gerät zur Verwendung als Fernbedienung einer entfernten Apparatur, wobei das Gerät eine Tastfläche und eine Verarbeitungseinheit aufweist und auf der Verarbeitungseinheit eine Softwareanwendung eingerichtet ist, die bei Ausführung die Tastfläche virtuell in ausschließlich drei aktive Zonen unterteilt und die auf diesen Zonen durchgeführten Einwirkungen solcherart detektiert, dass Steuersignale für die entfernte Apparatur erzeugt werden; wobei die drei Zonen dabei bestehen aus:
    - zwei Zonen, als Unterstützungszonen bezeichnet, die jeweils an den beiden gegenüberliegenden Rändern der Tastfläche angeordnet sind, dergestalt, dass jede Unterstützungszone in ihrer Gesamtheit eine einzelne punktweise Steuerzone darstellt, sowie
    - einer zentralen Zone, deren Abmessungen größer sind als die der beiden Unterstützungszonen, dergestalt, dass die zentrale Zone zur Erfassung von Gesten eingerichtet ist.
  2. Gerät nach Anspruch 1, dadurch gekennzeichnet, dass es eine akustische Einheit aufweist, die in Folge der Erzeugung eines Steuersignals für die entfernte Apparatur aktiviert werden kann.
  3. Gerät nach Anspruch 1 oder 2, dadurch gekennzeichnet, dass es eine Vibrationseinheit aufweist, die in Folge der Erzeugung eines Steuersignals für die entfernte Apparatur aktiviert werden kann.
  4. Gerät nach einem der vorangehenden Ansprüche, dadurch gekennzeichnet, dass es eine optische Einheit aufweist, die in Folge der Erzeugung eines Steuersignals für die entfernte Apparatur aktiviert werden kann.
  5. Gerät nach einem der vorangehenden Ansprüche, dadurch gekennzeichnet, dass es mindestens einen Sender für die kabellose Übertragung der Steuersignale für die entfernte Apparatur aufweist.
  6. Gerät nach Anspruch 5, dadurch gekennzeichnet, dass es einen Sender-Empfänger für eine kabellose bidirektionale Kommunikation der Steuersignale für die entfernte Apparatur aufweist.
  7. Gerät nach einem der vorangehenden Ansprüche, dadurch gekennzeichnet, dass die Tastfläche ein Touchscreen ist.
  8. Gerät nach einem der vorangehenden Ansprüche, dadurch gekennzeichnet, dass, wenn das Gerät senkrecht gehalten wird, sich die beiden Unterstützungszonen sich jeweils am oberen und unteren Abschnitt befinden.
  9. Gerät nach einem der vorangehenden Ansprüche, dadurch gekennzeichnet, dass wenn die Tastfläche eine Quaderform aufweist, jede Unterstützungszone einen Streifen über die gesamte Länge der jeweiligen Seite darstellt.
  10. Gerät nach Anspruch 9, dadurch gekennzeichnet, dass die Unterstützungszone in jeder Ecke der Tastfläche eine größere Länge aufweist als die des Bereichs zwischen den beiden Ecken auf der gleichen Seite der Tastfläche.
  11. Gerät nach einem der vorangehenden Ansprüche, dadurch gekennzeichnet, dass es sich bei dem Gerät um ein Mobiltelefon in Form eines «Smartphones» handelt.
  12. Gerät nach einem der Ansprüche 1-10, dadurch gekennzeichnet, dass es sich bei dem Gerät um ein Tablet handelt.
  13. Gerät nach einem der Ansprüche 1-10, dadurch gekennzeichnet, dass es sich bei dem Gerät um eine Tast-Maus handelt.
  14. Gerät nach einem der Ansprüche 1-10, dadurch gekennzeichnet, dass es sich bei dem Gerät um ein Touchpad handelt.
  15. Gerät nach einem der voranstehenden Ansprüche, dadurch gekennzeichnet, dass die Verarbeitungseinheit dergestalt eingerichtet ist, dass sie eine Entsprechung zwischen vordefinierten und parametrierten Gesten in der Anwendungssoftware einerseits und vom entfernten Apparat erfassbaren Steuersignalen andererseits erzielt.
EP16741881.3A 2015-06-30 2016-06-30 Virtuelle fernsteuerung Active EP3317868B1 (de)

Priority Applications (1)

Application Number Priority Date Filing Date Title
PL16741881T PL3317868T3 (pl) 2015-06-30 2016-06-30 Pilot wirtualny

Applications Claiming Priority (2)

Application Number Priority Date Filing Date Title
FR1556186A FR3038436B1 (fr) 2015-06-30 2015-06-30 Telecommande virtuelle
PCT/EP2016/065339 WO2017001578A1 (fr) 2015-06-30 2016-06-30 Telecommande virtuelle

Publications (2)

Publication Number Publication Date
EP3317868A1 EP3317868A1 (de) 2018-05-09
EP3317868B1 true EP3317868B1 (de) 2019-12-18

Family

ID=54199828

Family Applications (1)

Application Number Title Priority Date Filing Date
EP16741881.3A Active EP3317868B1 (de) 2015-06-30 2016-06-30 Virtuelle fernsteuerung

Country Status (5)

Country Link
EP (1) EP3317868B1 (de)
ES (1) ES2777536T3 (de)
FR (1) FR3038436B1 (de)
PL (1) PL3317868T3 (de)
WO (1) WO2017001578A1 (de)

Families Citing this family (1)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN113822795B (zh) * 2021-09-17 2024-02-09 惠州视维新技术有限公司 基于毫米波雷达的虚拟按键投影方法、装置及电子设备

Family Cites Families (2)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US8734256B2 (en) * 2008-09-15 2014-05-27 Panasonic Avionics Corporation System and method for hosting multiplayer games
US9547375B2 (en) * 2012-10-10 2017-01-17 Microsoft Technology Licensing, Llc Split virtual keyboard on a mobile computing device

Non-Patent Citations (1)

* Cited by examiner, † Cited by third party
Title
None *

Also Published As

Publication number Publication date
WO2017001578A1 (fr) 2017-01-05
ES2777536T3 (es) 2020-08-05
PL3317868T3 (pl) 2020-06-29
FR3038436B1 (fr) 2017-08-18
FR3038436A1 (fr) 2017-01-06
EP3317868A1 (de) 2018-05-09

Similar Documents

Publication Publication Date Title
USD842892S1 (en) Electronic device with pair of display screens or portions thereof each with graphical user interface
US20170347054A1 (en) Systems and Methods for Remote Control of a Television
EP1929778B1 (de) Verfahren zum durchsuchen einer liste durch kontinuierliches rollen eines graphischen merkmals und diesbezügliches endgerät
FR2967509A1 (fr) Appareil d'affichage d'images et procede de fonctionnement associe
CN103970443B (zh) 一种终端及终端显示控制方法
FR3022367A1 (de)
CN108475158A (zh) 基于轻扫手势让内容项目间能够转换的系统及方法
WO2008051538A3 (en) Product information display and product linking
WO2007090063A3 (en) Data object visualization using maps
WO2006041692A3 (en) Fractional video touch panels
US20160373804A1 (en) Systems and methods of displaying and navigating content based on dynamic icon mapping
CN106325663A (zh) 移动终端及其截屏方法
KR20140131166A (ko) 디스플레이 장치 및 검색 방법
CN103150084A (zh) 终端和终端操控方法
EP2539875B1 (de) Verfahren und vorrichtung zur steuerung mindestens einem feldgerät durch mindestens ein anderes feldgerät, sowie system mit einer derartigen vorrichtung
CN104991699B (zh) 一种视频显示控制的方法和装置
CN103345303A (zh) 一种用智能移动设备全替代鼠标键盘的系统及实现方法
EP3317868B1 (de) Virtuelle fernsteuerung
CN103226458A (zh) 一种用于智能移动设备的多屏显示控制方法
CN105898604A (zh) 基于移动终端的直播视频互动信息配置方法及装置
TW201207669A (en) A display control apparatus and method for selecting an interactive object on a display frame by a numberic controller
WO2008067263A3 (en) Interactive computer graphical user interface method and system
CN109634487A (zh) 信息显示方法、装置及存储介质
EP2958004B1 (de) Verfahren um ein element in einer liste auszuwählen
CN103442125A (zh) 手机

Legal Events

Date Code Title Description
STAA Information on the status of an ep patent application or granted ep patent

Free format text: STATUS: THE INTERNATIONAL PUBLICATION HAS BEEN MADE

PUAI Public reference made under article 153(3) epc to a published international application that has entered the european phase

Free format text: ORIGINAL CODE: 0009012

STAA Information on the status of an ep patent application or granted ep patent

Free format text: STATUS: REQUEST FOR EXAMINATION WAS MADE

17P Request for examination filed

Effective date: 20180130

AK Designated contracting states

Kind code of ref document: A1

Designated state(s): AL AT BE BG CH CY CZ DE DK EE ES FI FR GB GR HR HU IE IS IT LI LT LU LV MC MK MT NL NO PL PT RO RS SE SI SK SM TR

AX Request for extension of the european patent

Extension state: BA ME

DAV Request for validation of the european patent (deleted)
DAX Request for extension of the european patent (deleted)
GRAP Despatch of communication of intention to grant a patent

Free format text: ORIGINAL CODE: EPIDOSNIGR1

STAA Information on the status of an ep patent application or granted ep patent

Free format text: STATUS: GRANT OF PATENT IS INTENDED

INTG Intention to grant announced

Effective date: 20190708

GRAS Grant fee paid

Free format text: ORIGINAL CODE: EPIDOSNIGR3

GRAA (expected) grant

Free format text: ORIGINAL CODE: 0009210

STAA Information on the status of an ep patent application or granted ep patent

Free format text: STATUS: THE PATENT HAS BEEN GRANTED

AK Designated contracting states

Kind code of ref document: B1

Designated state(s): AL AT BE BG CH CY CZ DE DK EE ES FI FR GB GR HR HU IE IS IT LI LT LU LV MC MK MT NL NO PL PT RO RS SE SI SK SM TR

REG Reference to a national code

Ref country code: CH

Ref legal event code: EP

REG Reference to a national code

Ref country code: IE

Ref legal event code: FG4D

Free format text: LANGUAGE OF EP DOCUMENT: FRENCH

REG Reference to a national code

Ref country code: DE

Ref legal event code: R096

Ref document number: 602016026439

Country of ref document: DE

REG Reference to a national code

Ref country code: AT

Ref legal event code: REF

Ref document number: 1215460

Country of ref document: AT

Kind code of ref document: T

Effective date: 20200115

REG Reference to a national code

Ref country code: NL

Ref legal event code: MP

Effective date: 20191218

PG25 Lapsed in a contracting state [announced via postgrant information from national office to epo]

Ref country code: LT

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20191218

Ref country code: GR

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20200319

Ref country code: NO

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20200318

Ref country code: SE

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20191218

Ref country code: LV

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20191218

Ref country code: FI

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20191218

Ref country code: BG

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20200318

REG Reference to a national code

Ref country code: LT

Ref legal event code: MG4D

PG25 Lapsed in a contracting state [announced via postgrant information from national office to epo]

Ref country code: RS

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20191218

Ref country code: HR

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20191218

PG25 Lapsed in a contracting state [announced via postgrant information from national office to epo]

Ref country code: AL

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20191218

PG25 Lapsed in a contracting state [announced via postgrant information from national office to epo]

Ref country code: EE

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20191218

Ref country code: RO

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20191218

Ref country code: NL

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20191218

Ref country code: CZ

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20191218

Ref country code: PT

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20200513

REG Reference to a national code

Ref country code: ES

Ref legal event code: FG2A

Ref document number: 2777536

Country of ref document: ES

Kind code of ref document: T3

Effective date: 20200805

PG25 Lapsed in a contracting state [announced via postgrant information from national office to epo]

Ref country code: IS

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20200418

Ref country code: SK

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20191218

Ref country code: SM

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20191218

REG Reference to a national code

Ref country code: DE

Ref legal event code: R097

Ref document number: 602016026439

Country of ref document: DE

REG Reference to a national code

Ref country code: AT

Ref legal event code: MK05

Ref document number: 1215460

Country of ref document: AT

Kind code of ref document: T

Effective date: 20191218

PLBE No opposition filed within time limit

Free format text: ORIGINAL CODE: 0009261

STAA Information on the status of an ep patent application or granted ep patent

Free format text: STATUS: NO OPPOSITION FILED WITHIN TIME LIMIT

PG25 Lapsed in a contracting state [announced via postgrant information from national office to epo]

Ref country code: DK

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20191218

26N No opposition filed

Effective date: 20200921

PG25 Lapsed in a contracting state [announced via postgrant information from national office to epo]

Ref country code: SI

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20191218

Ref country code: AT

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20191218

PG25 Lapsed in a contracting state [announced via postgrant information from national office to epo]

Ref country code: IT

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20191218

Ref country code: MC

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20191218

REG Reference to a national code

Ref country code: CH

Ref legal event code: PL

GBPC Gb: european patent ceased through non-payment of renewal fee

Effective date: 20200630

PG25 Lapsed in a contracting state [announced via postgrant information from national office to epo]

Ref country code: LU

Free format text: LAPSE BECAUSE OF NON-PAYMENT OF DUE FEES

Effective date: 20200630

REG Reference to a national code

Ref country code: BE

Ref legal event code: MM

Effective date: 20200630

PG25 Lapsed in a contracting state [announced via postgrant information from national office to epo]

Ref country code: LI

Free format text: LAPSE BECAUSE OF NON-PAYMENT OF DUE FEES

Effective date: 20200630

Ref country code: CH

Free format text: LAPSE BECAUSE OF NON-PAYMENT OF DUE FEES

Effective date: 20200630

Ref country code: IE

Free format text: LAPSE BECAUSE OF NON-PAYMENT OF DUE FEES

Effective date: 20200630

Ref country code: GB

Free format text: LAPSE BECAUSE OF NON-PAYMENT OF DUE FEES

Effective date: 20200630

PG25 Lapsed in a contracting state [announced via postgrant information from national office to epo]

Ref country code: BE

Free format text: LAPSE BECAUSE OF NON-PAYMENT OF DUE FEES

Effective date: 20200630

PG25 Lapsed in a contracting state [announced via postgrant information from national office to epo]

Ref country code: TR

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20191218

Ref country code: MT

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20191218

Ref country code: CY

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20191218

PG25 Lapsed in a contracting state [announced via postgrant information from national office to epo]

Ref country code: MK

Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

Effective date: 20191218

PGFP Annual fee paid to national office [announced via postgrant information from national office to epo]

Ref country code: FR

Payment date: 20230628

Year of fee payment: 8

Ref country code: DE

Payment date: 20230629

Year of fee payment: 8

PGFP Annual fee paid to national office [announced via postgrant information from national office to epo]

Ref country code: PL

Payment date: 20230626

Year of fee payment: 8

PGFP Annual fee paid to national office [announced via postgrant information from national office to epo]

Ref country code: ES

Payment date: 20230807

Year of fee payment: 8

REG Reference to a national code

Ref country code: DE

Ref legal event code: R119

Ref document number: 602016026439

Country of ref document: DE

PG25 Lapsed in a contracting state [announced via postgrant information from national office to epo]

Ref country code: DE

Free format text: LAPSE BECAUSE OF NON-PAYMENT OF DUE FEES

Effective date: 20250101

PG25 Lapsed in a contracting state [announced via postgrant information from national office to epo]

Ref country code: FR

Free format text: LAPSE BECAUSE OF NON-PAYMENT OF DUE FEES

Effective date: 20240630

REG Reference to a national code

Ref country code: ES

Ref legal event code: FD2A

Effective date: 20250805

PG25 Lapsed in a contracting state [announced via postgrant information from national office to epo]

Ref country code: ES

Free format text: LAPSE BECAUSE OF NON-PAYMENT OF DUE FEES

Effective date: 20240701

PG25 Lapsed in a contracting state [announced via postgrant information from national office to epo]

Ref country code: PL

Free format text: LAPSE BECAUSE OF NON-PAYMENT OF DUE FEES

Effective date: 20240630