EP2530564A2 - Système tactile a émetteurs et recepteurs optiques - Google Patents

Système tactile a émetteurs et recepteurs optiques Download PDF

Info

Publication number
EP2530564A2
EP2530564A2 EP12170160A EP12170160A EP2530564A2 EP 2530564 A2 EP2530564 A2 EP 2530564A2 EP 12170160 A EP12170160 A EP 12170160A EP 12170160 A EP12170160 A EP 12170160A EP 2530564 A2 EP2530564 A2 EP 2530564A2
Authority
EP
European Patent Office
Prior art keywords
light
touch system
optical touch
display surface
light source
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Withdrawn
Application number
EP12170160A
Other languages
German (de)
English (en)
French (fr)
Inventor
Johanna Dominici
Arnaud Petitdemange
Loïc Becouarn
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
Thales SA
Original Assignee
Thales SA
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Thales SA filed Critical Thales SA
Publication of EP2530564A2 publication Critical patent/EP2530564A2/fr
Withdrawn legal-status Critical Current

Links

Images

Classifications

    • G—PHYSICS
    • G06—COMPUTING; CALCULATING OR COUNTING
    • G06F—ELECTRIC DIGITAL DATA PROCESSING
    • G06F3/00—Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
    • G06F3/01—Input arrangements or combined input and output arrangements for interaction between user and computer
    • G06F3/03—Arrangements for converting the position or the displacement of a member into a coded form
    • G06F3/041—Digitisers, e.g. for touch screens or touch pads, characterised by the transducing means
    • G06F3/042—Digitisers, e.g. for touch screens or touch pads, characterised by the transducing means by opto-electronic means
    • G06F3/0421—Digitisers, e.g. for touch screens or touch pads, characterised by the transducing means by opto-electronic means by interrupting or reflecting a light beam, e.g. optical touch-screen
    • B—PERFORMING OPERATIONS; TRANSPORTING
    • B64—AIRCRAFT; AVIATION; COSMONAUTICS
    • B64D—EQUIPMENT FOR FITTING IN OR TO AIRCRAFT; FLIGHT SUITS; PARACHUTES; ARRANGEMENT OR MOUNTING OF POWER PLANTS OR PROPULSION TRANSMISSIONS IN AIRCRAFT
    • B64D43/00—Arrangements or adaptations of instruments
    • G—PHYSICS
    • G06—COMPUTING; CALCULATING OR COUNTING
    • G06F—ELECTRIC DIGITAL DATA PROCESSING
    • G06F2203/00—Indexing scheme relating to G06F3/00 - G06F3/048
    • G06F2203/041—Indexing scheme relating to G06F3/041 - G06F3/045
    • G06F2203/04104—Multi-touch detection in digitiser, i.e. details about the simultaneous detection of a plurality of touching locations, e.g. multiple fingers or pen and finger
    • G—PHYSICS
    • G06—COMPUTING; CALCULATING OR COUNTING
    • G06F—ELECTRIC DIGITAL DATA PROCESSING
    • G06F2203/00—Indexing scheme relating to G06F3/00 - G06F3/048
    • G06F2203/048—Indexing scheme relating to G06F3/048
    • G06F2203/04808—Several contacts: gestures triggering a specific function, e.g. scrolling, zooming, right-click, when the user establishes several contacts with the surface simultaneously; e.g. using several fingers or a combination of fingers and pen

Definitions

  • the field of the invention is that of tactile systems, and more particularly optical touch systems.
  • the use of the system is not limited to a particular application but the system is particularly applicable to aircraft dashboards and their avionics systems.
  • touch screens as a means of human-computer interaction has become more and more widespread in everyday life. This interaction means greatly facilitates the use of the associated device by being more intuitive and faster.
  • touch screens facilitates interaction between pilots and cockpit displays, improving flight safety while reducing pilots' workload.
  • a cockpit screen must meet certain environmental requirements. These include, among others, optical stresses, vibrations, electromagnetic disturbances, resistance to temperature, shocks, liquids, ... The addition of touch technology on the screen makes it more difficult to meet these requirements.
  • touch screens Today, few aircraft are equipped with touch screens and for those who are, the touch screens are not critical screens such as so-called PFD screens for "Primary Flight Display” or ND for “Navigation Display” which give basic information about driving and navigation.
  • multitouch There are currently various technologies of tactile systems called “multitouch”. They include resistive systems, projected capacitive, optical, acoustic or “in-cell”. In optical technologies, we distinguish the technologies known as “optical imaging”, “infrared Matrix” and “FTIR” (Frustrated Total Internal Reflection). Nevertheless, these technologies are not perfectly adapted to use in avionics environment for the critical screens of a cockpit.
  • optical imaging systems are the most widely used today. There are different technical principles implementing this technology.
  • the "optical position detector" of the Japanese company EIT Co and which was the subject of the patent application Reference PCT WO 2005/031554 .
  • the device used to detect the position of an object or a finger of a user on a surface 1 essentially comprises two identical transmission-reception modules 2 and a retro-reflective barrier 3 disposed on the periphery of the surface 1 This barrier is U-shaped on the figure 1 .
  • Each transmission-reception module 2 comprises a light source 21 arranged to illuminate the entire surface 1 and a reception assembly comprising a linear or surface-sensitive photosensitive sensor 22 whose field makes it possible to cover the entire surface 1. The operation is the next.
  • the light emitted by a light source 21 is retro-reflected by the barrier 3 and completely illuminates the surface of the sensor 22.
  • the light emitted by the light source 21 and intercepted by the object either before reflection on the barrier, or after reflection on the barrier, does not reach the surface of the sensor 22 and creates a shadow.
  • the light distribution on the sensors 22R and 22L of the modules 2 on the left and on the right of the surface 1 is represented.
  • the positions of the shades 4R and 4L are representative of the position of the object on the surface 1. II is easy, by analyzing their exact positions on the sensors 22R and 22L, to find the position of the object 4.
  • the computer 5 performs this treatment.
  • the edge of the screen may be illuminated in the infrared by either external illuminators or illuminators embedded in the border.
  • Two matrix sensors then image the light border and detect the presence of a shadow when a pointer interacts with the screen.
  • the system according to the invention while preserving the advantages of the optical imaging technology, makes it possible to solve all or some of the above problems.
  • the solution consists of a set of optical sensors and illumination sources correctly positioned to allow the detection of a pointer and its position, on a screen where the display is dynamic or on a static display area.
  • the system according to the invention operates by direct detection, the object to be detected being bright against a dark background at the level of the photosensitive surfaces.
  • the solution according to the invention makes it possible to solve the problems of NVG compatibility, the use in "multitouch”, the operation under strong illumination, the simplicity and the control of the control electronics and the associated software, the redundancy necessary to satisfy the security constraints.
  • the subject of the invention is an optical touch system mounted above a detection zone of a display surface, said system comprising a first light source arranged so as to produce above said zone of the display surface a "light sheet" covering at least said area, a first imager and a second imager whose optical fields cover at least said area, characterized in that , the first source being disjoint from the first and second imagers when a first object is above said zone, a first and a second light image of said object are picked up by the first imager and the second imager, the system comprising analysis means allowing, by triangulation, from of knowing the positions of the first and second light image, to determine the position of this first object above said area of the display surface.
  • the system comprises a third imager so that when a first and a second object are above the area of the display surface, a first, a second and a third light image of the first object are captured. by the first, the second and the third imagers, a fourth, fifth and sixth light image of the second object are picked up by the first, second and third imagers, the system comprising analysis means allowing, by triangulation, from knowing the positions of the six light images, determining with certainty the position of the first object and the second object above said area of the display surface.
  • the system comprises a second light source disjoint from the first light source.
  • the first and the second light source emit light periodically and never simultaneously during normal operation of the optical touch system.
  • the first light source emits in a first spectral band
  • the second light source emits in a second spectral band disjoint from the first spectral band
  • the imagers comprising spectral filters making it possible to transmit only one of the two spectral bands.
  • Light sources can also be lit alternately to avoid disturbing each other.
  • the source or sources emit in a spectral band situated outside the amplification spectral band of night vision binoculars and in that the imagers are sensitive in said spectral band said light sources.
  • the light source or sources comprise optical means arranged so that the average illumination above the area of the display surface and in a plane perpendicular to it is substantially constant.
  • the optical means comprise a collimation optics and a light guide or a light guide comprising diffusing patterns arranged regularly.
  • the imager comprises a sun visor and the periphery of the display surface is surrounded by a barrier absorbing sunlight.
  • the display surface is substantially rectangular in shape and the touch zone covers all of said display surface.
  • the display surface comprises a plurality of zones, the system comprising a plurality of light sources and imagers arranged so that the position of at least one object can be determined in each zone.
  • the display surface is a display screen or has static display areas.
  • the display surface belongs to an avionics system mounted in an aircraft cockpit.
  • the display surface covers part or all of the dashboard.
  • the optical touch system is mounted above a detection area of a display surface.
  • it comprises a set of optical imagers C and illumination sources S correctly positioned to allow the detection of one or more pointers P and their positions above the display surface A.
  • the display surface A may be one or more display screens. This is called dynamic signage. It can be a static display area made by means of stickers, serigraphy or combine the two functions.
  • the pointer P can be one or more fingers of the user, a stylus or any other object.
  • the only condition is that the pointer is not too wide to be accurately detected and at least partly diffusive.
  • the general operating principle of the systems according to the invention is described on the Figures 3 and 4 in the simplest case, that is to say a single detection zone A, a single illumination source S, only two imagers C1 and C2 and a single pointer P to be detected.
  • the principles described are easily generalizable to a plurality of detection zones and to several pointers to be detected.
  • the detection zone of the figure 3 is rectangular but the system according to the invention can easily adapt to different types of forms of detection zones.
  • the location of the source and imagers is also given as an indication.
  • the illumination source S emits light parallel to the display area in a layer from the display surface up to a few millimeters thick. This "light sheet" must cover, of course, the entire detection area and not illuminate the imagers. This light source is used to illuminate the pointer P when it designates a particular location on the display area. Electroluminescent diodes or laser diodes can be used. In this case, these are associated with a diffuser and / or an optical device for expanding the beam so as to cover the entire touch zone.
  • Each imager includes focusing optics and an optical sensor.
  • Each imager is, in fact, a micro-camera.
  • the optical sensor is composed of photosensitive pixels, it can be surface or linear. It forms an image of the surface of the display area in a plane parallel to the plane of the display area. When there is no pointer on the display area, the sensor does not detect any light, so the image is black. When the pointer is illuminated, it reflects and scatters the light, creating a bright image on the sensors of both imagers.
  • the signals SC1 and SC2 delivered by the sensors and represented in figure 4 allow, after processing, to determine the photosensitive pixels P k and P j associated with the pointer as seen on the figure 4 .
  • a prior calibration makes it possible to know the positioning and the orientation of the sensors relative to one another.
  • the system according to the invention in particular when used in an aeronautical environment, must operate both under high sunlight and, for certain uses, in night conditions.
  • FIG. figure 5 To ensure operation under solar irradiance, various techniques illustrated in FIG. figure 5 . To limit the risk of saturation of the sensor of the imager C, is added in front of the focusing optics a spectral filter F wedged on the wavelength of the associated light source. Thus, the solar radiation is strongly attenuated without degradation of the signal reflected by the pointer.
  • the pointer is illuminated by the sun, which is a major problem for existing solutions based on optical imaging technology, the signal picked up by the detector is not disturbed. On the contrary, it is amplified and the pointer is only better detected because the rest of the image is always dark.
  • the tactile zone is surrounded by R.A. absorbing edges with a light of sufficient thickness to cover the field of view of the sensors, ie a few millimeters.
  • a judicious design of the module integrating the sensor can prevent the sun from directly illuminating the sensor. Indeed, by adding a "glareshield" G or a visor to the imager as we see it on the figure 5 , the sun's rays never reach the limiting incidence allowing direct illumination of the sensor.
  • light sources At night, to ensure compatibility with the use of night vision binoculars called “NVG” for "Night Vision Goggle", light sources have emission spectra located beyond the wavelength of binocular amplification, usually 930 nm. These sources may be laser diodes or light-emitting diodes. The sensors then have a spectral sensitivity adapted to these wavelengths.
  • single-touch mode two imagers are no longer sufficient.
  • dual-touch mode two imagers are no longer sufficient.
  • the simultaneous presence of two objects P1 and P2 at two different locations of the touch surface will give each sensor C1 and C2 two images. These two images have as coordinates on the first sensor P k1 and P k2 and on the second sensor P j1 and P j2 .
  • four objects can correspond, the two real objects P1 and P2 and two ghost objects or "ghosts" G1 and G2.
  • this third imager depends, of course, on the position of the first imagers and the field covered by this third imager. It is also possible to ensure that the three imagers are always properly illuminated to add a second light source S2 as seen on the figure 8 .
  • the addition of a new imager and at least one light source can disturb the signal received by the other imagers as seen on the figure 8 . Indeed, it is essential that the different imagers are not directly illuminated by the emission sources. There are two solutions to this problem.
  • the first is to do a different spectral filtering on the different sensors by judiciously choosing the wavelengths of the light sources.
  • the spectral band of detection of the sensors 1 and 2 is adapted to the wavelength of the source 1 while rejecting, thanks to a spectral filtering, the wavelength of the source 2
  • the spectral band of detection of the sensor 3 is adapted to the wavelength of the source 2 while rejecting, thanks to a different spectral filtering, the wavelength of the source 1.
  • the second solution is to temporally sequence the signals emitted by the light sources.
  • the figure 9 represents a possible example of this type of sequence in the case of a touch system with two sources and three imagers and two objects detected.
  • the total duration of a sequence is equal to T.
  • This duration T is generally from a few milliseconds to a few tens of milliseconds.
  • Each duration T comprises two half-periods.
  • the first source S1 is on and the second source S2 is off.
  • the first sensor C1 and the second sensor C2 are activated, the third sensor C3 is off.
  • the first source S1 is off and the second source S2 is on.
  • the first sensor C1 and the second sensor C2 are turned off, the third sensor C3 is activated.
  • the first source never lights the third sensor and the second source never illuminates the first and second sensors.
  • the analysis of the different signals SC1, SC2 and SC3 from the sensors makes it possible to find the positions of the two objects.
  • This solution also makes it possible to verify the proper functioning of the various sensors and light sources by activating simultaneously, when no pointer is detected, all the sensors and light sources. It will thus be verified that the sensors SC1 and SC2 "see” the source S2 and that the sensor SC3 "sees” the source S1.
  • the illumination varies significantly depending on whether one is more or less ready from the lighting source.
  • the detection by the sensors is independent of the level of light received.
  • a light guide-type shaping optics is used to allow more uniform illumination of the designator whatever its position on the surface of the detection zone.
  • the figure 10 represents a first embodiment of this uniformly distributed source.
  • the source has Fresnel reflector collimation optics. This optic is usually a parabola portion that can be used either in total internal reflection or in direct reflection in the air.
  • the collimated light is then uniformly diffused by a light guide GL.
  • S1 sources can be multiplied to cover the entire width of the detection zone.
  • the figure 11 represents a second embodiment of this uniformly distributed source.
  • the light guide GL comprises patterns or "patterns" diffusing regularly spaced. These patterns are usually ⁇ P microprisms.
  • the guide may include on its edge a prism film for better directivity. The light is then slightly diffuse but the illumination of the designator remains more uniform than with a simple source.
  • the optical touch system according to the invention is particularly applicable to aeronautical applications and in particular to aircraft dashboards. It is easy to adapt to different cockpit configurations.
  • the Figures 12 and 13 represent two different cockpit configurations. The first has six viewing screens D arranged in T and the associated control panels. It is demonstrated that a touch system configuration comprising seven sources S and nine imagers C is necessary to ensure total coverage of the dashboard, which is composed of two different planes. The second configuration has four viewing screens arranged in T and the associated control panels. We show that a configuration A touch system comprising six S sources and eight C imagers is necessary to ensure the total coverage of the dashboard, which is composed of two different planes. Whatever the configuration of the cockpit, it is sufficient to place sensors and light sources in sufficient number and strategic locations to make the entire dashboard touch screens and buttons included.

Landscapes

  • Engineering & Computer Science (AREA)
  • General Engineering & Computer Science (AREA)
  • Theoretical Computer Science (AREA)
  • Aviation & Aerospace Engineering (AREA)
  • Human Computer Interaction (AREA)
  • Physics & Mathematics (AREA)
  • General Physics & Mathematics (AREA)
  • Position Input By Displaying (AREA)
  • Details Of Measuring Devices (AREA)
EP12170160A 2011-06-01 2012-05-31 Système tactile a émetteurs et recepteurs optiques Withdrawn EP2530564A2 (fr)

Applications Claiming Priority (1)

Application Number Priority Date Filing Date Title
FR1101680A FR2976093B1 (fr) 2011-06-01 2011-06-01 Systeme tactile a emetteurs et recepteurs optiques

Publications (1)

Publication Number Publication Date
EP2530564A2 true EP2530564A2 (fr) 2012-12-05

Family

ID=46147369

Family Applications (1)

Application Number Title Priority Date Filing Date
EP12170160A Withdrawn EP2530564A2 (fr) 2011-06-01 2012-05-31 Système tactile a émetteurs et recepteurs optiques

Country Status (5)

Country Link
US (1) US20120327034A1 (ja)
EP (1) EP2530564A2 (ja)
JP (1) JP2012252702A (ja)
CN (1) CN102830854A (ja)
FR (1) FR2976093B1 (ja)

Cited By (1)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
FR3005173A1 (fr) * 2013-04-26 2014-10-31 Airbus Procede d'interaction dans un cockpit d'aeronef entre un pilote et son environnement

Families Citing this family (8)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
KR101159179B1 (ko) * 2010-10-13 2012-06-22 액츠 주식회사 터치 스크린 시스템 및 그 제조 방법
US8941619B2 (en) * 2011-11-18 2015-01-27 Au Optronics Corporation Apparatus and method for controlling information display
US9465483B2 (en) * 2012-03-22 2016-10-11 Mediatek Inc. Methods for input-output calibration and image rendering
US8886372B2 (en) * 2012-09-07 2014-11-11 The Boeing Company Flight deck touch-sensitive hardware controls
CN103853394A (zh) * 2014-02-19 2014-06-11 中国电子科技集团公司第五十五研究所 采用诱导透射滤光片的夜视兼容红外触摸屏
CN103885648B (zh) * 2014-03-25 2017-04-12 锐达互动科技股份有限公司 侧投双镜头触摸屏的真两点触摸检测方法
SI3440773T1 (sl) * 2016-04-07 2023-04-28 Diehl Ako Stiftung & Co. Kg Krmilna naprava operaterja, zlasti za gospodinjski aparat
CN110119208B (zh) * 2019-05-15 2021-04-30 京东方科技集团股份有限公司 悬浮显示成像装置及悬浮显示触控方法

Citations (1)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
WO2005031554A1 (ja) 2003-09-29 2005-04-07 Eit Co., Ltd. 光学式位置検出装置

Family Cites Families (14)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US5317140A (en) * 1992-11-24 1994-05-31 Dunthorn David I Diffusion-assisted position location particularly for visual pen detection
US5949402A (en) * 1997-02-13 1999-09-07 International Business Machines Corporation Optical alignment method for pointing devices
JP3080041B2 (ja) * 1997-09-03 2000-08-21 日本電気株式会社 Ａｂｒのセルフヒーリングにおけるセル廃棄防止装置
JP4033582B2 (ja) * 1998-06-09 2008-01-16 株式会社リコー 座標入力／検出装置および電子黒板システム
JP2002351615A (ja) * 2001-05-24 2002-12-06 Ricoh Co Ltd ディスプレイ装置
US6972401B2 (en) * 2003-01-30 2005-12-06 Smart Technologies Inc. Illuminated bezel and touch system incorporating the same
JP4363174B2 (ja) * 2003-12-16 2009-11-11 富士ゼロックス株式会社 座標入力装置
US7492357B2 (en) * 2004-05-05 2009-02-17 Smart Technologies Ulc Apparatus and method for detecting a pointer relative to a touch surface
JP4590295B2 (ja) * 2005-04-15 2010-12-01 キヤノン株式会社 座標入力装置及びその制御方法、プログラム
JP5415954B2 (ja) * 2006-09-28 2014-02-12 ルミオ インコーポレイテッド 光学式タッチパネル
DE102007021537B4 (de) * 2006-12-13 2020-01-02 Lg Display Co., Ltd. Displayeinheit mit Mehrfachberührungs-Erkennungsfunktion
DE602007003002D1 (de) * 2007-06-29 2009-12-10 Barco Nv Zweifach-Touchscreen
TWI339808B (en) * 2007-09-07 2011-04-01 Quanta Comp Inc Method and system for distinguishing multiple touch points
JP5025552B2 (ja) * 2008-04-16 2012-09-12 キヤノン株式会社 タッチパネル

Patent Citations (1)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
WO2005031554A1 (ja) 2003-09-29 2005-04-07 Eit Co., Ltd. 光学式位置検出装置

Cited By (2)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
FR3005173A1 (fr) * 2013-04-26 2014-10-31 Airbus Procede d'interaction dans un cockpit d'aeronef entre un pilote et son environnement
US9360673B2 (en) 2013-04-26 2016-06-07 Airbus Sas Interaction method in an aircraft cockpit between a pilot and his environment

Also Published As

Publication number Publication date
US20120327034A1 (en) 2012-12-27
FR2976093A1 (fr) 2012-12-07
JP2012252702A (ja) 2012-12-20
CN102830854A (zh) 2012-12-19
FR2976093B1 (fr) 2013-08-16

Similar Documents

Publication Publication Date Title
EP2530564A2 (fr) Système tactile a émetteurs et recepteurs optiques
CN107241467B (zh) 电子装置
TWI420371B (zh) 光學式觸控系統及其運作方法
US8259240B2 (en) Multi-touch sensing through frustrated total internal reflection
EP2188701B1 (en) Multi-touch sensing through frustrated total internal reflection
US10956702B2 (en) Apparatus for recognizing a fingerprint, and display device
CN110741386A (zh) 指纹识别装置和电子设备
US20130100082A1 (en) Touch panels with dynamic zooming and low profile bezels
US20150035799A1 (en) Optical touchscreen
WO2008017077A4 (en) Multi-touch sensing display through frustrated total internal reflection
KR20140016390A (ko) 디스플레이들 및 정보입력장치들
JP2010515971A (ja) 複数のカメラを使用する鏡面反射の低減
US20110227876A1 (en) Interactive Display Device with Infrared Capture Unit
CN102073418A (zh) 坐标定位方法和设备
US11231580B2 (en) Eye tracking device and virtual reality imaging apparatus
US9678600B2 (en) Display device including a display screen with integrated imaging and a method of using same
WO2015033036A1 (fr) Equipements de véhicule automobile intégrant un dispositif de mesure de distance d'objets
EP2507655B1 (fr) Reflecteur optique a lames semi-reflechissantes pour dispositif de detection de position de casque et casque comportant un tel dispositif
JP2006163751A (ja) 位置検出平面外に撮像部を有する光学式位置検出装置
WO2014083103A1 (fr) Dispositif de visualisation comprenant un ecran de visualisation a transparence controlee
US8330736B2 (en) Optical overlay for an electronic display
US9213444B2 (en) Touch device and touch projection system using the same
US11061248B2 (en) Noncontact operation detecting device
US20240135745A1 (en) Electronic device
WO2024074960A1 (en) Display systems using multilayer optical films

Legal Events

Date Code Title Description
PUAI Public reference made under article 153(3) epc to a published international application that has entered the european phase

Free format text: ORIGINAL CODE: 0009012

AK Designated contracting states

Kind code of ref document: A2

Designated state(s): AL AT BE BG CH CY CZ DE DK EE ES FI FR GB GR HR HU IE IS IT LI LT LU LV MC MK MT NL NO PL PT RO RS SE SI SK SM TR

AX Request for extension of the european patent

Extension state: BA ME

STAA Information on the status of an ep patent application or granted ep patent

Free format text: STATUS: THE APPLICATION IS DEEMED TO BE WITHDRAWN

18D Application deemed to be withdrawn

Effective date: 20161201