EP2923233A1 - Optisches augmented-reality-modul - Google Patents

Optisches augmented-reality-modul

Info

Publication number
EP2923233A1
EP2923233A1 EP13815544.5A EP13815544A EP2923233A1 EP 2923233 A1 EP2923233 A1 EP 2923233A1 EP 13815544 A EP13815544 A EP 13815544A EP 2923233 A1 EP2923233 A1 EP 2923233A1
Authority
EP
European Patent Office
Prior art keywords
display
image
user
eye
diopter
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Withdrawn
Application number
EP13815544.5A
Other languages
English (en)
French (fr)
Inventor
Maxime DENEFLE
Zile Liu
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
Laster SA
Original Assignee
Laster SA
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Laster SA filed Critical Laster SA
Publication of EP2923233A1 publication Critical patent/EP2923233A1/de
Withdrawn legal-status Critical Current

Links

Classifications

    • GPHYSICS
    • G02OPTICS
    • G02BOPTICAL ELEMENTS, SYSTEMS OR APPARATUS
    • G02B5/00Optical elements other than lenses
    • G02B5/30Polarising elements
    • GPHYSICS
    • G02OPTICS
    • G02BOPTICAL ELEMENTS, SYSTEMS OR APPARATUS
    • G02B27/00Optical systems or apparatus not provided for by any of the groups G02B1/00 - G02B26/00, G02B30/00
    • G02B27/01Head-up displays
    • G02B27/0101Head-up displays characterised by optical features
    • GPHYSICS
    • G02OPTICS
    • G02BOPTICAL ELEMENTS, SYSTEMS OR APPARATUS
    • G02B27/00Optical systems or apparatus not provided for by any of the groups G02B1/00 - G02B26/00, G02B30/00
    • G02B27/0093Optical systems or apparatus not provided for by any of the groups G02B1/00 - G02B26/00, G02B30/00 with means for monitoring data relating to the user, e.g. head-tracking, eye-tracking
    • GPHYSICS
    • G02OPTICS
    • G02BOPTICAL ELEMENTS, SYSTEMS OR APPARATUS
    • G02B27/00Optical systems or apparatus not provided for by any of the groups G02B1/00 - G02B26/00, G02B30/00
    • G02B27/01Head-up displays
    • G02B27/017Head mounted
    • GPHYSICS
    • G02OPTICS
    • G02BOPTICAL ELEMENTS, SYSTEMS OR APPARATUS
    • G02B27/00Optical systems or apparatus not provided for by any of the groups G02B1/00 - G02B26/00, G02B30/00
    • G02B27/01Head-up displays
    • G02B27/017Head mounted
    • G02B27/0172Head mounted characterised by optical features
    • GPHYSICS
    • G02OPTICS
    • G02BOPTICAL ELEMENTS, SYSTEMS OR APPARATUS
    • G02B27/00Optical systems or apparatus not provided for by any of the groups G02B1/00 - G02B26/00, G02B30/00
    • G02B27/28Optical systems or apparatus not provided for by any of the groups G02B1/00 - G02B26/00, G02B30/00 for polarising
    • G02B27/281Optical systems or apparatus not provided for by any of the groups G02B1/00 - G02B26/00, G02B30/00 for polarising used for attenuating light intensity, e.g. comprising rotatable polarising elements
    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06TIMAGE DATA PROCESSING OR GENERATION, IN GENERAL
    • G06T19/00Manipulating 3D models or images for computer graphics
    • G06T19/006Mixed reality
    • GPHYSICS
    • G02OPTICS
    • G02BOPTICAL ELEMENTS, SYSTEMS OR APPARATUS
    • G02B27/00Optical systems or apparatus not provided for by any of the groups G02B1/00 - G02B26/00, G02B30/00
    • G02B27/01Head-up displays
    • G02B27/0101Head-up displays characterised by optical features
    • G02B2027/011Head-up displays characterised by optical features comprising device for correcting geometrical aberrations, distortion
    • GPHYSICS
    • G02OPTICS
    • G02BOPTICAL ELEMENTS, SYSTEMS OR APPARATUS
    • G02B27/00Optical systems or apparatus not provided for by any of the groups G02B1/00 - G02B26/00, G02B30/00
    • G02B27/01Head-up displays
    • G02B27/0101Head-up displays characterised by optical features
    • G02B2027/0112Head-up displays characterised by optical features comprising device for genereting colour display
    • G02B2027/0116Head-up displays characterised by optical features comprising device for genereting colour display comprising devices for correcting chromatic aberration
    • GPHYSICS
    • G02OPTICS
    • G02BOPTICAL ELEMENTS, SYSTEMS OR APPARATUS
    • G02B27/00Optical systems or apparatus not provided for by any of the groups G02B1/00 - G02B26/00, G02B30/00
    • G02B27/01Head-up displays
    • G02B27/0101Head-up displays characterised by optical features
    • G02B2027/0118Head-up displays characterised by optical features comprising devices for improving the contrast of the display / brillance control visibility
    • GPHYSICS
    • G02OPTICS
    • G02BOPTICAL ELEMENTS, SYSTEMS OR APPARATUS
    • G02B27/00Optical systems or apparatus not provided for by any of the groups G02B1/00 - G02B26/00, G02B30/00
    • G02B27/01Head-up displays
    • G02B27/0101Head-up displays characterised by optical features
    • G02B2027/0123Head-up displays characterised by optical features comprising devices increasing the field of view
    • GPHYSICS
    • G02OPTICS
    • G02BOPTICAL ELEMENTS, SYSTEMS OR APPARATUS
    • G02B27/00Optical systems or apparatus not provided for by any of the groups G02B1/00 - G02B26/00, G02B30/00
    • G02B27/01Head-up displays
    • G02B27/0101Head-up displays characterised by optical features
    • G02B2027/0132Head-up displays characterised by optical features comprising binocular systems
    • GPHYSICS
    • G02OPTICS
    • G02BOPTICAL ELEMENTS, SYSTEMS OR APPARATUS
    • G02B27/00Optical systems or apparatus not provided for by any of the groups G02B1/00 - G02B26/00, G02B30/00
    • G02B27/01Head-up displays
    • G02B27/0101Head-up displays characterised by optical features
    • G02B2027/0138Head-up displays characterised by optical features comprising image capture systems, e.g. camera
    • GPHYSICS
    • G02OPTICS
    • G02BOPTICAL ELEMENTS, SYSTEMS OR APPARATUS
    • G02B27/00Optical systems or apparatus not provided for by any of the groups G02B1/00 - G02B26/00, G02B30/00
    • G02B27/01Head-up displays
    • G02B27/017Head mounted
    • G02B2027/0178Eyeglass type

Definitions

  • the present invention relates mainly to the field of portable augmented reality optical devices, in particular those mounted on the head of a user.
  • optical solutions are transparent but they use an "off-axis" optical path, that is to say outside the main axis of vision of the user, which induces strong optical aberrations, in particular astigmatism, curvature of field and distortion, which reduces the quality of the projected image in the retina.
  • these devices use a certain number of optical elements that are not compatible with the fineness required for a device that one wishes to be able to integrate into an ergonomic pair of glasses.
  • Another problem with current devices is the size of the exit pupil. The pupil of an eye looking at a projected image of average intensity is about 3mm in diameter.
  • the exit pupil that is to say the area of placement of the eye where the user perceives the whole field, must be at least 3 times larger. that the pupil of the eye of the user so that even if the user moves with respect to the system, he continues to perceive a sharp image without vignetting.
  • the object of the invention is in particular to propose a device whose size and complexity are considerably reduced with regard to the existing display systems and designed so that it can be fixed to the head of a user while remaining transparent for her stare.
  • such a device will be advantageously easy to use for consumer applications where ergonomics and simplicity are key elements.
  • such an augmented reality device is characterized in that it comprises:
  • a display for transmitting at least one image in the form of a beam
  • an ocular return diopter disposed substantially transversely to said main optical axis so that it returns the image in the direction of the eye
  • This device may further comprise ophthalmic correction means for adapting the image to the vision of the user.
  • the display is preferably chosen from LCD, OLED and LCOS types.
  • the device may further comprise at least one lens or a group of lenses disposed downstream of the display and upstream of the redirection means, in particular to obtain a desired magnification of the image, preferably by compensating for chromatic aberrations.
  • the redirection means are advantageously a flat or curved semi-reflecting plate, designed to fold the image beam from the display towards an inner face of the diopter, said blade passing without reflection at least part of the beam reflected by said diopter.
  • This semi-reflecting blade comprises a polarizing structure capable of providing the reflection and transmission functions of said blade on one side and significantly reducing the parasitic reflections due to the light coming from the other side of the beam. said blade.
  • the device may also include a micro-camera whose axis is placed substantially parallel to the optical axis of the user's directing eye, an inertial unit, a magnetic compass and a GPS to allow a virtual interaction with the user. environment observed in augmented reality according to the movements and the point of view of the user.
  • the device also comprises a battery and electronic computing and communication means designed to allow wireless use with a smartphone or a computer.
  • the invention also relates to an augmented reality optical system characterized in that it comprises two augmented reality optical devices according to the invention, each for a respective eye of the user.
  • a device or system according to the invention advantageously comprises a load-bearing structure for fixing it to the user's head, preferably of the spectacle frame type, ski mask, protective mask or helmet.
  • FIG. 1 schematically illustrates a vertical axial section of a device according to the invention.
  • FIG. 2 illustrates a section through the thickness of a semireflecting plate for the device of FIG. 1.
  • Figure 1 uses an optical device 1, portable, and intended to provide augmented reality to a user of this device.
  • This device is in an optical configuration called "on the axis", that is to say along an optical axis XI which is substantially the axis of the user's gaze when looking at infinity, in front of him ; this reduces the complexity and weight of such a device.
  • this device 1 comprises a display 2, a semi-reflecting plate 3, a diopter 4, a retardation plate 5, a polarizing film 6 and ophthalmic correction means 7.
  • the display 2 may be of the micro-display type ("microdisplay”), LCOS, LCD or OLED; it is intended to form and emit an image, fixed or animated, in the form of a light beam.
  • the reflective plate 3 is of the PB S type (Polarizing Beam Spliter Plate, in English) is used to fold the optical path of the light beam from the display 2 towards the diopter 4.
  • the diopter 4 is a semi-transparent catadioptric element intended to collimate the beam so as to project the image to infinity in the eye 10 of the user.
  • the retardation plate 5 is a polarized plate of the quarter-wave type.
  • the blade 3 is transparent for polarized P-type light, that is to say polarized in the plane of incidence, and reflects S-polarized light, that is to say perpendicular to the plane of incidence. , when it is positioned at 45 degrees to the optical axis XI.
  • the display 2 comprises means of polarization or is juxtaposed with a polarizer, so that the emitted light is polarized S, so that it is reflected by the reflecting plate 3. Once reflected by the reflecting plate 3, this light It crosses the retardation plate 5 which converts the S polarization of the light into a circular polarization.
  • An assembly not represented in the figures, consisting of optical lenses coupled to a semi-reflecting catadioptric element, intended to obtain a desired magnification while compensating for chromatic aberrations, is placed immediately downstream of the display 2.
  • optical path traveled by an image transmitted by the broadcaster 2 can be described as follows:
  • a semi-reflective plate 3 of the PB S type instead of a semi-reflective mirror type plate, significantly increases the brightness of the device when the display is of the LCD or LCOS type.
  • the light transmission ratio for the optical path of the device of FIG. 1 is 77% with a PBS blade against 25% with a semi-reflective mirror.
  • a semi-reflective mirror may nevertheless be used for a lower cost architecture.
  • the use for the diopter 4 of a semi-reflecting catadioptric element 4 in the frontal position makes it possible to compensate for the spherical aberrations and does not add any prismatic effect or distortion when the user looks through the device.
  • the interest of such catadioptric elements is the possibility of using large diameters without increasing the chromatic aberrations as with the refractive elements.
  • the use of a spherical or aspheric diopter coupled to the flat or semi-reflective curved blade also makes it possible to significantly increase the display field.
  • the diopter 4 is preferably made of polycarbonate with a semi-reflective inner surface 14, which can be aspherical, to optimize them. performance.
  • the internal transmission of the diopter 4 is optimized to ensure a good contrast between the projected image and the scene 11 observed.
  • Semi-reflective holographic processing can be used instead of thin-film semi-reflective processing to improve the brightness of projected images when projecting a monochromatic or RGB image.
  • the outer face 15 of the diopter 4 is calculated to cancel the prismatic effects for the vision in transparency, thus the natural vision of the scene 11 by the user is preserved.
  • the retardation plate 5 may take the form of a polymer film. To facilitate the assembly of the device, it can be thermoformed to directly adapt to the curvature of the diopter 4.
  • the geometry and the curvature of the inner surface 14 of the diopter 4 and those of the lenses of the assembly coupled to the diffuser can be optimized to adapt the magnification of the optical system to different screen sizes of the diffuser 2.
  • FIG. 2 illustrates a section along the thickness of the semi-reflecting plate 3.
  • the blade 3 comprises 6 layers 21-26 which are:
  • a polarizing and reflecting structure 21 constituted by a film of the type
  • a polymer substrate 23 for example a PMMA or a polycarbonate
  • the polarizer 6, although not essential, can be placed on the path between the semi-reflecting plate 3 and the user's eye 10, in order to advantageously filter the non-polarized portion P of the light which would be produced by a parasitic reflection on the semi-reflecting plate 3 if it does not include the structure 17.
  • the polarizer 6 is a film advantageously deposited on the correction means 7, making it possible to adapt the image to the vision of the user.
  • a device such as that of Figure 1 has a very small footprint, the eye relief ("eye relief" in English) is 15mm; the complete device 1 may have a size of 30 x 25 x 17 mm; it is for example completely integrable in a pair of ergonomic sunglasses.
  • a device according to the invention represents an improvement over the state of the art through the use of a semi-reflective plate coupled to a semi-reflective spherical frontal surface 14 which significantly reduces aberrations and vignetting of the natural field of view.
  • the exit pupil is also easily increased from 9mm to 15mm in diameter depending on the version of the architecture.
  • such an optical device 1 can be used in pairs so as to produce a small binocular augmented reality device.
  • This system would for example be easily compatible for a population group with an IPD ("interpupillary distance", inter-pupillary distance, in French) between 52 and 65mm without requiring any adjustment.
  • the micro-display 1 is located above so that the natural field of view of the user is preserved; consider HFOV (horizontal) natural at least 160 ° and VFOV (vertically) greater than 100 °.
  • the device 1 does not reduce the natural field of view while having a reduced form factor, so it can be used in a large number of applications where the perceived scene is as important as the information or projected images.
  • the device can advantageously be coupled to a micro-camera or motion sensors linked to the user's head (gyroscopes, accelerometers, etc.) so as to interact with the observed scene.
  • a micro-camera or motion sensors linked to the user's head gyroscopes, accelerometers, etc.
  • Other options such as voice recognition, an inertial unit or a tracking device (GPS %) can be added to improve the immersion and user experience.
  • the device may not include ophthalmic correction means.
  • ophthalmic correction means In the case where a correction is used, the ocular clearance is reduced by a few mm.
  • the correction can be applied directly to the semi-reflective frontal glass or by adding ophthalmic clips.
  • the choice of the display used among types LCD, OLED or LCOS is done according to the needs of the intended application, in terms of brightness, color rendering and costs.
  • these lenses can be replaced by hybrid lenses coupled with a Fresnel lens.
  • these components can be molded in polycarbonate to optimize costs.
  • the display may be disposed laterally relative to that axis, for example on one side or below.

Landscapes

  • Physics & Mathematics (AREA)
  • General Physics & Mathematics (AREA)
  • Optics & Photonics (AREA)
  • Engineering & Computer Science (AREA)
  • Computer Graphics (AREA)
  • Computer Hardware Design (AREA)
  • General Engineering & Computer Science (AREA)
  • Software Systems (AREA)
  • Theoretical Computer Science (AREA)
EP13815544.5A 2012-11-21 2013-11-21 Optisches augmented-reality-modul Withdrawn EP2923233A1 (de)

Applications Claiming Priority (2)

Application Number Priority Date Filing Date Title
FR1261080 2012-11-21
PCT/FR2013/052812 WO2014080129A1 (fr) 2012-11-21 2013-11-21 Module optique de réalité augmentée

Publications (1)

Publication Number Publication Date
EP2923233A1 true EP2923233A1 (de) 2015-09-30

Family

ID=49911725

Family Applications (1)

Application Number Title Priority Date Filing Date
EP13815544.5A Withdrawn EP2923233A1 (de) 2012-11-21 2013-11-21 Optisches augmented-reality-modul

Country Status (4)

Country Link
US (1) US20150301336A1 (de)
EP (1) EP2923233A1 (de)
CN (1) CN104903777A (de)
WO (1) WO2014080129A1 (de)

Cited By (1)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN108391231A (zh) * 2018-03-03 2018-08-10 宋彦震 基于ar的滑雪盲区显示系统及其控制方法

Families Citing this family (26)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US9507066B2 (en) * 2014-06-30 2016-11-29 Microsoft Technology Licensing, Llc Eyepiece for near eye display system
IL235642B (en) * 2014-11-11 2021-08-31 Lumus Ltd A compact head-up display system is protected by an element with a super-thin structure
KR20180104056A (ko) 2016-01-22 2018-09-19 코닝 인코포레이티드 와이드 필드 개인 디스플레이
US10459230B2 (en) * 2016-02-02 2019-10-29 Disney Enterprises, Inc. Compact augmented reality / virtual reality display
CN107664840A (zh) * 2016-07-28 2018-02-06 中强光电股份有限公司 头戴式显示装置
CN107664839A (zh) * 2016-07-28 2018-02-06 中强光电股份有限公司 头戴式显示装置
CN106842571A (zh) * 2017-01-18 2017-06-13 上海乐蜗信息科技有限公司 增强现实设备的光学系统
CN107065181B (zh) * 2017-01-18 2020-02-07 上海乐蜗信息科技有限公司 虚拟现实设备的光学系统
CN108333750B (zh) * 2017-01-19 2020-07-17 台达电子工业股份有限公司 近眼显示装置
TWI619996B (zh) 2017-01-19 2018-04-01 台達電子工業股份有限公司 近眼顯示裝置
WO2018196108A1 (zh) * 2017-04-28 2018-11-01 歌尔科技有限公司 一种光学模组及增强现实眼镜
CN107065189B (zh) * 2017-04-28 2019-12-13 歌尔科技有限公司 一种光学模组及增强现实眼镜
WO2018221867A1 (ko) * 2017-05-27 2018-12-06 이문기 거울을 이용한 투명한 안경형 디스플레이
US10976551B2 (en) 2017-08-30 2021-04-13 Corning Incorporated Wide field personal display device
CN107861247B (zh) 2017-12-22 2020-08-25 联想(北京)有限公司 光学部件及增强现实设备
CN108107581A (zh) * 2017-12-27 2018-06-01 上海摩软通讯技术有限公司 头戴式显示设备
CN110161688A (zh) * 2018-02-12 2019-08-23 杭州太若科技有限公司 屈光矫正ar显示装置和穿戴式ar设备
CN110161689A (zh) * 2018-02-12 2019-08-23 杭州太若科技有限公司 Ar显示装置和穿戴式ar设备
JP7285579B2 (ja) * 2018-02-12 2023-06-02 マトリックスド、リアリティー、テクノロジー、カンパニー、リミテッド 拡張現実装置、およびそのための光学系
CN110161692A (zh) 2018-07-16 2019-08-23 上海视涯信息科技有限公司 一种虚拟现实显示装置
CN111624767B (zh) * 2019-02-28 2022-03-04 京东方科技集团股份有限公司 近眼显示装置
CN109709676A (zh) * 2019-03-07 2019-05-03 浙江水晶光电科技股份有限公司 一种增强现实光学模组及增强现实装置
CN112444979A (zh) * 2019-09-03 2021-03-05 舜宇光学(浙江)研究院有限公司 近眼显示光学系统和近眼显示设备
CN110927979B (zh) * 2019-12-17 2023-04-14 程楷琳 一种数字屏投远放大阅读系统
US11360308B2 (en) * 2020-01-22 2022-06-14 Facebook Technologies, Llc Optical assembly with holographic optics for folded optical path
CN115704958A (zh) * 2021-08-16 2023-02-17 华为技术有限公司 一种光学成像系统及控制方法

Family Cites Families (5)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
JP3197350B2 (ja) * 1992-08-05 2001-08-13 オリンパス光学工業株式会社 頭部又は顔面装着式ディスプレイ装置
JP3151771B2 (ja) * 1993-10-29 2001-04-03 キヤノン株式会社 画像表示装置
GB9415894D0 (en) * 1994-08-05 1994-09-28 Central Research Lab Ltd An apparatus for displaying an image
JPH1195160A (ja) * 1997-09-19 1999-04-09 Seiko Epson Corp 頭部装着型表示装置
US9182596B2 (en) * 2010-02-28 2015-11-10 Microsoft Technology Licensing, Llc See-through near-eye display glasses with the optical assembly including absorptive polarizers or anti-reflective coatings to reduce stray light

Non-Patent Citations (1)

* Cited by examiner, † Cited by third party
Title
See references of WO2014080129A1 *

Cited By (1)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN108391231A (zh) * 2018-03-03 2018-08-10 宋彦震 基于ar的滑雪盲区显示系统及其控制方法

Also Published As

Publication number Publication date
US20150301336A1 (en) 2015-10-22
WO2014080129A1 (fr) 2014-05-30
CN104903777A (zh) 2015-09-09

Similar Documents

Publication Publication Date Title
WO2014080129A1 (fr) Module optique de réalité augmentée
US11042040B2 (en) Augmented reality apparatus and optical system therefor
US10365491B1 (en) Head-mounted display including diffractive combiner to integrate a display and an eye-tracking sensor
US9671614B2 (en) See-through eyepiece for head wearable display
US9335549B2 (en) Imaging lightguide with holographic boundaries
US10139628B2 (en) Head-mounted display
CA2628871C (en) Polarizing optical system
US9915823B1 (en) Lightguide optical combiner for head wearable display
EP3215884B1 (de) Kopfmontierte anzeigevorrichtung mit gekreuzter optik
FR2873212A1 (fr) Lentille opthalmique destinee a la realisation d'un afficheur optique
US9389422B1 (en) Eyepiece for head wearable display using partial and total internal reflections
EP0011024A1 (de) Helmsichtsystem
WO2008003903A2 (fr) Lentille ophtalmique à insert optique intégré destiné à permettre la projection d'informations
EP1929356B1 (de) Optische einrichtung zum überlagern von elektronischen bildern vor einer linse
US20180373038A1 (en) Optics of wearable display devices
EP1258771A1 (de) Raumsparende optische Architektur für Helmvisier mit grossem Sichtfeld
FR3017966A1 (fr) Dispositif optique binoculaire pour lunette a realite augmentee
US20220128744A1 (en) Broadband reflector for waveguide assembly in a head-mounted display
EP1763695B1 (de) Ophthalmische anzeige mit vorrichtung zur anpassung an den pupillenabstand des benutzers
EP1730577A1 (de) Optische pipeline zur herstellung einer elektronischen display-anordnung
WO2013068688A2 (fr) Dispositif portable de vision augmentee.
WO2008099116A2 (fr) Dispositif d'affichage opto-electronique a insert optique encapsule dans une lentille ophtalmique
WO2022175813A1 (en) Foveated optical lens for near eye display

Legal Events

Date Code Title Description
PUAI Public reference made under article 153(3) epc to a published international application that has entered the european phase

Free format text: ORIGINAL CODE: 0009012

17P Request for examination filed

Effective date: 20150601

AK Designated contracting states

Kind code of ref document: A1

Designated state(s): AL AT BE BG CH CY CZ DE DK EE ES FI FR GB GR HR HU IE IS IT LI LT LU LV MC MK MT NL NO PL PT RO RS SE SI SK SM TR

AX Request for extension of the european patent

Extension state: BA ME

DAX Request for extension of the european patent (deleted)
STAA Information on the status of an ep patent application or granted ep patent

Free format text: STATUS: THE APPLICATION IS DEEMED TO BE WITHDRAWN

18D Application deemed to be withdrawn

Effective date: 20180602