EP3633419A1 - Visiocasque - Google Patents
Visiocasque Download PDFInfo
- Publication number
- EP3633419A1 EP3633419A1 EP19201472.8A EP19201472A EP3633419A1 EP 3633419 A1 EP3633419 A1 EP 3633419A1 EP 19201472 A EP19201472 A EP 19201472A EP 3633419 A1 EP3633419 A1 EP 3633419A1
- Authority
- EP
- European Patent Office
- Prior art keywords
- display
- head
- micro lenses
- central
- mounted display
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Granted
Links
- 230000003287 optical effect Effects 0.000 claims abstract description 29
- 230000002093 peripheral effect Effects 0.000 claims description 20
- 230000000694 effects Effects 0.000 description 6
- 230000004075 alteration Effects 0.000 description 5
- 238000010586 diagram Methods 0.000 description 4
- 238000007654 immersion Methods 0.000 description 4
- 238000012986 modification Methods 0.000 description 3
- 230000004048 modification Effects 0.000 description 3
- 210000001747 pupil Anatomy 0.000 description 3
- 238000013459 approach Methods 0.000 description 2
- 230000004456 color vision Effects 0.000 description 2
- 210000003128 head Anatomy 0.000 description 2
- 210000001525 retina Anatomy 0.000 description 2
- 230000035945 sensitivity Effects 0.000 description 2
- 238000004891 communication Methods 0.000 description 1
- 238000013461 design Methods 0.000 description 1
- 238000011161 development Methods 0.000 description 1
- 239000003814 drug Substances 0.000 description 1
- 238000005516 engineering process Methods 0.000 description 1
- 238000001746 injection moulding Methods 0.000 description 1
- 230000003993 interaction Effects 0.000 description 1
- 238000004519 manufacturing process Methods 0.000 description 1
- 230000035479 physiological effects, processes and functions Effects 0.000 description 1
- 229920003023 plastic Polymers 0.000 description 1
- 238000004088 simulation Methods 0.000 description 1
- 238000012549 training Methods 0.000 description 1
- 230000000007 visual effect Effects 0.000 description 1
Images
Classifications
-
- G—PHYSICS
- G02—OPTICS
- G02B—OPTICAL ELEMENTS, SYSTEMS OR APPARATUS
- G02B3/00—Simple or compound lenses
- G02B3/0006—Arrays
- G02B3/0037—Arrays characterized by the distribution or form of lenses
-
- G—PHYSICS
- G02—OPTICS
- G02B—OPTICAL ELEMENTS, SYSTEMS OR APPARATUS
- G02B3/00—Simple or compound lenses
- G02B3/0006—Arrays
- G02B3/0037—Arrays characterized by the distribution or form of lenses
- G02B3/0056—Arrays characterized by the distribution or form of lenses arranged along two different directions in a plane, e.g. honeycomb arrangement of lenses
-
- G—PHYSICS
- G02—OPTICS
- G02B—OPTICAL ELEMENTS, SYSTEMS OR APPARATUS
- G02B27/00—Optical systems or apparatus not provided for by any of the groups G02B1/00 - G02B26/00, G02B30/00
- G02B27/0075—Optical systems or apparatus not provided for by any of the groups G02B1/00 - G02B26/00, G02B30/00 with means for altering, e.g. increasing, the depth of field or depth of focus
-
- G—PHYSICS
- G02—OPTICS
- G02B—OPTICAL ELEMENTS, SYSTEMS OR APPARATUS
- G02B27/00—Optical systems or apparatus not provided for by any of the groups G02B1/00 - G02B26/00, G02B30/00
- G02B27/01—Head-up displays
- G02B27/017—Head mounted
- G02B27/0172—Head mounted characterised by optical features
-
- G—PHYSICS
- G02—OPTICS
- G02B—OPTICAL ELEMENTS, SYSTEMS OR APPARATUS
- G02B30/00—Optical systems or apparatus for producing three-dimensional [3D] effects, e.g. stereoscopic images
- G02B30/10—Optical systems or apparatus for producing three-dimensional [3D] effects, e.g. stereoscopic images using integral imaging methods
-
- G—PHYSICS
- G02—OPTICS
- G02B—OPTICAL ELEMENTS, SYSTEMS OR APPARATUS
- G02B3/00—Simple or compound lenses
- G02B2003/0093—Simple or compound lenses characterised by the shape
-
- G—PHYSICS
- G02—OPTICS
- G02B—OPTICAL ELEMENTS, SYSTEMS OR APPARATUS
- G02B27/00—Optical systems or apparatus not provided for by any of the groups G02B1/00 - G02B26/00, G02B30/00
- G02B27/01—Head-up displays
- G02B27/0101—Head-up displays characterised by optical features
- G02B2027/0123—Head-up displays characterised by optical features comprising devices increasing the field of view
-
- G—PHYSICS
- G02—OPTICS
- G02B—OPTICAL ELEMENTS, SYSTEMS OR APPARATUS
- G02B27/00—Optical systems or apparatus not provided for by any of the groups G02B1/00 - G02B26/00, G02B30/00
- G02B27/01—Head-up displays
- G02B27/0101—Head-up displays characterised by optical features
- G02B2027/0132—Head-up displays characterised by optical features comprising binocular systems
- G02B2027/0134—Head-up displays characterised by optical features comprising binocular systems of stereoscopic type
-
- G—PHYSICS
- G02—OPTICS
- G02B—OPTICAL ELEMENTS, SYSTEMS OR APPARATUS
- G02B27/00—Optical systems or apparatus not provided for by any of the groups G02B1/00 - G02B26/00, G02B30/00
- G02B27/01—Head-up displays
- G02B27/017—Head mounted
- G02B2027/0178—Eyeglass type
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F1/00—Details not covered by groups G06F3/00 - G06F13/00 and G06F21/00
- G06F1/16—Constructional details or arrangements
- G06F1/1613—Constructional details or arrangements for portable computers
- G06F1/163—Wearable computers, e.g. on a belt
Definitions
- the present disclosure relates to a head-mounted display.
- HMDs head-mounted displays
- This type of display has multiple commercial applications involving simulation of virtual reality including video games, medicine, sport training, entertainment applications, and so forth.
- these displays may be used, for example, to render three-dimensional (3D) virtual game worlds.
- the optical system For a head-mounted display, there is a need for the optical system to have a wide field of view (FOV), e.g., greater than 120 degrees.
- FOV field of view
- the wide field of view increases the sense of immersion and allows the users to observe mobile object better.
- the development of a wide FOV head mounted display has been a technological challenge for decades.
- Some kinds of conventional head-mounted displays tackled this problem using multiple display units (tiling) or multiple curved mirrors.
- the former approach tends to be expensive and heavy, whereas the latter approach tends to suffer from image distortion and a small exit pupil.
- the manufacturing accuracy of the curved Fresnel lens is hard to control, and optical aberration and stray light are easily produced while using the curved Fresnel lens.
- An aspect of the disclosure is to provide a head-mounted display that can efficiently solve the aforementioned problems.
- a head-mounted display includes an optical component.
- the optical component includes a plurality of micro lenses and a central lens.
- the micro lenses are connected to each other.
- the central lens is connected among and surrounded by the micro lenses.
- the central lens and the micro lenses are substantially arranged along a plane.
- the central lens and the micro lenses of the optical component form a unitary lens structure.
- a lateral length of the central lens is greater than a lateral length of any of the micro lenses.
- the lateral lengths are measured along one dimension of the plane.
- the lateral length of the central lens is about 4 to 50 times the lateral length of any of the micro lenses.
- a shape of a peripheral edge of the central lens is substantially circular.
- a shape of a peripheral edge of one of the micro lenses is at least a part of a hexagon.
- the head-mounted display further includes a display panel having a display surface.
- the display surface faces the optical component.
- the display surface includes a central display region and a peripheral display region surrounding the central display region.
- the central lens has an optical axis passing through the central display region.
- the display panel is configured to display a central image at the central display region and a plurality of light field images at the peripheral display region.
- the display surface is a flat surface.
- the display surface is a concave surface.
- one of the micro lenses that is directly connected to the central lens is smoothly connected to a peripheral edge of the central lens.
- the head-mounted display of the present disclosure provides an optical component combining a central lens and a plurality of micro lenses to widen the field of view.
- the optical component is cheap and light, and well-known problems (e.g., image distortion, small exit pupil, optical aberration, stray light, etc.) can be effectively solved.
- the micro lenses can be used to present the depth effect of light field, such that the sense of immersion can be further enhanced by the depth effect.
- Fig. 1 is a schematic diagram illustrating a user wearing a head-mounted display 100 according to some embodiments of the present disclosure.
- the head-mounted display 100 includes a housing 110 configured to be worn on the head of the user.
- the head-mounted display 100 may communicate wirelessly (e.g., WiFi, Bluetooth, etc.) with a computing device.
- the head-mounted display 100 may be wired directly to the computing device or in communication with the computing device via a network (e.g., the Internet).
- the computing device may be a server on a network that provides video or game services.
- the head-mounted display 100 is a game playing device and the game is executed directly on the head-mounted display, without the need of an external device to run the game.
- Fig. 2 is a schematic view of components of the head-mounted display 100 according to some embodiments of the present disclosure.
- the head-mounted display 100 further includes an optical component 120 and a display panel 130.
- the optical component 120 and the display panel 130 are disposed on the housing 110.
- the display panel 130 is configured to display images.
- the optical component 120 is configured to transmit the images to an eye of the user.
- Fig. 3 is a front view of the optical component 120 as shown in Fig. 2 according to some embodiments of the present disclosure.
- the optical component 120 includes a plurality of micro lenses 121 and a central lens 122.
- the micro lenses 121 are connected to each other.
- the central lens 122 is connected among and surrounded by the micro lenses 121.
- the central lens 122 and the micro lenses 121 are substantially arranged along a plane P. That is to say, the micro lenses 121 and the central lens 122 are connected side by side.
- the display panel 130 has a display surface 131.
- the display surface 131 faces the optical component 120.
- the display surface 131 includes a central display region 131a and a peripheral display region 131b surrounding the central display region 131a.
- the central lens 122 has an optical axis A passing through the central display region 131a.
- the object distance of the central lens 122 corresponds to the central display region 131a, and the object distances of the micro lenses 121 correspond to the peripheral display region 131b.
- the central lens 122 is configured to magnify the image content displayed in the central display region 131a and present a high-resolution virtual image, while the micro lenses 121 are configured to magnify the image content displayed in the peripheral display region 131b and present a virtual image with a lower resolution.
- the central lens 122 adopts a surface design, which has a high resolution and is designed to meet the high resolution requirements of the central field of view. Although the resolution of the surrounding micro lenses 121 is not as high as that of the central lens 122, it can meet the low resolution requirements of the peripheral field of view.
- Fig. 4 is a schematic diagram illustrating a human field of view (FOV).
- FOV human field of view
- the macular portion located in the retina has the highest sensitivity to color vision, and thus has the greatest resolution for images.
- the angle of view corresponding to the central region (i.e., the fovea) of the macular portion is about 5 degrees
- the peripheral region of the macular portion is from about 8 degrees to about 18 degrees.
- the color vision sensitivity is lower, and the corresponding angle of view ranges from about 18 degrees to about 60 degrees, and even the maximum angle of view can reach about 110 degrees.
- the central field of view (about ⁇ 30 degrees relative to the viewing direction) is the clearest, and the peripheral field of view is more blurred and unclear. It should be pointed out that due to physiological limitations, the angle of rotation of the human eye is about 60 degrees.
- the central lens 122 covers a field of view of about 120 degrees, so it is sufficient to meet the resolution requirements of the central field of view of the human eye.
- the central lens 122 and the micro lenses 121 of the optical component 120 form a unitary lens structure.
- the optical component 120 may be made of a transparent plastic by an injection molding process, but the disclosure is not limited in this regard.
- a lateral length L1 of the central lens 122 is greater than a lateral length L2 of any of the micro lenses 121.
- the lateral lengths L1, L2 are measured along one dimension of the plane P.
- the lateral length L1 of the central lens 122 is about 4 to 50 times the lateral length L2 of any of the micro lenses 121.
- the lateral length L1 of the central lens 122 is from about 40 mm to about 50 mm, and the lateral length L2 of any of the micro lenses 121 is from about 1 mm to 10 mm, but the disclosure is not limited in this regard.
- a shape of a peripheral edge 122a of the central lens 122 is substantially circular, but the disclosure is not limited in this regard.
- a shape of a peripheral edge 121a of each of the micro lenses 121 is at least a part of a hexagon, such that the micro lenses 121 can be stacked along the plane P more closely, but the disclosure is not limited in this regard.
- the display panel 130 is configured to display the same type of image at the central display region 131a and the peripheral display region 131b, but the disclosure is not limited in this regard. In some other embodiments, the display panel 130 is configured to display a central image at the central display region 131a and a plurality of light field images at the peripheral display region 131b. As such, the micro lenses 121 can be used to present the depth effect of light field, such that the sense of immersion can be further enhanced by the depth effect.
- Fig. 5 is a schematic view of components of a head-mounted display 200 according to some embodiments of the present disclosure.
- the display panel 230 of the embodiments as shown in Fig. 5 has a display surface 231 which is a concave surface. That is to say, the display panel 230 is a curved panel or a freeform panel.
- the head-mounted display 200 can provide a larger field of view with the same panel width and effectively solve the problems of field curvature aberration and distortion aberration.
- the micro lenses 121 that are directly connected to the central lens 122 are smoothly connected to a peripheral edge 122a of the central lens 122. Furthermore, by adjusting the curvatures of the central lens 122 and the micro lenses 121 directly connected thereto, the purpose of eliminating the sense of discontinuity in the displayed image as mentioned above can also be achieved.
- the head-mounted display of the present disclosure provides an optical component combining a central lens and a plurality of micro lenses to widen the field of view.
- the optical component is cheap and light, and well-known problems (e.g., image distortion, small exit pupil, optical aberration, stray light, etc.) can be effectively solved.
- the micro lenses can be used to present the depth effect of light field, such that the sense of immersion can be further enhanced by the depth effect.
Landscapes
- Physics & Mathematics (AREA)
- General Physics & Mathematics (AREA)
- Optics & Photonics (AREA)
Applications Claiming Priority (1)
Application Number | Priority Date | Filing Date | Title |
---|---|---|---|
US201862741552P | 2018-10-05 | 2018-10-05 |
Publications (2)
Publication Number | Publication Date |
---|---|
EP3633419A1 true EP3633419A1 (fr) | 2020-04-08 |
EP3633419B1 EP3633419B1 (fr) | 2021-05-26 |
Family
ID=68158939
Family Applications (1)
Application Number | Title | Priority Date | Filing Date |
---|---|---|---|
EP19201472.8A Active EP3633419B1 (fr) | 2018-10-05 | 2019-10-04 | Visiocasque |
Country Status (4)
Country | Link |
---|---|
US (1) | US11137526B2 (fr) |
EP (1) | EP3633419B1 (fr) |
CN (1) | CN111007667A (fr) |
TW (1) | TWI690733B (fr) |
Cited By (3)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
WO2022272148A1 (fr) * | 2021-06-24 | 2022-12-29 | Meta Platforms Technologies, Llc | Dispositifs d'affichage à champ lumineux de forme libre pour casques vr/ar |
US11740473B2 (en) | 2021-06-24 | 2023-08-29 | Meta Platforms Technologies, Llc | Flexible displays for VR/AR headsets |
US11789280B2 (en) | 2020-07-22 | 2023-10-17 | Meta Platforms Technologies, Llc | Peripheral light field display |
Families Citing this family (1)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
US11467320B2 (en) * | 2020-12-24 | 2022-10-11 | Microsoft Technology Licensing, Llc | Head mounted display device having dynamically addressable shutter array |
Citations (3)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
US20170171533A1 (en) * | 2013-11-25 | 2017-06-15 | Tesseland Llc | Immersive compact display glasses |
CN206270594U (zh) * | 2016-12-15 | 2017-06-20 | 金华唯见科技有限公司 | 一种用于虚拟现实的近眼显示系统及头戴显示设备 |
US20180210208A1 (en) * | 2017-01-25 | 2018-07-26 | Samsung Electronics Co., Ltd. | Head-mounted apparatus, and method thereof for generating 3d image information |
Family Cites Families (5)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
US10502391B2 (en) * | 2013-12-05 | 2019-12-10 | Harman Professional Denmark Aps | Light collector with a plurality of lenslets packed in an optimized dense circular pattern |
CN103823305B (zh) | 2014-03-06 | 2016-09-14 | 成都贝思达光电科技有限公司 | 一种基于曲面微透镜阵列的近眼显示光学系统 |
CN105717640B (zh) | 2014-12-05 | 2018-03-30 | 北京蚁视科技有限公司 | 基于微透镜阵列的近眼显示器 |
US9681804B2 (en) | 2015-01-12 | 2017-06-20 | X Development Llc | Hybrid lens system for head wearable display |
CN106019605B (zh) | 2016-08-04 | 2018-03-23 | 京东方科技集团股份有限公司 | 近眼显示装置和方法 |
-
2019
- 2019-10-04 EP EP19201472.8A patent/EP3633419B1/fr active Active
- 2019-10-04 US US16/592,782 patent/US11137526B2/en active Active
- 2019-10-05 TW TW108136195A patent/TWI690733B/zh active
- 2019-10-08 CN CN201910949794.9A patent/CN111007667A/zh active Pending
Patent Citations (3)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
US20170171533A1 (en) * | 2013-11-25 | 2017-06-15 | Tesseland Llc | Immersive compact display glasses |
CN206270594U (zh) * | 2016-12-15 | 2017-06-20 | 金华唯见科技有限公司 | 一种用于虚拟现实的近眼显示系统及头戴显示设备 |
US20180210208A1 (en) * | 2017-01-25 | 2018-07-26 | Samsung Electronics Co., Ltd. | Head-mounted apparatus, and method thereof for generating 3d image information |
Cited By (3)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
US11789280B2 (en) | 2020-07-22 | 2023-10-17 | Meta Platforms Technologies, Llc | Peripheral light field display |
WO2022272148A1 (fr) * | 2021-06-24 | 2022-12-29 | Meta Platforms Technologies, Llc | Dispositifs d'affichage à champ lumineux de forme libre pour casques vr/ar |
US11740473B2 (en) | 2021-06-24 | 2023-08-29 | Meta Platforms Technologies, Llc | Flexible displays for VR/AR headsets |
Also Published As
Publication number | Publication date |
---|---|
US20200110198A1 (en) | 2020-04-09 |
EP3633419B1 (fr) | 2021-05-26 |
TW202014759A (zh) | 2020-04-16 |
US11137526B2 (en) | 2021-10-05 |
CN111007667A (zh) | 2020-04-14 |
TWI690733B (zh) | 2020-04-11 |
Similar Documents
Publication | Publication Date | Title |
---|---|---|
US11137526B2 (en) | Head-mounted display | |
RU2623708C2 (ru) | Компактный наголовный дисплей с отслеживанием движения глаз | |
KR101916079B1 (ko) | 하나 또는 그 이상의 프레넬 렌즈를 수반하는 헤드 장착 디스플레이 장치 | |
KR101928764B1 (ko) | 하나 이상의 반사 광학 표면이 수반된 헤드 장착 디스플레이 장치 | |
JP6859362B2 (ja) | 頭部装着型仮想現実表示装置 | |
JPWO2018008577A1 (ja) | 頭部装着型ディスプレイ装置 | |
CN112236716B (zh) | 包括用于头戴式显示器的光导的光学设备 | |
US11454783B2 (en) | Tiled triplet lenses providing a wide field of view | |
US20190349506A1 (en) | Virtual reality head-mounted apparatus | |
CN107783291B (zh) | 真三维全息显示头戴式可视设备 | |
KR101590825B1 (ko) | 헤드 마운티드 디스플레이 장치용 복합 렌즈 및 이를 포함하는 디스플레이 장치 | |
US20220146856A1 (en) | Head-mounted display apparatus | |
GB2274727A (en) | Optical display system | |
CN110089112A (zh) | 用于车辆仪表板的固定的深度显示器 | |
JP2022514806A (ja) | 広視野角・高画質接眼レンズ光学システム及び設備 | |
TW202104985A (zh) | 後置式頭戴虛擬實境(vr)顯示裝置 | |
CN111399219A (zh) | 虚拟现实镜组、设备以及系统 | |
WO2023133192A1 (fr) | Systèmes d'affichage comportant des réseaux orientés pour réduire les apparitions d'images fantômes | |
CN213843671U (zh) | 头戴型显示器的光学系统 | |
US20230084541A1 (en) | Compact imaging optics using spatially located, free form optical components for distortion compensation and image clarity enhancement | |
US9857592B2 (en) | Display device | |
JP7177356B2 (ja) | パーソナルディスプレイ用の接眼レンズ及びこのような接眼レンズを含むパーソナルディスプレイ | |
CN209765166U (zh) | 虚拟现实镜组、设备以及系统 | |
RU181214U1 (ru) | Устройство для создания стереоскопического изображения | |
TWI755954B (zh) | 頭戴型顯示器之光學系統 |
Legal Events
Date | Code | Title | Description |
---|---|---|---|
STAA | Information on the status of an ep patent application or granted ep patent |
Free format text: STATUS: EXAMINATION IS IN PROGRESS |
|
PUAI | Public reference made under article 153(3) epc to a published international application that has entered the european phase |
Free format text: ORIGINAL CODE: 0009012 |
|
17P | Request for examination filed |
Effective date: 20191004 |
|
AK | Designated contracting states |
Kind code of ref document: A1 Designated state(s): AL AT BE BG CH CY CZ DE DK EE ES FI FR GB GR HR HU IE IS IT LI LT LU LV MC MK MT NL NO PL PT RO RS SE SI SK SM TR |
|
AX | Request for extension of the european patent |
Extension state: BA ME |
|
RBV | Designated contracting states (corrected) |
Designated state(s): AL AT BE BG CH CY CZ DE DK EE ES FI FR GB GR HR HU IE IS IT LI LT LU LV MC MK MT NL NO PL PT RO RS SE SI SK SM TR |
|
GRAP | Despatch of communication of intention to grant a patent |
Free format text: ORIGINAL CODE: EPIDOSNIGR1 |
|
STAA | Information on the status of an ep patent application or granted ep patent |
Free format text: STATUS: GRANT OF PATENT IS INTENDED |
|
INTG | Intention to grant announced |
Effective date: 20201218 |
|
GRAS | Grant fee paid |
Free format text: ORIGINAL CODE: EPIDOSNIGR3 |
|
GRAA | (expected) grant |
Free format text: ORIGINAL CODE: 0009210 |
|
STAA | Information on the status of an ep patent application or granted ep patent |
Free format text: STATUS: THE PATENT HAS BEEN GRANTED |
|
AK | Designated contracting states |
Kind code of ref document: B1 Designated state(s): AL AT BE BG CH CY CZ DE DK EE ES FI FR GB GR HR HU IE IS IT LI LT LU LV MC MK MT NL NO PL PT RO RS SE SI SK SM TR |
|
REG | Reference to a national code |
Ref country code: GB Ref legal event code: FG4D |
|
REG | Reference to a national code |
Ref country code: CH Ref legal event code: EP |
|
REG | Reference to a national code |
Ref country code: AT Ref legal event code: REF Ref document number: 1396785 Country of ref document: AT Kind code of ref document: T Effective date: 20210615 |
|
REG | Reference to a national code |
Ref country code: DE Ref legal event code: R096 Ref document number: 602019004892 Country of ref document: DE |
|
REG | Reference to a national code |
Ref country code: IE Ref legal event code: FG4D |
|
REG | Reference to a national code |
Ref country code: NL Ref legal event code: FP |
|
REG | Reference to a national code |
Ref country code: LT Ref legal event code: MG9D |
|
REG | Reference to a national code |
Ref country code: AT Ref legal event code: MK05 Ref document number: 1396785 Country of ref document: AT Kind code of ref document: T Effective date: 20210526 |
|
PG25 | Lapsed in a contracting state [announced via postgrant information from national office to epo] |
Ref country code: FI Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT Effective date: 20210526 Ref country code: HR Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT Effective date: 20210526 Ref country code: LT Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT Effective date: 20210526 Ref country code: BG Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT Effective date: 20210826 Ref country code: AT Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT Effective date: 20210526 |
|
PG25 | Lapsed in a contracting state [announced via postgrant information from national office to epo] |
Ref country code: IS Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT Effective date: 20210926 Ref country code: GR Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT Effective date: 20210827 Ref country code: RS Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT Effective date: 20210526 Ref country code: PT Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT Effective date: 20210927 Ref country code: SE Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT Effective date: 20210526 Ref country code: PL Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT Effective date: 20210526 Ref country code: NO Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT Effective date: 20210826 Ref country code: LV Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT Effective date: 20210526 |
|
PG25 | Lapsed in a contracting state [announced via postgrant information from national office to epo] |
Ref country code: SM Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT Effective date: 20210526 Ref country code: RO Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT Effective date: 20210526 Ref country code: CZ Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT Effective date: 20210526 Ref country code: DK Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT Effective date: 20210526 Ref country code: EE Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT Effective date: 20210526 Ref country code: ES Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT Effective date: 20210526 Ref country code: SK Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT Effective date: 20210526 |
|
REG | Reference to a national code |
Ref country code: DE Ref legal event code: R097 Ref document number: 602019004892 Country of ref document: DE |
|
PLBE | No opposition filed within time limit |
Free format text: ORIGINAL CODE: 0009261 |
|
STAA | Information on the status of an ep patent application or granted ep patent |
Free format text: STATUS: NO OPPOSITION FILED WITHIN TIME LIMIT |
|
26N | No opposition filed |
Effective date: 20220301 |
|
PG25 | Lapsed in a contracting state [announced via postgrant information from national office to epo] |
Ref country code: IS Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT Effective date: 20210926 Ref country code: AL Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT Effective date: 20210526 |
|
REG | Reference to a national code |
Ref country code: BE Ref legal event code: MM Effective date: 20211031 |
|
PG25 | Lapsed in a contracting state [announced via postgrant information from national office to epo] |
Ref country code: MC Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT Effective date: 20210526 |
|
PG25 | Lapsed in a contracting state [announced via postgrant information from national office to epo] |
Ref country code: LU Free format text: LAPSE BECAUSE OF NON-PAYMENT OF DUE FEES Effective date: 20211004 Ref country code: IT Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT Effective date: 20210526 Ref country code: BE Free format text: LAPSE BECAUSE OF NON-PAYMENT OF DUE FEES Effective date: 20211031 |
|
PG25 | Lapsed in a contracting state [announced via postgrant information from national office to epo] |
Ref country code: IE Free format text: LAPSE BECAUSE OF NON-PAYMENT OF DUE FEES Effective date: 20211004 |
|
REG | Reference to a national code |
Ref country code: CH Ref legal event code: PL |
|
PG25 | Lapsed in a contracting state [announced via postgrant information from national office to epo] |
Ref country code: CY Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT Effective date: 20210526 |
|
P01 | Opt-out of the competence of the unified patent court (upc) registered |
Effective date: 20230602 |
|
PG25 | Lapsed in a contracting state [announced via postgrant information from national office to epo] |
Ref country code: LI Free format text: LAPSE BECAUSE OF NON-PAYMENT OF DUE FEES Effective date: 20221031 Ref country code: HU Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT; INVALID AB INITIO Effective date: 20191004 Ref country code: CH Free format text: LAPSE BECAUSE OF NON-PAYMENT OF DUE FEES Effective date: 20221031 |
|
PGFP | Annual fee paid to national office [announced via postgrant information from national office to epo] |
Ref country code: NL Payment date: 20230915 Year of fee payment: 5 Ref country code: GB Payment date: 20230831 Year of fee payment: 5 |
|
PGFP | Annual fee paid to national office [announced via postgrant information from national office to epo] |
Ref country code: FR Payment date: 20230911 Year of fee payment: 5 |
|
PGFP | Annual fee paid to national office [announced via postgrant information from national office to epo] |
Ref country code: DE Payment date: 20230906 Year of fee payment: 5 |
|
PG25 | Lapsed in a contracting state [announced via postgrant information from national office to epo] |
Ref country code: MK Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT Effective date: 20210526 |