EP3903172A1 - Procédé et ensemble d'envoi d'un affichage tête haute sur un système de visiocasque - Google Patents

Procédé et ensemble d'envoi d'un affichage tête haute sur un système de visiocasque

Info

Publication number
EP3903172A1
EP3903172A1 EP20703942.1A EP20703942A EP3903172A1 EP 3903172 A1 EP3903172 A1 EP 3903172A1 EP 20703942 A EP20703942 A EP 20703942A EP 3903172 A1 EP3903172 A1 EP 3903172A1
Authority
EP
European Patent Office
Prior art keywords
hud
user
gesture
head
elements
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Pending
Application number
EP20703942.1A
Other languages
German (de)
English (en)
Inventor
Robert Wilde
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
Siemens AG
Original Assignee
Siemens AG
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Siemens AG filed Critical Siemens AG
Publication of EP3903172A1 publication Critical patent/EP3903172A1/fr
Pending legal-status Critical Current

Links

Classifications

    • G—PHYSICS
    • G06—COMPUTING; CALCULATING OR COUNTING
    • G06F—ELECTRIC DIGITAL DATA PROCESSING
    • G06F3/00—Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
    • G06F3/01—Input arrangements or combined input and output arrangements for interaction between user and computer
    • G06F3/011—Arrangements for interaction with the human body, e.g. for user immersion in virtual reality
    • G—PHYSICS
    • G02—OPTICS
    • G02B—OPTICAL ELEMENTS, SYSTEMS OR APPARATUS
    • G02B27/00—Optical systems or apparatus not provided for by any of the groups G02B1/00 - G02B26/00, G02B30/00
    • G02B27/01—Head-up displays
    • G02B27/017—Head mounted
    • G—PHYSICS
    • G06—COMPUTING; CALCULATING OR COUNTING
    • G06F—ELECTRIC DIGITAL DATA PROCESSING
    • G06F1/00—Details not covered by groups G06F3/00 - G06F13/00 and G06F21/00
    • G06F1/16—Constructional details or arrangements
    • G06F1/1613—Constructional details or arrangements for portable computers
    • G06F1/163—Wearable computers, e.g. on a belt
    • G—PHYSICS
    • G06—COMPUTING; CALCULATING OR COUNTING
    • G06F—ELECTRIC DIGITAL DATA PROCESSING
    • G06F3/00—Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
    • G06F3/01—Input arrangements or combined input and output arrangements for interaction between user and computer
    • G06F3/011—Arrangements for interaction with the human body, e.g. for user immersion in virtual reality
    • G06F3/012—Head tracking input arrangements
    • G—PHYSICS
    • G06—COMPUTING; CALCULATING OR COUNTING
    • G06F—ELECTRIC DIGITAL DATA PROCESSING
    • G06F3/00—Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
    • G06F3/01—Input arrangements or combined input and output arrangements for interaction between user and computer
    • G06F3/017—Gesture based interaction, e.g. based on a set of recognized hand gestures
    • G—PHYSICS
    • G06—COMPUTING; CALCULATING OR COUNTING
    • G06F—ELECTRIC DIGITAL DATA PROCESSING
    • G06F3/00—Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
    • G06F3/01—Input arrangements or combined input and output arrangements for interaction between user and computer
    • G06F3/048—Interaction techniques based on graphical user interfaces [GUI]
    • G06F3/0481—Interaction techniques based on graphical user interfaces [GUI] based on specific properties of the displayed interaction object or a metaphor-based environment, e.g. interaction with desktop elements like windows or icons, or assisted by a cursor's changing behaviour or appearance
    • G06F3/04815—Interaction with a metaphor-based environment or interaction object displayed as three-dimensional, e.g. changing the user viewpoint with respect to the environment or object
    • G—PHYSICS
    • G06—COMPUTING; CALCULATING OR COUNTING
    • G06F—ELECTRIC DIGITAL DATA PROCESSING
    • G06F3/00—Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
    • G06F3/01—Input arrangements or combined input and output arrangements for interaction between user and computer
    • G06F3/048—Interaction techniques based on graphical user interfaces [GUI]
    • G06F3/0487—Interaction techniques based on graphical user interfaces [GUI] using specific features provided by the input device, e.g. functions controlled by the rotation of a mouse with dual sensing arrangements, or of the nature of the input device, e.g. tap gestures based on pressure sensed by a digitiser
    • G06F3/0488—Interaction techniques based on graphical user interfaces [GUI] using specific features provided by the input device, e.g. functions controlled by the rotation of a mouse with dual sensing arrangements, or of the nature of the input device, e.g. tap gestures based on pressure sensed by a digitiser using a touch-screen or digitiser, e.g. input of commands through traced gestures
    • G06F3/04883—Interaction techniques based on graphical user interfaces [GUI] using specific features provided by the input device, e.g. functions controlled by the rotation of a mouse with dual sensing arrangements, or of the nature of the input device, e.g. tap gestures based on pressure sensed by a digitiser using a touch-screen or digitiser, e.g. input of commands through traced gestures for inputting data by handwriting, e.g. gesture or text
    • G—PHYSICS
    • G02—OPTICS
    • G02B—OPTICAL ELEMENTS, SYSTEMS OR APPARATUS
    • G02B27/00—Optical systems or apparatus not provided for by any of the groups G02B1/00 - G02B26/00, G02B30/00
    • G02B27/01—Head-up displays
    • G02B27/0101—Head-up displays characterised by optical features
    • G02B2027/0138—Head-up displays characterised by optical features comprising image capture systems, e.g. camera
    • G—PHYSICS
    • G02—OPTICS
    • G02B—OPTICAL ELEMENTS, SYSTEMS OR APPARATUS
    • G02B27/00—Optical systems or apparatus not provided for by any of the groups G02B1/00 - G02B26/00, G02B30/00
    • G02B27/01—Head-up displays
    • G02B27/017—Head mounted
    • G02B2027/0178—Eyeglass type
    • G—PHYSICS
    • G02—OPTICS
    • G02B—OPTICAL ELEMENTS, SYSTEMS OR APPARATUS
    • G02B27/00—Optical systems or apparatus not provided for by any of the groups G02B1/00 - G02B26/00, G02B30/00
    • G02B27/01—Head-up displays
    • G02B27/0179—Display position adjusting means not related to the information to be displayed
    • G02B2027/0187—Display position adjusting means not related to the information to be displayed slaved to motion of at least a part of the body of the user, e.g. head, eye

Definitions

  • the invention relates to the output of a head-up display (HUD) on a head-mounted display (HMD).
  • HUD head-up display
  • HMD head-mounted display
  • head-up display (HUD) is used in the meaning used in computer games.
  • the HUD designates virtual control elements and / or displays which are at least predominantly positioned at the edges of a user's field of vision.
  • the field of vision of the user here designates the area within which the user can fix objects only by eye movements, that is to say without head movements, that is to say he can see clearly with his visual center.
  • head-mounted display denotes a visual output device worn on the head, for example VR glasses (for example HTC Vive) or AR glasses (for example Microsoft Hololens), which are used for the visual output of a virtual or augmented reality Representation of three-dimensional images is set up.
  • VR glasses for example HTC Vive
  • AR glasses for example Microsoft Hololens
  • HUD head-up display
  • the term “head-up display” is also intended in the following to refer to virtual control elements and / or displays which are at least predominantly positioned at the edges of the user's field of vision. This means that most of the elements of the HUD are positioned in the head coordinates at the side of the user's field of vision and are carried along when the head moves.
  • the HMD forms the origin of the head coordinate system. Since they follow the head movements, the elements of the HUD move completely independently of virtual or real ones Objects in world coordinates, which can also be in the user's field of vision.
  • the virtual control elements and / or displays are, for example, elements as are known in principle from graphical user interfaces. Suitable control elements are, for example, symbols, menus, buttons, selection boxes, option fields or list fields. Suitable displays are, for example, text fields, graphic status displays or pictures.
  • the virtual control elements and / or displays can be designed as two-dimensional (flat) or three-dimensional representations.
  • the present invention is intended to provide an alternative to the prior art.
  • a computing unit outputs a HUD with an HMD to a user, with at least some elements of the HUD also being displayed essentially stationary in head coordinates at the edge of a field of view of the user even when the head is moved.
  • the method is characterized in that a tracking device detects at least one hand and / or finger movement of the user as a gesture, and the computing unit recognizes and processes the gesture as an interaction with at least one element of the HUD.
  • the arrangement for outputting a HUD with an HMD includes an HMD and a computing unit which is programmed for outputting a HUD with the HMD to a user, the output of at least some elements of the HUD being essentially stationary in head coordinates at the edge even when the head is moved a field of view of the user is arranged.
  • the arrangement is characterized by a tracking device which is set up to record at least one hand and / or finger movement of the user as a gesture.
  • the computing unit is programmed to recognize and process the gesture as an interaction with at least one element of the HUD.
  • the gesture-based interaction of the user is an immediate interaction with the HUD.
  • An indirect interaction with controllers within an arm's length in front of the user's face would be uncomfortable, unergonomic and also imprecise. For this reason, no attempt has ever been made to control objects that are arranged in head coordinates using VR controllers.
  • the direct interaction with the bare hand enables the user to operate the HUD elements very intuitively, even close to his face.
  • Direct operation thanks to the precise tracking of the fingers of the bare hand has become possible thanks to tracking devices such as Leap Motion or the tracking system from Microsoft Hololens that have only recently appeared on the market.
  • the direct interaction with the HUD using gestures means a disruptive break with previous approaches to implementing a HUD for VR and AR applications. Instead of moving away from plateau in the prior art Information in head coordinates enables the increased ergonomics of gesture-based interaction to use the HUD to display information that should always be available. The user is enabled to operate such menus intuitively with his bare hand in front of his face.
  • the computing unit of the arrangement is, for example, a processor, a notebook or a PC.
  • the processor is, for example, a microprocessor or microcontroller, a system-on-chip or a programmable digital module, such as a "field programmable gate array” (FPGA).
  • FPGA field programmable gate array
  • the interaction is to change an arrangement of the elements of the HUD depending on the gesture.
  • This embodiment represents a disruptive departure from the prior art in which the HUD is designed and implemented as a static arrangement.
  • the embodiment makes it possible for the user to move and rearrange elements of the HUD through direct gesture-based interaction.
  • the elements of the HUD are shown at a distance from the user that does not exceed the reach of the user's hands.
  • the user touches an element of the HUD as a gesture, the interaction actuating or selecting the element in particular.
  • the element is, for example, a button that is touched by the gesture.
  • the user performs a swipe gesture in front of or on an element of the HUD as a gesture, the interaction shifting and / or enlarging or reducing the element.
  • This embodiment offers the advantage that the user can directly place elements of the HUD that are relevant to him prominently in his field of vision, while he can push unimportant elements of the HUD into the periphery.
  • the elements of the HUD are presented to the user at different distances.
  • the user performs a gesture of a beckoning gesture in front of or on an element of the HUD, where the interaction leads the element closer to the user and / or enlarges.
  • the user performs a driving gesture in front of or on an element of the HUD as a gesture, the interaction removing and / or reducing the element from the user.
  • the elements of the HUD head movements of the user follow with a time delay which is between 400 ms and 1200 ms. This is visualized by resetting the elements in head coordinates against the direction of movement for the duration of the time delay from the beginning of the head movement.
  • the time delay between 400 ms and 1200 ms results in a significant increase in ergonomics, since the visual impression of the HUD becomes more natural for the user.
  • the tracking device is mounted on the HMD.
  • a suitable tracking device is the product Leap Motion.
  • a computer program is stored on the computer-readable data carrier and executes the method when it is processed in a processor.
  • the computer program is processed in a processor and executes the method.
  • HUD 1 shows a HUD 1, which with an HMD 2 to a user
  • FIG. 2 shows a gesture 4 with which a user actuates a third element 13 of a HUD
  • FIG. 3 shows a gesture 4 with which a user moves a third element 13 of a HUD into the center of his field of vision 31,
  • FIG. 5 shows a gesture 4 with which a user beckons a third element 13 of a HUD from the background.
  • FIG. 1 shows a HUD 1 which is output to a user 3 using an HMD 2.
  • the HUD 1 is installed within a current display area 10 in front of the user 3 three-dimensionally. It consists of a number of flat fields or windows, which are arranged in spatially staggered levels in front of the face of the user 3 in head coordinates.
  • the HMD 2 has a tracking device 21 with which the hand and / or finger movement of the user 3 can be recognized and recognized as gestures.
  • a tracking device 21 with which the hand and / or finger movement of the user 3 can be recognized and recognized as gestures.
  • the product Leap Motion which is placed on the outside of VR glasses, or the tracking technology from Microsoft Hololens are suitable.
  • the tracking device 21 enables the user 3 to interact directly with the elements of the HUD 1 by means of his hand and / or finger movements in order to rearrange them, for example.
  • FIG. 2 shows a gesture 4 with which a user actuates or pushes a third element 13 of a HUD with his hand 32.
  • the third element 13 is displayed to the user in a plane with a first element 11, a second element 12, a fifth element 15, a sixth element 16 and a seventh element 17.
  • the level is so close to the user's face that he can easily reach the level with his fingertip.
  • gesture 4 shown in FIG. 2 the user touches third element 13 with his bare hand in front of his face.
  • the interaction associated with this gesture could be, for example, a selection of the third element 13 for future purposes, a drag-and-drop operation or the actuation of a button.
  • FIG. 3 shows a gesture 4, here a swiping gesture, with which a third element 13 of an HUD is moved into the center of the field of view 31 of the user as interaction 41.
  • a fourth element 14 and an eighth element 18 are also shown.
  • the third element 13 need not be located centrally in the field of vision 31 of the user. It can continue to edge of the field of view 31, but more central than the other elements, which are more in the periphery.
  • the user performs the gesture 4, for example, in order to be able to better focus and read text which is represented in the third element 13. In this way, he can keep his field of view 31 essentially free and only move the most important elements such as the third element 13 to the center.
  • the elements contain, for example, control elements or displays as they are known from graphical user interfaces.
  • Suitable control elements are, for example, symbols, menus, buttons, check boxes, radio buttons or list boxes.
  • Suitable displays are, for example, text fields, graphic status displays or pictures.
  • the elements can be designed as two-dimensional (flat) or three-dimensional representations.
  • FIG. 4 shows a gesture 4 with which the user at least partially removes a third element 13 of a HUD from his field of vision 31.
  • the correspondingly recognized and executed interaction 41 is shown as an arrow.
  • Figure 5 shows another gesture 4, with which the user beckons a third element 13 of a HUD from the background. After recognition of this gesture by the tracking device 21, a pick-up of the third element 13 is identified and carried out as the associated interaction 41. Conversely, the user can use an expelling gesture to move elements into the background. In this way, the user can also elements that are initially out of the reach of his hands. Furthermore, the user can organize stacks of elements in this way, whereby the HUD is additionally structured and the user's field of vision is better kept clear.

Landscapes

  • Engineering & Computer Science (AREA)
  • Theoretical Computer Science (AREA)
  • General Engineering & Computer Science (AREA)
  • Physics & Mathematics (AREA)
  • General Physics & Mathematics (AREA)
  • Human Computer Interaction (AREA)
  • Computer Hardware Design (AREA)
  • Optics & Photonics (AREA)
  • User Interface Of Digital Computer (AREA)

Abstract

L'invention concerne un affichage tête haute (HUD) virtuel (1), qui s'affiche avec un système de visiocasque (HMD) (2) à l'attention d'un utilisateur (3). Au moins certains éléments du HUD sont affichés, même en cas de mouvements de tête, sensiblement de manière stationnaire dans des coordonnées de tête sur le bord d'un champ de vision de l'utilisateur. Un dispositif de suivi (21) détecte au moins un mouvement de la main et/ou du doigt de l'utilisateur en tant que geste. Le geste est identifié et traité en tant qu'interaction avec au moins un élément du HUD. L'interaction directe avec la simple main permet à l'utilisateur d'utiliser de manière très intuitive des éléments du HUD même à proximité devant son visage. L'interaction directe avec le HUD au moyen de gestes signifie une fracture avec des approches mises en œuvre jusqu'à présent d'implémentation d'un HUD pour des applications de réalité virtuelle et de réalité augmentée. En lieu et place de la voix empruntée dans l'état de la technique consistant à se détourner du placement d'informations dans des coordonnées de tête, l'ergonomie améliorée de l'interaction gestuelle permet d'utiliser le HUD pour afficher des informations censées être toujours disponibles. L'utilisateur est ainsi en mesure d'utiliser des menus de ce type de manière intuitive à l'aide d'une simple main devant son visage.
EP20703942.1A 2019-01-30 2020-01-20 Procédé et ensemble d'envoi d'un affichage tête haute sur un système de visiocasque Pending EP3903172A1 (fr)

Applications Claiming Priority (3)

Application Number Priority Date Filing Date Title
DE102019201175 2019-01-30
DE102019202512.9A DE102019202512A1 (de) 2019-01-30 2019-02-25 Verfahren und Anordnung zur Ausgabe eines HUD auf einem HMD
PCT/EP2020/051273 WO2020156854A1 (fr) 2019-01-30 2020-01-20 Procédé et ensemble d'envoi d'un affichage tête haute sur un système de visiocasque

Publications (1)

Publication Number Publication Date
EP3903172A1 true EP3903172A1 (fr) 2021-11-03

Family

ID=71524683

Family Applications (1)

Application Number Title Priority Date Filing Date
EP20703942.1A Pending EP3903172A1 (fr) 2019-01-30 2020-01-20 Procédé et ensemble d'envoi d'un affichage tête haute sur un système de visiocasque

Country Status (5)

Country Link
US (1) US20220091662A1 (fr)
EP (1) EP3903172A1 (fr)
CN (1) CN113330393A (fr)
DE (1) DE102019202512A1 (fr)
WO (1) WO2020156854A1 (fr)

Families Citing this family (4)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
WO2022088103A1 (fr) * 2020-10-30 2022-05-05 华为技术有限公司 Procédé et appareil d'étalonnage d'image
CN114839782B (zh) * 2022-06-07 2023-08-18 上汽大众汽车有限公司 一种用于车辆控制与信息显示的车载增强显示系统
WO2024061163A1 (fr) * 2022-09-19 2024-03-28 北京字跳网络技术有限公司 Procédé d'interaction homme-ordinateur, procédé d'affichage, appareil et dispositif
DE102023204274B3 (de) 2023-05-09 2024-10-31 Volkswagen Aktiengesellschaft Verfahren, System und Computerprogramm zur augmentierten Bedienung eines Fahrzeugsystems eines Kraftfahrzeugs

Citations (1)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US20160026253A1 (en) * 2014-03-11 2016-01-28 Magic Leap, Inc. Methods and systems for creating virtual and augmented reality

Family Cites Families (11)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
WO2011058584A1 (fr) * 2009-11-10 2011-05-19 Selex Sistemi Integrati S.P.A. Assistance collaborative virtuelle basée sur un avatar
CN103946732B (zh) * 2011-09-26 2019-06-14 微软技术许可有限责任公司 基于对透视、近眼显示器的传感器输入的视频显示修改
US9389420B2 (en) * 2012-06-14 2016-07-12 Qualcomm Incorporated User interface interaction for transparent head-mounted displays
US9378592B2 (en) * 2012-09-14 2016-06-28 Lg Electronics Inc. Apparatus and method of providing user interface on head mounted display and head mounted display thereof
US20140282274A1 (en) * 2013-03-15 2014-09-18 Qualcomm Incorporated Detection of a gesture performed with at least two control objects
US10175483B2 (en) * 2013-06-18 2019-01-08 Microsoft Technology Licensing, Llc Hybrid world/body locked HUD on an HMD
US10451874B2 (en) * 2013-09-25 2019-10-22 Seiko Epson Corporation Image display device, method of controlling image display device, computer program, and image display system
KR102251541B1 (ko) * 2014-06-23 2021-05-14 엘지전자 주식회사 이동단말기 및 그것의 제어방법
US10409443B2 (en) * 2015-06-24 2019-09-10 Microsoft Technology Licensing, Llc Contextual cursor display based on hand tracking
JP6776155B2 (ja) * 2017-02-28 2020-10-28 株式会社コロプラ 仮想現実を提供するための方法、および当該方法をコンピュータに実行させるためのプログラム、および当該プログラムを実行するための情報処理装置
US10521020B2 (en) * 2017-07-12 2019-12-31 Unity IPR ApS Methods and systems for displaying UI elements in mixed reality environments

Patent Citations (1)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US20160026253A1 (en) * 2014-03-11 2016-01-28 Magic Leap, Inc. Methods and systems for creating virtual and augmented reality

Also Published As

Publication number Publication date
WO2020156854A1 (fr) 2020-08-06
DE102019202512A1 (de) 2020-07-30
CN113330393A (zh) 2021-08-31
US20220091662A1 (en) 2022-03-24

Similar Documents

Publication Publication Date Title
EP3903172A1 (fr) Procédé et ensemble d'envoi d'un affichage tête haute sur un système de visiocasque
EP2989524B1 (fr) Procédé d'interaction avec un objet affiché sur des lunettes de données
EP2017756A1 (fr) Procédé destiné à l'affichage et/ou au traitement de données images d'origine médicale avec détection de mouvement
DE60025926T2 (de) Steuerung der tiefenbewegung in einer anzeigevorrichtung mit mehrschichtigem bildschirm
Piumsomboon et al. User-defined gestures for augmented reality
DE102012020607B4 (de) Kraftwagen mit einer Gestensteuerungseinrichtung sowie Verfahren zum Steuern eines Auswahlelements
EP2467822B1 (fr) Détermination continue d'une perspective
EP2795451B1 (fr) Procédé de fonctionnement d'un affichage tactile multipoints et dispositif avec affichage tactile multipoints
EP1374027B1 (fr) Positionnement de secteurs affiches sur une interface utilisateur
EP3400515A1 (fr) Interface utilisateur pourvue de plusieurs écrans d'affichage et procédé de positionnement de contenus sur plusieurs écrans d'affichage
DE69026516T2 (de) Digitalisiertablett mit zweimodenläufer/maus
DE10084249T5 (de) Zusätzliches LCD-Feld mit Sensorbildschirm
DE102017121342A1 (de) Anzeigesteuerungsvorrichtung, anzeigesteuerungssystem und anzeigesteuerungsverfahren
Colley et al. Guided touch screen: Enhanced eyes-free interaction
Plasson et al. A lens-based extension of raycasting for accurate selection in dense 3d environments
DE102016204692A1 (de) Steuerung der Mehrfachauswahl auf berührungsempfindlichen Flächen
DE102016115479A1 (de) Nutzerschnittstelle für Elektronikgerät, Eingabeverarbeitungsverfahren und Elektronikgerät
DE102004027289B4 (de) Verfahren und Anordnung zur berührungslosen Navigation in einem Dokument
DE102013014889A1 (de) Mauszeigersteuerung für eine Bedienvorrichtung
Koskinen et al. Hands-on the process control: users preferences and associations on hand movements
Chen et al. Study on the interactive interface design of gaze input smart TV
EP1881398A1 (fr) Procédé destiné au positionnement d'un curseur sur un écran tactile
EP3292549A1 (fr) Système électronique et procédé de planification et d'exécution d'une tâche devant être réalisée avec un véhicule
DE19720051A1 (de) Verfahren zur Eingabe einer Information in einen Rechner
DE102020100073A1 (de) Verfahren und System zum Auswählen eines Listeneintrags aus einer Liste

Legal Events

Date Code Title Description
STAA Information on the status of an ep patent application or granted ep patent

Free format text: STATUS: UNKNOWN

STAA Information on the status of an ep patent application or granted ep patent

Free format text: STATUS: THE INTERNATIONAL PUBLICATION HAS BEEN MADE

PUAI Public reference made under article 153(3) epc to a published international application that has entered the european phase

Free format text: ORIGINAL CODE: 0009012

STAA Information on the status of an ep patent application or granted ep patent

Free format text: STATUS: REQUEST FOR EXAMINATION WAS MADE

17P Request for examination filed

Effective date: 20210714

AK Designated contracting states

Kind code of ref document: A1

Designated state(s): AL AT BE BG CH CY CZ DE DK EE ES FI FR GB GR HR HU IE IS IT LI LT LU LV MC MK MT NL NO PL PT RO RS SE SI SK SM TR

DAV Request for validation of the european patent (deleted)
DAX Request for extension of the european patent (deleted)
STAA Information on the status of an ep patent application or granted ep patent

Free format text: STATUS: EXAMINATION IS IN PROGRESS

17Q First examination report despatched

Effective date: 20230804