WO2015176708A1 - Dispositif d'affichage d'une réalité virtuelle ainsi qu'appareil de mesure - Google Patents

Dispositif d'affichage d'une réalité virtuelle ainsi qu'appareil de mesure Download PDF

Info

Publication number
WO2015176708A1
WO2015176708A1 PCT/DE2015/100153 DE2015100153W WO2015176708A1 WO 2015176708 A1 WO2015176708 A1 WO 2015176708A1 DE 2015100153 W DE2015100153 W DE 2015100153W WO 2015176708 A1 WO2015176708 A1 WO 2015176708A1
Authority
WO
WIPO (PCT)
Prior art keywords
virtual
hand
representation
display
data
Prior art date
Application number
PCT/DE2015/100153
Other languages
German (de)
English (en)
Inventor
Jeronimo DZAACK
Ronald Meyer
Original Assignee
Atlas Elektronik Gmbh
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Atlas Elektronik Gmbh filed Critical Atlas Elektronik Gmbh
Priority to EP15732516.8A priority Critical patent/EP3146411A1/fr
Publication of WO2015176708A1 publication Critical patent/WO2015176708A1/fr

Links

Classifications

    • G—PHYSICS
    • G06—COMPUTING; CALCULATING OR COUNTING
    • G06F—ELECTRIC DIGITAL DATA PROCESSING
    • G06F3/00—Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
    • G06F3/01—Input arrangements or combined input and output arrangements for interaction between user and computer
    • G06F3/017—Gesture based interaction, e.g. based on a set of recognized hand gestures
    • G—PHYSICS
    • G01—MEASURING; TESTING
    • G01S—RADIO DIRECTION-FINDING; RADIO NAVIGATION; DETERMINING DISTANCE OR VELOCITY BY USE OF RADIO WAVES; LOCATING OR PRESENCE-DETECTING BY USE OF THE REFLECTION OR RERADIATION OF RADIO WAVES; ANALOGOUS ARRANGEMENTS USING OTHER WAVES
    • G01S15/00—Systems using the reflection or reradiation of acoustic waves, e.g. sonar systems
    • G01S15/88—Sonar systems specially adapted for specific applications
    • G01S15/89—Sonar systems specially adapted for specific applications for mapping or imaging
    • G—PHYSICS
    • G01—MEASURING; TESTING
    • G01S—RADIO DIRECTION-FINDING; RADIO NAVIGATION; DETERMINING DISTANCE OR VELOCITY BY USE OF RADIO WAVES; LOCATING OR PRESENCE-DETECTING BY USE OF THE REFLECTION OR RERADIATION OF RADIO WAVES; ANALOGOUS ARRANGEMENTS USING OTHER WAVES
    • G01S17/00—Systems using the reflection or reradiation of electromagnetic waves other than radio waves, e.g. lidar systems
    • G01S17/88—Lidar systems specially adapted for specific applications
    • G01S17/89—Lidar systems specially adapted for specific applications for mapping or imaging
    • G—PHYSICS
    • G01—MEASURING; TESTING
    • G01S—RADIO DIRECTION-FINDING; RADIO NAVIGATION; DETERMINING DISTANCE OR VELOCITY BY USE OF RADIO WAVES; LOCATING OR PRESENCE-DETECTING BY USE OF THE REFLECTION OR RERADIATION OF RADIO WAVES; ANALOGOUS ARRANGEMENTS USING OTHER WAVES
    • G01S7/00—Details of systems according to groups G01S13/00, G01S15/00, G01S17/00
    • G01S7/48—Details of systems according to groups G01S13/00, G01S15/00, G01S17/00 of systems according to group G01S17/00
    • G01S7/51—Display arrangements
    • G—PHYSICS
    • G01—MEASURING; TESTING
    • G01S—RADIO DIRECTION-FINDING; RADIO NAVIGATION; DETERMINING DISTANCE OR VELOCITY BY USE OF RADIO WAVES; LOCATING OR PRESENCE-DETECTING BY USE OF THE REFLECTION OR RERADIATION OF RADIO WAVES; ANALOGOUS ARRANGEMENTS USING OTHER WAVES
    • G01S7/00—Details of systems according to groups G01S13/00, G01S15/00, G01S17/00
    • G01S7/52—Details of systems according to groups G01S13/00, G01S15/00, G01S17/00 of systems according to group G01S15/00
    • G01S7/56—Display arrangements
    • G01S7/62—Cathode-ray tube displays
    • G01S7/6245—Stereoscopic displays; Three-dimensional displays; Pseudo-three dimensional displays
    • G—PHYSICS
    • G01—MEASURING; TESTING
    • G01S—RADIO DIRECTION-FINDING; RADIO NAVIGATION; DETERMINING DISTANCE OR VELOCITY BY USE OF RADIO WAVES; LOCATING OR PRESENCE-DETECTING BY USE OF THE REFLECTION OR RERADIATION OF RADIO WAVES; ANALOGOUS ARRANGEMENTS USING OTHER WAVES
    • G01S7/00—Details of systems according to groups G01S13/00, G01S15/00, G01S17/00
    • G01S7/52—Details of systems according to groups G01S13/00, G01S15/00, G01S17/00 of systems according to group G01S15/00
    • G01S7/56—Display arrangements
    • G01S7/62—Cathode-ray tube displays
    • G01S7/6272—Cathode-ray tube displays producing cursor lines and indicia by electronic means
    • G—PHYSICS
    • G06—COMPUTING; CALCULATING OR COUNTING
    • G06F—ELECTRIC DIGITAL DATA PROCESSING
    • G06F3/00—Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
    • G06F3/01—Input arrangements or combined input and output arrangements for interaction between user and computer
    • G06F3/03—Arrangements for converting the position or the displacement of a member into a coded form
    • G06F3/0304—Detection arrangements using opto-electronic means
    • G—PHYSICS
    • G06—COMPUTING; CALCULATING OR COUNTING
    • G06F—ELECTRIC DIGITAL DATA PROCESSING
    • G06F3/00—Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
    • G06F3/01—Input arrangements or combined input and output arrangements for interaction between user and computer
    • G06F3/048—Interaction techniques based on graphical user interfaces [GUI]
    • G06F3/0481—Interaction techniques based on graphical user interfaces [GUI] based on specific properties of the displayed interaction object or a metaphor-based environment, e.g. interaction with desktop elements like windows or icons, or assisted by a cursor's changing behaviour or appearance
    • G—PHYSICS
    • G06—COMPUTING; CALCULATING OR COUNTING
    • G06F—ELECTRIC DIGITAL DATA PROCESSING
    • G06F3/00—Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
    • G06F3/01—Input arrangements or combined input and output arrangements for interaction between user and computer
    • G06F3/048—Interaction techniques based on graphical user interfaces [GUI]
    • G06F3/0481—Interaction techniques based on graphical user interfaces [GUI] based on specific properties of the displayed interaction object or a metaphor-based environment, e.g. interaction with desktop elements like windows or icons, or assisted by a cursor's changing behaviour or appearance
    • G06F3/04815—Interaction with a metaphor-based environment or interaction object displayed as three-dimensional, e.g. changing the user viewpoint with respect to the environment or object

Definitions

  • the invention relates to a device for displaying a virtual reality, wherein the device has a gesture recognition device for determining a movement of a hand and a display device and a measuring device.
  • cuts are placed in such 3D data, which are then displayed to an operator on a two-dimensional screen.
  • the operator or according to the user, has the opportunity to change the angle and orientation of the cuts in order to get a better picture of a given situation.
  • the object of the invention is to improve the state of the art.
  • the object is achieved by a device for displaying a virtual reality, wherein the device a gesture recognition device for determining a movement of a hand and a display device, wherein the display device displays a representation of the hand and has a virtual control element, which can be actuated by the hand by means of the representation of the hand, wherein the display device provides in particular further virtual controls, which by the hand is selectable by means of the representation of the hand.
  • an input means and a display can be provided which allow an operator to virtually work with a given amount of data.
  • the selection of the individual virtual control elements, the given data can be manipulated. For example, not only horizontal and vertical cuts, but also, for example, represented by a knife flat-shaped arbitrary shape can be put into the data set to display certain things.
  • the device can be used for both online and offline data.
  • the representation of the hand also referred to as the virtual hand in the following
  • the virtual hand can actuate a virtual operating element
  • an operator has a very intuitive operating concept in which he "moves" in a virtual environment by means of his hand, to better evaluate the data.
  • virtual reality is in particular a three-dimensional optical representation, which gives the operator the impression that it is located in the data itself.
  • a "display device” which is able to give the human eye or eyes the impression that a three-dimensional space is created for the operator
  • the eye can also be directly imprinted with light signals or it can be reflected signals generated, which give the eye a three-dimensional image.
  • a combination of screen and shutter glasses can realize the display device.
  • the "gesture recognition device” recognizes certain intentional movements of the operator by means of associated sensors, in particular, these movements can be hand movements.
  • the gesture recognition device is based on optical inputs, which are recorded in particular by two cameras and processed by means of appropriate software Hand transmitter and / or receiver can be arranged, which emit and / or receive corresponding signals.Thus, the signals can be detected a corresponding movement in space.In particular, it should be mentioned here that these transmitters to ultrasonic transmitter or infrared transmitter and the corresponding receiver can act.
  • the "representation of the hand” is in particular a virtual hand, which is represented by means of the display device, that real movements of the hand with the virtual hand in the virtual space are simulated, the real hand by means of the virtual hand of one of the virtual
  • the hand may be represented (partially) by points, which may be arranged on the joints of the fingers or on the individual links of the fingers, and points may be represented by straight lines , Surfaces, bars or bars are connected, so that a sketched hand results in three-dimensional space.
  • a "virtual control element” is in particular a control element which is displayed in the virtual environment but is controlled by movement of the real hand via the virtual hand.
  • the virtual control element can be coupled to an operating system or a computer so that control signals which can be impressed by the real hand are used to control the operating system or the computer.
  • the virtual control is a mouse
  • the real hand in the virtual environment may comprise the mouse by means of the virtual hand, which in the real world is, for example, a hand forming a cavity on a tabletop and which one over the Tabletop is moved.
  • an up and down of individual fingers as operating the individual mouse buttons or the buckling of individual fingers as moving the rolling wheel be interpreted on a mouse, whereby each representation of the hand reproduces the individual actions.
  • the operator can develop a sense of what actions in the real world have, which effects in the virtual environment.
  • a spatial data set is displayed by means of the display means as a spatial image and the spatial image can be manipulated by the virtual control elements.
  • the "spatial data set” may be, in particular, 3D sonar data in which, due to the low signal strengths and the noisy signals, automatic image recognition mechanisms function only to a limited extent and the human observer is able to gain an overview of the given situation much more quickly ,
  • the spatial record can be provided online or offline. If the data is provided online, it is also possible to look at the actual sonar system or the device that contains the 3D measurement data in this case, to elaborate certain details, if necessary, better.
  • the spatial data set can be determined online by means of a sensor.
  • sensors can be, for example, cameras or even hydrophones. All other sensors, which can convey a spatial impression, are applicable here.
  • one of the virtual controls is a virtual joystick, a virtual mouse, a virtual touch pad, a virtual scissors, a virtual knife, a virtual slider, a virtual knob, a virtual stylus, a virtual brush, a virtual file, a virtual glue stick or a virtual eraser.
  • the object is achieved by a measuring device, in particular sonar, which has a device described above.
  • the sonar may be an active or passive sonar.
  • the measuring device can also be a stereo camera, for example, which delivers a three-dimensional image of a specific situation.
  • this can also be an infrared camera, which can provide a three-dimensional overview of the observed scenery, especially in poor visibility conditions.
  • Figure 1 is a schematic representation of a device according to the invention with a 3D screen and a stereo camera.
  • An apparatus 101 according to the invention is connected to an active sonar 181.
  • the device 101 comprises a 3D screen 103 and a stereo camera 105.
  • the stereo camera 105 has two mutually offset camera lenses 107.
  • the 3D screen 103 is divided into a display area 109 and a toolbar 111.
  • three-dimensional sonar data 113 are shown on the 3D screen 103.
  • a virtual joystick 117 and a virtual hand 115 are shown in the display area 109.
  • a virtual mouse 119, a virtual scissors 121, a virtual knob 123, a virtual knife 125 and a virtual brush 127 are shown in the tool list 111.
  • the sonar data 113 are manipulated.
  • the sonar data 113 are manipulated.
  • the representation 115 of the hand traces all movements of the real hand 155.
  • the virtual hand 115 in the screen is also moved to the left.
  • the fingers of the real hand 155 are slightly bent as if they were embracing something, this is also shown on the 3D screen 103 by the virtual hand 115.
  • the virtual hand 115 and the virtual joystick 117 are superimposed in the virtual environment, the virtual hand 115 impresses movements of the real hand 155 to the virtual joystick 117.
  • the 3D sonar data 113 can be rotated or tilted by the joystick, or the 3D data 113 can be penetrated.
  • the virtual hand may "grab" the virtual knife 125 and virtually cut the data 113 to place certain planes or slices through the data 113, which may then be displayed two-dimensionally, for example, or unfolded can be.
  • objects in the 3D data 113 become more apparent to a viewer.

Landscapes

  • Engineering & Computer Science (AREA)
  • Physics & Mathematics (AREA)
  • General Physics & Mathematics (AREA)
  • General Engineering & Computer Science (AREA)
  • Theoretical Computer Science (AREA)
  • Radar, Positioning & Navigation (AREA)
  • Remote Sensing (AREA)
  • Computer Networks & Wireless Communication (AREA)
  • Human Computer Interaction (AREA)
  • Electromagnetism (AREA)
  • Acoustics & Sound (AREA)
  • Position Input By Displaying (AREA)
  • User Interface Of Digital Computer (AREA)

Abstract

L'invention concerne un dispositif d'affichage d'une réalité virtuelle. Ledit dispositif comprend un système de reconnaissance de gestes, servant à déterminer un mouvement d'une main, et un système d'affichage. Ledit système d'affichage reproduit une représentation de la main et comprend un autre élément de commande virtuel qui peut être actionné par la main au moyen de la représentation de la main. Le système d'affichage met en outre à disposition d'autres éléments de commande virtuels qui peuvent être sélectionnés par la main au moyen de la représentation de la main.
PCT/DE2015/100153 2014-05-22 2015-04-10 Dispositif d'affichage d'une réalité virtuelle ainsi qu'appareil de mesure WO2015176708A1 (fr)

Priority Applications (1)

Application Number Priority Date Filing Date Title
EP15732516.8A EP3146411A1 (fr) 2014-05-22 2015-04-10 Dispositif d'affichage d'une réalité virtuelle ainsi qu'appareil de mesure

Applications Claiming Priority (2)

Application Number Priority Date Filing Date Title
DE102014107211.1 2014-05-22
DE102014107211.1A DE102014107211A1 (de) 2014-05-22 2014-05-22 Vorrichtung zum Anzeigen einer virtuellen Realität sowie Messgerät

Publications (1)

Publication Number Publication Date
WO2015176708A1 true WO2015176708A1 (fr) 2015-11-26

Family

ID=53496346

Family Applications (1)

Application Number Title Priority Date Filing Date
PCT/DE2015/100153 WO2015176708A1 (fr) 2014-05-22 2015-04-10 Dispositif d'affichage d'une réalité virtuelle ainsi qu'appareil de mesure

Country Status (3)

Country Link
EP (1) EP3146411A1 (fr)
DE (1) DE102014107211A1 (fr)
WO (1) WO2015176708A1 (fr)

Families Citing this family (5)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
DE102017114914A1 (de) * 2017-07-04 2019-01-10 Atlas Elektronik Gmbh Visuelles Ausgabegerät und Bediensystem
DE102017114905A1 (de) * 2017-07-04 2019-01-10 Atlas Elektronik Gmbh Kommunikationsvorrichtung und Bediensystem
EP3649539A1 (fr) 2017-07-04 2020-05-13 ATLAS ELEKTRONIK GmbH Appareil de sortie visuelle doté d'une caméra et procédé de présentation
DE102017215074A1 (de) * 2017-08-29 2019-02-28 Siemens Healthcare Gmbh Verfahren und Auswahleinheit zum Auswählen eines virtuellen Objekts oder eines Bildparameterwerts
IT202000019282A1 (it) * 2020-08-05 2022-02-05 Swhard S R L Sistema di realtà virtuale e metodo di scrittura in realtà virtuale

Citations (6)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US20110298704A1 (en) * 2005-10-21 2011-12-08 Apple Inc. Three-dimensional imaging and display system
US20120212399A1 (en) * 2010-02-28 2012-08-23 Osterhout Group, Inc. See-through near-eye display glasses wherein image light is transmitted to and reflected from an optically flat film
US20120287044A1 (en) * 2007-09-14 2012-11-15 Intellectual Ventures Holding 67 Llc Processing of gesture-based user interactions using volumetric zones
US20130100008A1 (en) * 2011-10-19 2013-04-25 Stefan J. Marti Haptic Response Module
WO2013068821A2 (fr) * 2011-11-09 2013-05-16 Abyssal S.A. Système et procédé de fonctionnement pour des véhicules télécommandés incluant des ensembles d'images en 3d superposés
WO2014010670A1 (fr) * 2012-07-13 2014-01-16 Isayama Taro Dispositif de sélection d'élément, procédé de sélection d'élément et programme

Family Cites Families (2)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US8287373B2 (en) * 2008-12-05 2012-10-16 Sony Computer Entertainment Inc. Control device for communicating visual information
KR101079598B1 (ko) * 2007-12-18 2011-11-03 삼성전자주식회사 디스플레이장치 및 그 제어방법

Patent Citations (7)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US20110298704A1 (en) * 2005-10-21 2011-12-08 Apple Inc. Three-dimensional imaging and display system
US20120287044A1 (en) * 2007-09-14 2012-11-15 Intellectual Ventures Holding 67 Llc Processing of gesture-based user interactions using volumetric zones
US20120212399A1 (en) * 2010-02-28 2012-08-23 Osterhout Group, Inc. See-through near-eye display glasses wherein image light is transmitted to and reflected from an optically flat film
US20130100008A1 (en) * 2011-10-19 2013-04-25 Stefan J. Marti Haptic Response Module
WO2013068821A2 (fr) * 2011-11-09 2013-05-16 Abyssal S.A. Système et procédé de fonctionnement pour des véhicules télécommandés incluant des ensembles d'images en 3d superposés
WO2014010670A1 (fr) * 2012-07-13 2014-01-16 Isayama Taro Dispositif de sélection d'élément, procédé de sélection d'élément et programme
EP2874044A1 (fr) * 2012-07-13 2015-05-20 Juice Design Co., Ltd. Dispositif de sélection d'élément, procédé de sélection d'élément et programme

Non-Patent Citations (3)

* Cited by examiner, † Cited by third party
Title
MAHMOUD HAYDAR ET AL: "Virtual Exploration of Underwater Archaeological Sites: Visualization and Interaction in Mixed Reality Environments", THE 9TH INTERNATIONAL SYMPOSIUM ON VIRTUAL REALITY, ARCHAEOLOGY AND CULTURAL HERITAGE VAST, 1 January 2008 (2008-01-01), pages 141 - 148, XP055204020, Retrieved from the Internet <URL:http://dx.doi.org/10.2312/VAST/VAST08/141-148> DOI: 10.2312/VAST/VAST08/141-148 *
NGUYEN THONG DANG: "A STEREOSCOPIC 3D VISUALIZATION ENVIRONMENT FOR AIR TRAFFIC CONTROL AN ANALYSIS OF INTERACTION AND A PROPOSAL OF NEW INTERACTION TECHNIQUES", PH.D. THESIS, 31 December 2005 (2005-12-31), XP055046789, Retrieved from the Internet <URL:http://www.eurocontrol.int/eec/gallery/content/public/documents/PhD_theses/2005/Ph.D_Thesis_2005_Dang_T.pdf> [retrieved on 20121205] *
ROBERT J. BARTON III ET AL: "Large Scale Interactive Data Visualization for Undersea Warfare Applications", 13 September 2002 (2002-09-13), XP055201668, Retrieved from the Internet <URL:http://www.dzdvi.net/uploads/3/8/5/3/38536945/largescaledataviz_sept02.pdf> [retrieved on 20150710] *

Also Published As

Publication number Publication date
DE102014107211A1 (de) 2015-11-26
EP3146411A1 (fr) 2017-03-29

Similar Documents

Publication Publication Date Title
DE102019002898B4 (de) Robotersimulationsvorrichtung
EP3067874A1 (fr) Procede et dispositif d&#39;essai d&#39;un appareil utilise dans un aeronef
WO2015176708A1 (fr) Dispositif d&#39;affichage d&#39;une réalité virtuelle ainsi qu&#39;appareil de mesure
EP3458939B1 (fr) Système et procédé d&#39;interaction
EP1047014A2 (fr) Procédé et appareil d&#39;entrée de commande graphique de la position d&#39;un object affiché dans un espace tri-dimensionnel
DE102013110580A1 (de) Verfahren zum optischen Abtasten und Vermessen einer Szene
DE29720443U1 (de) Kalibration einer Handstellung und Auswahl eines virtuellen Bildes für einen Virtual-Reality-Fahrzeugsimulator
DE202008014481U1 (de) Tragbares Roboterkontrollgerät zum Kontrollieren einer Bewegung eines Roboters
DE102014015871B4 (de) Anzeigesystem für einen Kraftwagen, Kraftwagen mit einem Anzeigesystem und Verfahren zum Betreiben eines Anzeigesystems
DE102011119012A1 (de) Vereinfachtes Koordinatenmesssystem für Schulungszwecke
DE102015102238A1 (de) Verfahren und Anordnung zum Überprüfen einer Fläche
DE102021122362A1 (de) Wechsel zwischen zuständen in einer hybriden virtual-reality-desktop-rechenumgebung
DE102016224774B3 (de) Verfahren zur Programmierung eines Messroboters und Programmiersystem
DE102019219485A1 (de) System und verfahren für standardisierte evaluation einer aktivitätssequenz
DE102014115363A1 (de) Virtuelles Zeichen in realer Umgebung
WO2017054894A1 (fr) Système de commande interactif et procédé de réalisation d&#39;une opération de commande sur un système de commande intéractif
EP1665023B1 (fr) Procede et dispositif de commande d&#39;un systeme graphique de realite virtuelle par des interactions
WO2013034133A1 (fr) Interaction avec un scénario tridimensionnel virtuel
DE102019113799A1 (de) Messsystem zum Vermessen eines Messobjekts
EP3534240A1 (fr) Procédé et dispositif d&#39;annotation de données
DE102010036904A1 (de) Haptische Messvorrichtung und Messverfahren
DE102013211046A1 (de) Verfahren und Vorrichtung zum Gewinnen eines Stellsignals aus einer Bediengeste
DE102016121687B4 (de) Intraoralscanner und Verfahren zur digitalen Zahnabformung im zahnmedizinischen Bereich
DE102021212928B4 (de) Verfahren, Computerprogramm und Vorrichtung zum Erproben eines Einbaus oder Ausbaus zumindest eines Bauteils
DE102015003883B4 (de) Kraftfahrzeugsimulationsanordnung zur Simulation einer virtuellen Umgebung mit einem virtuellen Kraftfahrzeug und Verfahren zur Simulation einer virtuellen Umgebung

Legal Events

Date Code Title Description
121 Ep: the epo has been informed by wipo that ep was designated in this application

Ref document number: 15732516

Country of ref document: EP

Kind code of ref document: A1

REEP Request for entry into the european phase

Ref document number: 2015732516

Country of ref document: EP

WWE Wipo information: entry into national phase

Ref document number: 2015732516

Country of ref document: EP