EP1642199A2 - Wireless three dimensional microwave holographic pointer (3dmi-hope) using microstrip antennas - Google Patents

Wireless three dimensional microwave holographic pointer (3dmi-hope) using microstrip antennas

Info

Publication number
EP1642199A2
EP1642199A2 EP03815533A EP03815533A EP1642199A2 EP 1642199 A2 EP1642199 A2 EP 1642199A2 EP 03815533 A EP03815533 A EP 03815533A EP 03815533 A EP03815533 A EP 03815533A EP 1642199 A2 EP1642199 A2 EP 1642199A2
Authority
EP
European Patent Office
Prior art keywords
3dmi
hope
reconstruction
unit
refers
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Withdrawn
Application number
EP03815533A
Other languages
German (de)
French (fr)
Inventor
Hesham E. El-Deeb
Hala A. El-Sadek
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
Electronics Research Institute
Original Assignee
Electronics Research Institute
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Electronics Research Institute filed Critical Electronics Research Institute
Publication of EP1642199A2 publication Critical patent/EP1642199A2/en
Withdrawn legal-status Critical Current

Links

Classifications

    • G—PHYSICS
    • G06—COMPUTING OR CALCULATING; COUNTING
    • G06F—ELECTRIC DIGITAL DATA PROCESSING
    • G06F3/00—Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
    • G06F3/01—Input arrangements or combined input and output arrangements for interaction between user and computer
    • G06F3/011—Arrangements for interaction with the human body, e.g. for user immersion in virtual reality
    • G—PHYSICS
    • G06—COMPUTING OR CALCULATING; COUNTING
    • G06F—ELECTRIC DIGITAL DATA PROCESSING
    • G06F3/00—Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
    • G06F3/01—Input arrangements or combined input and output arrangements for interaction between user and computer
    • G06F3/048—Interaction techniques based on graphical user interfaces [GUI]
    • G06F3/0484—Interaction techniques based on graphical user interfaces [GUI] for the control of specific functions or operations, e.g. selecting or manipulating an object, an image or a displayed text element, setting a parameter value or selecting a range
    • G06F3/04842—Selection of displayed objects or displayed text elements

Definitions

  • VR Virtual Reality
  • Sensing technologies include mechanical, electric field, optical, inertial, acoustic and magneto static. Many of these technologies have been adapted to measure the location of body parts in 3D. Certain limitations are still stand behind the versatility usage of these conventional devices. From this point, we think to use different technology to record 3D image in one step and then to retrieve it in another step depending on holography with electromagnetic waves in microwave region.
  • microwave holography the holographic data is not recorded in a holograph plate, as in laser case, but it is recorded in an electronic memory.
  • This allows a lot of applications to be created as radar inverse scattering and contour mapping.
  • a wide area of attention is realizing the computer 3D image and its vast fields of applications, which is one of the dreams of present image processing technology.
  • we present in this invention an application on microwave holography using microstrip antennas, which is a 3DMI- HOPE input device.
  • it is useful in generating a body fitted grid system in 3D space.
  • Input devices such as the mouse, trackball and graphics tablet are often used for pointing and selection in conjunction with the present generation of 2D user interface.
  • remote (n ⁇ n-contact) occupancy and motion detector sensing technologies include technology to record 3D image in one step and then to retrieve it in another step depending on holography with electromagnetic waves in microwave region
  • sensing technologies include technology to record 3D image in one step and then to retrieve it in another step depending on holography with electromagnetic waves in microwave region
  • holography with electromagnetic waves in microwave region
  • Gabor in 1948 started to record images in 3D by laser light. He called his process, holography that means total recording process.
  • the 3D-MI- HOPE pointer input device introduced here is an application on microwave holography technique.
  • Fig.l 3D Flock of birds as an example on magnetostatic 3D motion tracking device (the picture from web page of Ascension Technology Corporation, Burlington, VT, US).
  • Fig. 2 Holography recording idea.
  • Fig.3 (a) Overview of system stages in Block diagram
  • Reconstruction of virtual image of the object 34 refers to: 3D graphic program to represent the intensity of position
  • Input 35 refers to: Antenna inter-element distance
  • Input 36 refers to: Antenna array size
  • Input 37 & 39 refers to: ( ⁇ 0 ) operating frequency
  • Fig 4 A diagrammatic representation of the apparatus used in the 3DMI-HOPE pointer system.
  • Display 43 refers to: Reconstruction (work) volume
  • MxM Array of antennas
  • Fig 5 Details of 3DMI-HOPE editing system using modulating diodes.
  • Fixed illuminator unit (4) 55 refers to: MxMArray of microstrip antenna (5)
  • Panel unit 57 refers to: Panel unit (7)
  • Computer interface unit (13) 514 refers to: Analog to digital converter (14)
  • 515 refers to: Digital interface (15)
  • 516 refers to: Holo3D pointer Card (16)
  • 517 refers to: Software driver (reconstruction algorithm built on ray tracing) (17)
  • 518 refers to: Hardware driver (special purpose machine for reconstruction (18)
  • 519 refers to: (CPU & monitor) 3D graphic facility to draw 3D object point by point(19)
  • Fig. 6 3DMI-HOPE wireless user hand unit illustrated in figure 5
  • Fig. 8 Data acquisition (multiplexing) system illustrated in panel unit of figure 5.
  • Switching diode on 84 refers to: Switching diode off
  • Fig. 9 Hardware representation of the used circuit in A/D and digital CPU interface illustrated in computer interface unit in figure 5...
  • Fig 10 Holographic system of a) conventional method and b) new method.

Landscapes

  • Engineering & Computer Science (AREA)
  • General Engineering & Computer Science (AREA)
  • Theoretical Computer Science (AREA)
  • Human Computer Interaction (AREA)
  • Physics & Mathematics (AREA)
  • General Physics & Mathematics (AREA)
  • Processing Or Creating Images (AREA)
  • Position Input By Displaying (AREA)
  • Radar Systems Or Details Thereof (AREA)

Abstract

This invention relates to a novel input system (3DMI-HOPE) that allows users to intuitively specify three-dimensional (3D) coordinates and enter it to computer memory. The new holographic pointer has reached high positioning accuracy of 1 mm using 5.2 GHz (802.11 b WLAN standard) operating frequency with resolution capability of multipoint capturing of λ0 (free space wave length) point's separation. The system has been developed with reduced size U-shaped slot antenna array to act as hologram recording plate. A new technique for reconstruction of virtual image of object has been developed which allows 3DMI-HOPE to have reconstruction volume equal to or greater than hologram size.

Description

Wireless Three Dimensional Microwave Holographic Pointer (3DMI-HOPE) Using Misrostrip Antennas
Technical field: Virtual reality and human machine interaction using holography and microstrip antennas
Virtual Reality (VR) applications are already recognized for their value in specialized domains. However, it is also possible to have VR applications that run on the desktop. Current development in interactive computer graphics and user interfaces requires the user to navigate, select and rotate in 3D. This increase the complexity in the user interface and it may be that the 3D system will fail to live up to its potential unless appropriate input devices are available to users. As the need for electronic security and surveillance increases, there is growing use of remote (non-contact) occupancy and motion detectors. Sensing technologies include mechanical, electric field, optical, inertial, acoustic and magneto static. Many of these technologies have been adapted to measure the location of body parts in 3D. Certain limitations are still stand behind the versatility usage of these conventional devices. From this point, we think to use different technology to record 3D image in one step and then to retrieve it in another step depending on holography with electromagnetic waves in microwave region.
In microwave holography, the holographic data is not recorded in a holograph plate, as in laser case, but it is recorded in an electronic memory. This allows a lot of applications to be created as radar inverse scattering and contour mapping. A wide area of attention is realizing the computer 3D image and its vast fields of applications, which is one of the dreams of present image processing technology. As a step toward this, we present in this invention an application on microwave holography using microstrip antennas, which is a 3DMI- HOPE input device. We can imagine how many applications will be like input any complicated shape to computer and save its 3D data in its memory, whatever this shape exists physically or even mathematically. This afterwards will be useful in information reduction, image compression and 3D data acquisition. Also, it is useful in generating a body fitted grid system in 3D space. We can see the processing in many wonderful fields as computer aided design in medicine, robotics and educational purposes where true spatial 3D information renders important assistance.
Background Art
Input devices such as the mouse, trackball and graphics tablet are often used for pointing and selection in conjunction with the present generation of 2D user interface. There is growing use of remote (nόn-contact) occupancy and motion detector; sensing technologies include technology to record 3D image in one step and then to retrieve it in another step depending on holography with electromagnetic waves in microwave region Very long time ago, the technology of photography records and displays the surrounding world in two-dimensional media, however the real world around us is three-dimensional. Gabor in 1948 started to record images in 3D by laser light. He called his process, holography that means total recording process. The media of at Bell laboratories in 1965, it was noticed that the resolution of laser was higher than the necessary resolution to recognize the image, specially simple ones, therefore the extension of holography to microwave region were very attractive and has many advantages. The 3D-MI- HOPE pointer input device introduced here is an application on microwave holography technique.
Brief description of the figures
The 3DMI-HOPE invention is explained in more details with conjunction with appended figures where in:
Fig.l : 3D Flock of birds as an example on magnetostatic 3D motion tracking device (the picture from web page of Ascension Technology Corporation, Burlington, VT, US).
Fig. 2: Holography recording idea.
Fig.3: (a) Overview of system stages in Block diagram
31 refers to (Object ) point location in space (x,y,z) (or multipoint separated by) (λQ ) 32 refers to: Microwave image generation
33 refers to: Reconstruction of virtual image of the object 34 refers to: 3D graphic program to represent the intensity of position
(x,y,z) of the VI
Input 35refers to: Antenna inter-element distance
Input 36 refers to: Antenna array size
Input 37 & 39 refers to: (λ0 ) operating frequency
Input 38 refers to: Reconstruction volume = Cube of side equal to antenna size
(b) Output of each stage.
Fig 4: A diagrammatic representation of the apparatus used in the 3DMI-HOPE pointer system.
41 refers to: Holo3D user's wireless hand unit
42 refers to: Display 43 refers to: Reconstruction (work) volume
44 refers to: 3D dipole (spherical wave) (illuminator unit)
45 refers to: Array of antennas (MxM) (Receiver unit)
46 refers to: Microstrip Antenna element
47 refers to: User Hand 48 refers to : Sampling rate
Fig 5: Details of 3DMI-HOPE editing system using modulating diodes.
51 refers to: User hand unit (1) 52 refers to: Modulated scattering diode (2)
53 refers to: Operator's hand switch (3)
54 refers to: Fixed illuminator unit (4) 55 refers to: MxMArray of microstrip antenna (5)
56 refers to: Object scattered modulated signal (6)
57 refers to: Panel unit (7)
58 refers to: Data Acquisition system (8) 59 refers to: De-modulator (9)
510 refers to: T-junction (10)
511 refers to: Reference Signal (11)
512 refers to: Signal generator at microwave operating frequency (12)
513 refers to: Computer interface unit (13) 514 refers to: Analog to digital converter (14)
515 refers to: Digital interface (15)
516 refers to: Holo3D pointer Card (16)
517 refers to: Software driver (reconstruction algorithm built on ray tracing) (17) 518 refers to: Hardware driver (special purpose machine for reconstruction (18)
519 refers to: (CPU & monitor) 3D graphic facility to draw 3D object point by point(19)
Fig. 6: 3DMI-HOPE wireless user hand unit illustrated in figure 5
61 refers to: Diode biasing battery
62 refers to: Modulating diode at low frequency
63 refers to: Mechanical switch
64 refers to : Passive dipole antenna Fig. 7: (4x4) U-shaped slot, orthogonal plane coupling sub- array illustrated in figure 5 in the pad plate unit (a) the antenna layer and (b) the feed layer.
Fig. 8 Data acquisition (multiplexing) system illustrated in panel unit of figure 5.
81 refers to: Antenna feed line
82 refers to: 1-to- M RF multiplexer (Vertical binary tree of diodes)
83 refers to: Switching diode on 84 refers to: Switching diode off
85 refers to: 1-to- M RF multiplexer (Horizontal binary tree of diodes)
86 refers to: Antenna element
Fig. 9: Hardware representation of the used circuit in A/D and digital CPU interface illustrated in computer interface unit in figure 5...
Fig 10: Holographic system of a) conventional method and b) new method.

Claims

1. Certain parts of the system need to be claimed as the wireless used hand unit and its controlling switch.
Characterized by controlling the modulation of the illumination signal at low frequency level. The modulated scattered field is proportional to the local field at the corresponding user hand unit's diode location. It works as hand agent that contains a short passive reflecting dipole antenna with a modulating diode at low frequency (1kHz) and its power supply feed (battery). This unit is attached to the operator's hand to locate its movements.
2. An illumination unit
Characterized by fixed 3D dipole antenna fixed in a certain corner within the reconstruction volume. The transmitter is set as 3D dipole to make the receiving signal -less dependent on the actual user hand orientation direction and also independent on the receiving microstrip antenna polarization direction.
3. A pad plate unit
Characterized by a signal receiving unit which is 2D U-shaped slot microstrip array antenna with orthogonal plane coupling between adjacent elements and uncorrelated (diversity) reception of the 2D complex data. The inter-element distance (edge-to-edge) is 0.05 operational wavelength. The array shape determines the shape of the working (reconstruction) volume. For example, a cubic reconstruction volume with side of length (a), needs an array antenna with rectangular plate shape with size (a) x (a) and provides diversity uncorrelated reception.
4. A de-modulation unit
Characterized by collecting RF T-junction to allow interference with reference signal at same high frequency operation level.
5. A 3DMI-HOPE reconstruction driver Characterized by A digital data processing unit for virtual image retrieval by either software driver and /or hardware driver based on correlation technique and ray-tracing reconstruction algorithm.
6. Positioning accuracy
Characterized by changing value according to the proposed application. It ranges from several centimeters to 1mm at Bluetooth ISM and IEEE 802.1 lb WLAN frequency bands respectively.
7. Capability of the 3DMI-HOPE system to define different features like different points or colors or materials.
8. Ability of the 3DMI-HOPE system for multi-point basis operation, which can be used for motion detection.
EP03815533A 2003-01-29 2003-12-21 Wireless three dimensional microwave holographic pointer (3dmi-hope) using microstrip antennas Withdrawn EP1642199A2 (en)

Applications Claiming Priority (2)

Application Number Priority Date Filing Date Title
EG2003010111A EG24614A (en) 2003-01-29 2003-01-29 Wireless three dimensional microwave holographic pointer (3dmi-hope) using mistrostrip antennas
PCT/EG2003/000012 WO2004068325A2 (en) 2003-01-29 2003-12-21 Wireless three dimensional microwave holographic pointer (3dmi-hope) using microstrip antennas

Publications (1)

Publication Number Publication Date
EP1642199A2 true EP1642199A2 (en) 2006-04-05

Family

ID=43778218

Family Applications (1)

Application Number Title Priority Date Filing Date
EP03815533A Withdrawn EP1642199A2 (en) 2003-01-29 2003-12-21 Wireless three dimensional microwave holographic pointer (3dmi-hope) using microstrip antennas

Country Status (4)

Country Link
EP (1) EP1642199A2 (en)
AU (1) AU2003287938A1 (en)
EG (1) EG24614A (en)
WO (1) WO2004068325A2 (en)

Family Cites Families (5)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US4952894A (en) * 1989-07-10 1990-08-28 Raytheon Company Waveguide feed network for antenna array
US5995048A (en) * 1996-05-31 1999-11-30 Lucent Technologies Inc. Quarter wave patch antenna
JPH1039997A (en) * 1996-07-18 1998-02-13 Saifasha:Yugen Three-dimensional image data/command input system
FR2772517B1 (en) * 1997-12-11 2000-01-07 Alsthom Cge Alcatel MULTIFREQUENCY ANTENNA MADE ACCORDING TO MICRO-TAPE TECHNIQUE AND DEVICE INCLUDING THIS ANTENNA
US6317098B1 (en) * 1999-08-23 2001-11-13 Lucent Technologies Inc. Communication employing triply-polarized transmissions

Non-Patent Citations (1)

* Cited by examiner, † Cited by third party
Title
See references of WO2004068325A3 *

Also Published As

Publication number Publication date
WO2004068325A3 (en) 2005-07-28
AU2003287938A8 (en) 2004-08-23
WO2004068325A2 (en) 2004-08-12
WO2004068325B1 (en) 2005-09-15
EG24614A (en) 2010-02-16
AU2003287938A1 (en) 2004-08-23

Similar Documents

Publication Publication Date Title
Meng et al. Gait recognition for co-existing multiple people using millimeter wave sensing
Paul Siebert et al. Human body 3D imaging by speckle texture projection photogrammetry
EP1761798B1 (en) Wireless location and identification system and method
CN110941331A (en) Gesture Recognition Using 3D mmWave Radar
CN108304075B (en) Method and device for performing man-machine interaction on augmented reality device
Sluÿters et al. RadarSense: Accurate recognition of mid-air hand gestures with radar sensing and few training examples
WO2014116882A1 (en) Systems and methods of tracking object movements in three-dimensional space
US9880728B2 (en) Methods and systems for controlling a virtual interactive surface and interactive display systems
CN108257177B (en) Positioning system and method based on space identification
CN109669544A (en) Fingerprint area determination method and device, terminal and readable storage medium
CN109478116A (en) Hover sensitive touchpad
Ghaffar et al. Hand pointing gestures based digital menu board implementation using IR-UWB transceivers
Tehsin et al. Improved maximum average correlation height filter with adaptive log base selection for object recognition
US11313990B2 (en) Large volume holographic imaging systems and associated methods
CN117453037A (en) Interactive method, head display device, electronic device and readable storage medium
EP1642199A2 (en) Wireless three dimensional microwave holographic pointer (3dmi-hope) using microstrip antennas
US10475392B2 (en) Media item relighting technique
Aoyama et al. TimeLine and visualization of multiple-data sets and the visualization querying challenge
Hägele et al. Occluded object classification with mmwave mimo radar iq signals using dual-stream convolutional neural networks
Attygalle et al. Comparative testing of radar signal representations when sensing through materials
Elsadek et al. A Compact 3D-microwave holographic pointer system using a size reduced microstrip planar array
Pucihar et al. Radar-Based Human-Computer Interaction
Gooch Space and the Spaceball
Elsadek et al. 3D-microwave holographic pointer using a compact microstrip array
WO2026068986A1 (en) A system for tracking positions, orientations and trajectories in space

Legal Events

Date Code Title Description
PUAI Public reference made under article 153(3) epc to a published international application that has entered the european phase

Free format text: ORIGINAL CODE: 0009012

17P Request for examination filed

Effective date: 20050824

AK Designated contracting states

Kind code of ref document: A2

Designated state(s): AT BE BG CH CY CZ DE DK EE ES FI FR GB GR HU IE IT LI LU MC NL PT RO SE SI SK TR

DAX Request for extension of the european patent (deleted)
17Q First examination report despatched

Effective date: 20070308

STAA Information on the status of an ep patent application or granted ep patent

Free format text: STATUS: THE APPLICATION IS DEEMED TO BE WITHDRAWN

18D Application deemed to be withdrawn

Effective date: 20080701