WO2005008378A2 - Holographic human-machine interfaces - Google Patents
Holographic human-machine interfaces Download PDFInfo
- Publication number
- WO2005008378A2 WO2005008378A2 PCT/US2004/021482 US2004021482W WO2005008378A2 WO 2005008378 A2 WO2005008378 A2 WO 2005008378A2 US 2004021482 W US2004021482 W US 2004021482W WO 2005008378 A2 WO2005008378 A2 WO 2005008378A2
- Authority
- WO
- WIPO (PCT)
- Prior art keywords
- operator
- tangible
- holographic
- hologram
- electronic
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Ceased
Links
Classifications
-
- G—PHYSICS
- G03—PHOTOGRAPHY; CINEMATOGRAPHY; ANALOGOUS TECHNIQUES USING WAVES OTHER THAN OPTICAL WAVES; ELECTROGRAPHY; HOLOGRAPHY
- G03H—HOLOGRAPHIC PROCESSES OR APPARATUS
- G03H1/00—Holographic processes or apparatus using light, infrared or ultraviolet waves for obtaining holograms or for obtaining an image from them; Details peculiar thereto
- G03H1/22—Processes or apparatus for obtaining an optical image from holograms
-
- G—PHYSICS
- G03—PHOTOGRAPHY; CINEMATOGRAPHY; ANALOGOUS TECHNIQUES USING WAVES OTHER THAN OPTICAL WAVES; ELECTROGRAPHY; HOLOGRAPHY
- G03H—HOLOGRAPHIC PROCESSES OR APPARATUS
- G03H1/00—Holographic processes or apparatus using light, infrared or ultraviolet waves for obtaining holograms or for obtaining an image from them; Details peculiar thereto
- G03H1/0005—Adaptation of holography to specific applications
-
- G—PHYSICS
- G03—PHOTOGRAPHY; CINEMATOGRAPHY; ANALOGOUS TECHNIQUES USING WAVES OTHER THAN OPTICAL WAVES; ELECTROGRAPHY; HOLOGRAPHY
- G03H—HOLOGRAPHIC PROCESSES OR APPARATUS
- G03H1/00—Holographic processes or apparatus using light, infrared or ultraviolet waves for obtaining holograms or for obtaining an image from them; Details peculiar thereto
- G03H1/26—Processes or apparatus specially adapted to produce multiple sub- holograms or to obtain images from them, e.g. multicolour technique
-
- G—PHYSICS
- G06—COMPUTING OR CALCULATING; COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F3/00—Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
- G06F3/01—Input arrangements or combined input and output arrangements for interaction between user and computer
- G06F3/011—Arrangements for interaction with the human body, e.g. for user immersion in virtual reality
-
- G—PHYSICS
- G06—COMPUTING OR CALCULATING; COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F3/00—Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
- G06F3/01—Input arrangements or combined input and output arrangements for interaction between user and computer
- G06F3/03—Arrangements for converting the position or the displacement of a member into a coded form
- G06F3/041—Digitisers, e.g. for touch screens or touch pads, characterised by the transducing means
- G06F3/042—Digitisers, e.g. for touch screens or touch pads, characterised by the transducing means by opto-electronic means
- G06F3/0425—Digitisers, e.g. for touch screens or touch pads, characterised by the transducing means by opto-electronic means using a single imaging device like a video camera for tracking the absolute position of a single or a plurality of objects with respect to an imaged reference surface, e.g. video camera imaging a display or a projection screen, a table or a wall surface, on which a computer generated image is displayed or projected
-
- G—PHYSICS
- G03—PHOTOGRAPHY; CINEMATOGRAPHY; ANALOGOUS TECHNIQUES USING WAVES OTHER THAN OPTICAL WAVES; ELECTROGRAPHY; HOLOGRAPHY
- G03H—HOLOGRAPHIC PROCESSES OR APPARATUS
- G03H1/00—Holographic processes or apparatus using light, infrared or ultraviolet waves for obtaining holograms or for obtaining an image from them; Details peculiar thereto
- G03H1/04—Processes or apparatus for producing holograms
- G03H1/0402—Recording geometries or arrangements
- G03H1/0408—Total internal reflection [TIR] holograms, e.g. edge lit or substrate mode holograms
-
- G—PHYSICS
- G03—PHOTOGRAPHY; CINEMATOGRAPHY; ANALOGOUS TECHNIQUES USING WAVES OTHER THAN OPTICAL WAVES; ELECTROGRAPHY; HOLOGRAPHY
- G03H—HOLOGRAPHIC PROCESSES OR APPARATUS
- G03H1/00—Holographic processes or apparatus using light, infrared or ultraviolet waves for obtaining holograms or for obtaining an image from them; Details peculiar thereto
- G03H1/22—Processes or apparatus for obtaining an optical image from holograms
- G03H1/2286—Particular reconstruction light ; Beam properties
-
- G—PHYSICS
- G03—PHOTOGRAPHY; CINEMATOGRAPHY; ANALOGOUS TECHNIQUES USING WAVES OTHER THAN OPTICAL WAVES; ELECTROGRAPHY; HOLOGRAPHY
- G03H—HOLOGRAPHIC PROCESSES OR APPARATUS
- G03H1/00—Holographic processes or apparatus using light, infrared or ultraviolet waves for obtaining holograms or for obtaining an image from them; Details peculiar thereto
- G03H1/26—Processes or apparatus specially adapted to produce multiple sub- holograms or to obtain images from them, e.g. multicolour technique
- G03H1/2645—Multiplexing processes, e.g. aperture, shift, or wavefront multiplexing
- G03H1/265—Angle multiplexing; Multichannel holograms
-
- G—PHYSICS
- G03—PHOTOGRAPHY; CINEMATOGRAPHY; ANALOGOUS TECHNIQUES USING WAVES OTHER THAN OPTICAL WAVES; ELECTROGRAPHY; HOLOGRAPHY
- G03H—HOLOGRAPHIC PROCESSES OR APPARATUS
- G03H1/00—Holographic processes or apparatus using light, infrared or ultraviolet waves for obtaining holograms or for obtaining an image from them; Details peculiar thereto
- G03H1/0005—Adaptation of holography to specific applications
- G03H2001/0061—Adaptation of holography to specific applications in haptic applications when the observer interacts with the holobject
-
- G—PHYSICS
- G03—PHOTOGRAPHY; CINEMATOGRAPHY; ANALOGOUS TECHNIQUES USING WAVES OTHER THAN OPTICAL WAVES; ELECTROGRAPHY; HOLOGRAPHY
- G03H—HOLOGRAPHIC PROCESSES OR APPARATUS
- G03H1/00—Holographic processes or apparatus using light, infrared or ultraviolet waves for obtaining holograms or for obtaining an image from them; Details peculiar thereto
- G03H1/22—Processes or apparatus for obtaining an optical image from holograms
- G03H1/2202—Reconstruction geometries or arrangements
- G03H2001/2223—Particular relationship between light source, hologram and observer
-
- G—PHYSICS
- G03—PHOTOGRAPHY; CINEMATOGRAPHY; ANALOGOUS TECHNIQUES USING WAVES OTHER THAN OPTICAL WAVES; ELECTROGRAPHY; HOLOGRAPHY
- G03H—HOLOGRAPHIC PROCESSES OR APPARATUS
- G03H1/00—Holographic processes or apparatus using light, infrared or ultraviolet waves for obtaining holograms or for obtaining an image from them; Details peculiar thereto
- G03H1/22—Processes or apparatus for obtaining an optical image from holograms
- G03H1/2202—Reconstruction geometries or arrangements
- G03H2001/2223—Particular relationship between light source, hologram and observer
- G03H2001/2226—Edge lit holograms
-
- G—PHYSICS
- G03—PHOTOGRAPHY; CINEMATOGRAPHY; ANALOGOUS TECHNIQUES USING WAVES OTHER THAN OPTICAL WAVES; ELECTROGRAPHY; HOLOGRAPHY
- G03H—HOLOGRAPHIC PROCESSES OR APPARATUS
- G03H1/00—Holographic processes or apparatus using light, infrared or ultraviolet waves for obtaining holograms or for obtaining an image from them; Details peculiar thereto
- G03H1/22—Processes or apparatus for obtaining an optical image from holograms
- G03H1/2202—Reconstruction geometries or arrangements
- G03H2001/2223—Particular relationship between light source, hologram and observer
- G03H2001/2231—Reflection reconstruction
-
- G—PHYSICS
- G03—PHOTOGRAPHY; CINEMATOGRAPHY; ANALOGOUS TECHNIQUES USING WAVES OTHER THAN OPTICAL WAVES; ELECTROGRAPHY; HOLOGRAPHY
- G03H—HOLOGRAPHIC PROCESSES OR APPARATUS
- G03H1/00—Holographic processes or apparatus using light, infrared or ultraviolet waves for obtaining holograms or for obtaining an image from them; Details peculiar thereto
- G03H1/22—Processes or apparatus for obtaining an optical image from holograms
- G03H1/2202—Reconstruction geometries or arrangements
- G03H2001/2223—Particular relationship between light source, hologram and observer
- G03H2001/2234—Transmission reconstruction
-
- G—PHYSICS
- G03—PHOTOGRAPHY; CINEMATOGRAPHY; ANALOGOUS TECHNIQUES USING WAVES OTHER THAN OPTICAL WAVES; ELECTROGRAPHY; HOLOGRAPHY
- G03H—HOLOGRAPHIC PROCESSES OR APPARATUS
- G03H1/00—Holographic processes or apparatus using light, infrared or ultraviolet waves for obtaining holograms or for obtaining an image from them; Details peculiar thereto
- G03H1/22—Processes or apparatus for obtaining an optical image from holograms
- G03H1/2249—Holobject properties
- G03H2001/2252—Location of the holobject
- G03H2001/226—Virtual or real
-
- G—PHYSICS
- G03—PHOTOGRAPHY; CINEMATOGRAPHY; ANALOGOUS TECHNIQUES USING WAVES OTHER THAN OPTICAL WAVES; ELECTROGRAPHY; HOLOGRAPHY
- G03H—HOLOGRAPHIC PROCESSES OR APPARATUS
- G03H2227/00—Mechanical components or mechanical aspects not otherwise provided for
- G03H2227/02—Handheld portable device, e.g. holographic camera, mobile holographic display
Definitions
- the present invention relates to holographic human-machine interfaces ("HMls”) between humans and electronic or electro-mechanical devices.
- HMls holographic human-machine interfaces
- holographic HMls involve no tangible physical contact between the human operator and the control elements of the HMls because the input devices are holographic images of keys or other customarily touch-activated tangible input elements. Operator interaction with those holographic images is detected through electromagnetic means or other means, obviating the need for direct physical contact with any solid input object or surface.
- Known holographic HMl systems may be characterized by the holographic
- HMl devices being relatively large and bulky, and they may consume relatively large amounts of power, making them impractical for some uses.
- a problem may also occur with known holographic HMls, when they are intended to replace touch screens or touch pads presenting multiple screens of information to the operator, because their holographic images cannot be smoothly integrated with input or output information available to the human operator on information presentation equipment of the electronic or electro-mechanical device being controlled.
- a problem may occur when more than one piece of electronic or electro-mechanical equipment is controlled by holographic HMls, requiring multiple holographic images. In such situations, an operator is easily distracted by the multiple images.
- holographic HMls Another problem posed by present holographic HMls is that, as compared with conventional interfaces, the operator of a holographic HMl receives no tactile feedback when interacting with a holographic HMl, which may cause the operator of the holographic HMl to lose track of the commands or information being entered into the electronic or electro-mechanical device.
- the present invention is made in consideration of the above situations, and has the object to provide an apparatus for realizing the reduction of the power consumption, size and weight of conventional holographic HMls. Further, the smoothness with which they can be integrated with information presentation features of the electronic or electro-mechanical device being controlled can be enhanced and the convenience of their human operators can be facilitated using the various methods of the present invention.
- an apparatus is provided to allow an operator to control an electronic or electro-mechanical device of the type conventionally controlled by a tangible control mechanism having one or more customarily touch-activated tangible input objects, where physical contact with the device produces a response by the electronic or electro-mechanical device.
- the apparatus allows such control without the operator physically touching any solid object.
- the apparatus comprises hologram means for generating at least one of a plurality of holographic images of the one or more tangible input objects of the tangible control mechanism for the electronic or electromechanical device; illumination means for illuminating the hologram means to produce the at least one of a plurality of holographic images; actuation detection means for determining the selection by the operator of the at least one of a plurality of holographic images, generated by the hologram means, of the tangible input objects; and signal generation means for receiving the determination of the actuation detection means and providing an input signal to the electronic or electro-mechanical device thereby to produce the response, where the hologram means is affixed to a transparent or translucent material of the type including, but not limited to, glass, acrylic or plastic.
- an apparatus for allowing an operator to control more than one electronic or electromechanical device of the type conventionally controlled by a separate tangible control mechanism having at least one of a plurality of customarily touch-activated tangible input objects, where physical contact produces a response by the more than one electronic or electro-mechanical devices.
- the apparatus allows such control without the operator physically touching any solid object.
- the apparatus comprises a hologram unit adapted to generate at least one of a plurality of holographic images of the one or more tangible input objects of the tangible control mechanism for the one electronic or electro-mechanical devices; illumination means for illuminating the hologram unit to produce each holographic image; an actuation detector unit adapted to determine selection by the operator of each holographic image of the tangible input devices; a signal generator adapted to receive the determination of the actuation detector unit and provide an input signal to the devices thereby producing the response, where each of the generated holographic images is capable of independently producing a response by each electronic or electro-mechanical device corresponding to that produced conventionally by the one or more tangible input objects of the tangible control mechanism of each such electronic or electro-mechanical device.
- a control arrangement apparatus for allowing an operator to control an electronic or electromechanical device of the type conventionally controlled by a tangible control mechanism having at least one of a plurality of customarily touch-activated tangible input objects, where physical contact with which produces a response by the device is provided.
- the control arrangement allows such control without an operator physically touching any solid object.
- the control arrangement comprises a composite hologram for generating a holographic image of at least one of a plurality of tangible input objects of the tangible control mechanism for the device, with the generated holographic image, for producing a response by the device, corresponding to that produced conventionally by each of tangible input objects of the tangible control mechanism.
- the composite hologram consists of a plurality of narrow holograms positioned side-by-side along a horizontal axis such that each of the holographic images presents a different thin vertical slice of what would otherwise be images of the tangible input objects, such that each of the narrow holographic images presented by the composite hologram can be separately viewed from a slightly different angle in the horizontal plane, either by the operator moving his or her head from right to left or left to right in the horizontal plane, by the operator slightly turning said composite hologram slightly from right to left or from left to right in the horizontal plane or by the hologram's being illuminated from different angles.
- An actuation detector for determining selection by the operator of the holographic image of the tangible input devices, and a signal generator for receiving the determination of the actuation detector and providing an input signal to the device thereby to produce the response.
- FIG. 1 is schematic functional representation of an HMl according to the principles of the invention, the sensor(s) of which, used to detect the operator's interaction with the holographic images, are positioned behind the hologram in relation to the operator.
- Fig. 2 is a schematic functional representation of an HMl according to the principles of the invention, the sensors of which, used to detect the operator's interaction, are positioned below, above, or to the side of an edge of a screen of the device employed to present input or output information to the operator of the electronic or electro-mechanical device being controlled and the holographic images function as soft keys, determined by corresponding icons or other symbols on the screen.
- FIG. 3 is a schematic functional representation of an HMl according to the principles of the invention, where holographic images of more than one electronic or electro-mechanical device interfaces are projected in one convenient location.
- FIG. 4 is a schematic functional representation of one embodiment of an HMl according to the principles of the invention, where the physical separation between its hologram and reconstructing light source is reduced using one or more mirrors.
- FIG. 5 is a schematic functional representation of one embodiment of an HMl according to the principles of the invention where the physical separation between its hologram and its reconstructing light is reduced using one or more lenses.
- Fig. 6 is a block diagram of one embodiment of an HMl according to the principles of the invention, where an audio or visible response is provided to the operator upon interaction with the HMl, in lieu of a tactile response.
- FIG. 7 is a schematic functional representation of one embodiment of an HMl according to the principles of the invention, where one or more narrow holograms are recorded in such as way as to allow the operator to see, and interact with, its reconstructed images from different angles along the horizontal or vertical axes.
- the first embodiment of the present invention provides a means for reducing the size and weight of holographic HMls by positioning detecting sensors behind the hologram in relation to the operator, so as to permit those sensors to "look through” the medium upon which the hologram is mounted.
- This arrangement offers a desirable alternative to positioning of wave source sensors alongside the hologram or on the same side of the hologram as the operator because required hardware can be more compact, reducing the size and weight of the holographic HMl.
- Certain types of wave source sensors suitable for use in the construction of holographic HMls can "look through" certain types of materials on which holograms can be affixed, embossed or mounted.
- Types of sensors that can "look through” those materials include, but are not limited to, those emitting/detecting certain wave lengths of infrared emissions, for example, a sensor emitting infrared light having a wavelength of approximately 880 nanometers.
- Traditional reflection and transmission holograms are well known in the art and can be used in holographic HMls.
- the former involves the use of a reconstructing light source positioned on the same side of the hologram as the HMI's operator while the latter involves a reconstructing light source positioned behind the hologram in relation to the operator either directly or through the use of reflective materials.
- a developing technology, the edge-lit hologram offers potentially significant advantages in reducing the size and weight of holographic HMls, as described below. In each case, it is well known in the art that holographic images are translucent, with the result that they can be projected in front of other objects without obscuring them.
- edge-lit holograms are known in the art (See S.A. Benton, S.M.
- the images of an edge-lit hologram are reconstructed by using a light source positioned at an edge of a holographic HMl hologram, to illuminate that edge, thereby reconstructing that hologram's images at a distance from the material containing the edge-lit hologram, and obviating the physical separation between reconstructing light source and hologram that accompanies both reflection and transmission holograms.
- Figure 1 is a schematic functional representation of a HMl according to the principle of this invention in which the sensor(s) detecting an operator's interaction with holographic images of what would otherwise be keys or other customarily touch-activated tangible input devices of electronic or electro-mechanical devices are positioned behind the hologram in relation to the operator.
- the hologram 421 is a transmission hologram
- the reconstructing light source 28 is located behind the hologram 421 to thereby illuminate the hologram.
- a holographic image 270 is projected into the air in front of the operator.
- the hologram 421 is a reflection hologram
- it is illuminated by a reconstructing light source 28', located in front of hologram 421.
- a holographic image 270 is projected into the air in front of the operator.
- the hologram 421 is an edge-lit hologram, it is illuminated by a reconstructing light source 28" at its edge, and a holographic image 270 is projected into the air in front of the operator.
- Actuation of the device may be detected by wave source emitter/detector 350 that emits wave 360, aimed at hologram 421. Because of this oblique angle, the wave as well as its reflection, passes through the material (not shown) on which the hologram is affixed, embossed or mounted. When the presence of a physical object (such as the operator's finger 11, indicated in Fig. 1 at 11) enters the apparent position of the holographic image 270, wave 360 is reflected to emitter/detector 350 as wave 370.
- a physical object such as the operator's finger 11, indicated in Fig. 1 at 11
- the reflected wave is detected by emitter/detector 350, despite the presence of the material on which hologram 421 is mounted.
- the reflected wave causes emitter/detector 350 to transmit the operator's selection of the holographic image to the HMI's electronic or electro-mechanical device in a way and with apparatus as described, for example, in U.S. Patent No. 6,377,238.
- the second embodiment of the present invention provides a means for positioning the hologram(s) so that their reconstructed holographic images of keys or other customarily touch-activated tangible input devices appear below, above, or on either side of the screen employed to present input or output information to an operator, with respect to the electronic or electro-mechanical device(s) being actuated or controlled.
- information presentation device 94 (or other electronic presentation of information) concerning the electronic or electro-mechanical device is actuated or controlled by holographic HMls.
- Icons (or other symbols) 44 appearing on the information presentation device 94 indicate possible choices or selections for the operator of the holographic HMI's electronic or electro-mechanical device.
- Holographic images 270 corresponding to icons (or other symbols) 44 are positioned below, above, or on either side of information presentation device 94 in order to facilitate the operator's entry of commands or information into the holographic HMI's electronic or electro-mechanical device, acting as soft keys, the function of which is determined by the assigned functions of the icons (or other symbols).
- Holographic images 270 are reconstructed from holograms 421 by a reconstructing light source 28 located behind holograms 421, if holograms 421 are transmission holograms, by a reconstructing light source 28' located in front of holograms 421, if holograms 421 are reflection holograms, or by reconstructing light sources 28" if holograms 421 are edge-lit holograms.
- sensor 350 is positioned so as to detect the intrusion of a finger or other physical object into the plane of each of holographic images 270 in the present embodiment.
- FIG. 4 Shown in Fig. 4 is a schematic functional representation of one embodiment of an HMl according to the principles of the present embodiment where one or more mirrors 52 are used to alter the path of its reconstructing light source 28 in order to more conveniently position its hardware, where holograms 421 are transmission holograms, and their holographic images 270 are reconstructed by light source 28.
- the path of the reconstructing light source is "wrapped around" the hardware of the holographic HMl
- the electronic or electro-mechanical device is capable of presenting multiple "screens" of information to the operator, selected by interacting with one or more of those holographic images appearing below, above or on either side of the screen of the device itself.
- the operator then makes his/her selections on each individual "screen” of information presentation device 94 by interacting with the different holographic images, in conjunction with corresponding characters, icons, letters, prompts or other symbols appearing on each individual "screen” appearing on information presentation device 94 which are proximate to the holographic images intended to enter data with respect to those characters, icons, letters, prompts or other symbols.
- Holographic HMls constructed according to the principles of this embodiment offer clearer information presentation on the information presentation device displaying information to the operator, as compared to conventional touch screens or touch pads.
- the third embodiment of the present invention provides a means for improving holographic HMls intended for use in places or situations where two or more electronic or electro-mechanical devices are to be actuated or controlled by a small number of people, such as vehicle or aircraft cockpits or industrial or military control facilities.
- a single hologram recorded according to methods known to artisans is positioned so as to project images of keys or other customarily touch-activated tangible input devices of two or more electronic or electro-mechanical devices at a single location, convenient to the operator(s). This arrangement enhances operator convenience while limiting operator distraction from principal tasks by reducing the operator's need to look away from those tasks in order to interact with electronic or electro-mechanical devices.
- multiple electronic devices such as those installed in an automobile cockpit, for example, cellular telephone, radio, air conditioning unit, global position equipment and the like, are actuated and controlled by interacting with a single holographic HMl projected from a hologram recorded according to principles known in the art, presenting translucent holographic images of what would otherwise be the keys or buttons of those devices to the operator, at a location convenient to the operator(s), as shown in Figure 3.
- holographic images are translucent, they can be projected in front of the operator, for example, in an automobile driver's field of vision, without limiting the driver's view of the road ahead, in a pilot's field of vision, without distracting the pilot from what is going on outside the aircraft, or in front of equipment or gages in an industrial or military control facility, without limiting the operator's attention to that other equipment or gages.
- sensor 350 detects the entry of a finger or other object into one or more of the holographic image 270.
- the fourth embodiment of the present invention provides a means for improving holographic HMls employing transmission holograms by reducing their size and weight through compressing the distance between their reconstructing light sources and their holograms through recording them using a converging reference beam or by altering the direction of, or focusing or spreading, the light source employed in reconstructing their holographic images through the use of mirrors or lenses.
- a converging reference beam in a known manner to record a transmission hologram results in a short light path between the hologram and its reconstructing light source.
- building the convergent properties of a lens into the hologram itself saves size, space and weight in the resulting HMl and also reduces, if not eliminates, the need for intermediate mirrors or lenses.
- Mirrors can also be employed to shorten the physical separation between the reconstructing light source of the holographic HMl and the hologram containing an image of keys or other customarily touch-activated tangible input devices of the electronic or electro-mechanical devices to be actuated or controlled.
- lenses can be used to shorten the physical separation between the reconstructing light source of the holographic HMl and the hologram, as well as focus that emission of the reconstructing light sources, achieving greater clarity of the resulting holographic images.
- the distance at which the reconstructing light source of the holographic HMl must be positioned from its transmission hologram in order to achieve optimum image resolution depends upon the angle of the convergence or divergence of the illuminating beam that is prescribed by the recording of the hologram itself.
- the total light path needed to reconstruct the holographic images of an HMl can be compressed into a smaller physical space, as shown in Figure 4.
- analogous effects can be achieved by altering that angle of convergence or divergence through either positioning a lens between light source and film while recording the hologram or by inserting one or more lenses between the reconstructing light beam and the hologram, as shown in Figure 5.
- mirrors 52 beneath transmission hologram 421 reflect light from reconstructing light source 28 to the hologram.
- Holographic images 270 are then reconstructed in the space above transmission hologram 421.
- Holographic images 270 are reconstructed in the space above transmission hologram
- a holographic HMl constructed according to the principles of this embodiment can be smaller and more compact owing to the reduced distance between its reconstructing light source and the transmission hologram itself.
- the fifth embodiment of the present invention provides an audible or visible response to the operator of a holographic HMl in the form of an electronic or other tone or a visual signal appearing on the information presentation device, such as a computer screen, to indicate the operator's selection of one or more holographic images of what would otherwise be keys or other customarily touch-activated tangible input devices of the electronic or electro-mechanical device being actuated or controlled.
- This improvement is advantageous because, unlike conventional HMls, where an operator physically interacts with a key or other customarily touch-activated tangible device and receives a tactile response from touching the HMl, the operator of a holographic HMl receives no tactile feedback upon making a selection using the holographic HMl, since there is nothing to actually touch in interacting with a holographic HML Operator accuracy, comfort and speed are, therefore, facilitated by receiving audible or visible evidence of the entry of a command or selection into a holographic HMl according to the principles of this invention, as a substitute for the tactile feedback that an operator interacting with keys or other customarily touch- activated tangible input devices of the electronic or electro-mechanical device being actuated or controlled would expect to feel.
- the holographic HMI's software is programmed so as to cause the HMl, upon the operator's interacting with the holographic images of a holographic HMl constructed according to the principles of this embodiment, to transmit one or more commands, selected in order to elicit the desired electronic tone(s) or visible signal(s), to the internal circuitry of the electronic or electromechanical device being controlled, which causes the device's hardware to emit the desired electronic tone(s) or display the desired visible signal, clearly indicating to the operator(s) which command or selection has been entered into the electronic or electro-mechanical device.
- Figure 6 is a block diagram of circuitry according to the present invention that can be used to produce an audible feedback. [00047] In Fig.
- field terminations 1 connect a power supply 2 to external power sources for an HMl according to the principles of this invention and connect output circuitry 3, which may be relays or solid state circuits, to the electronic or electro-mechanical device that HMl is intended to actuate or control.
- power supply 2 supplies power to output circuitry 3, detection wave source 14, image light source 28, microprocessor control 4, detection circuitry 11 and audio annunciator 37.
- image light source 28, which is controlled by microprocessor control 4 reconstructs the images of hologram 421, in conjunction with image generation optics 52, which may be mirrors or lenses according to the principles of this invention.
- image generation optics 52 which may be mirrors or lenses according to the principles of this invention.
- detection optics 350 which may be contained in the same hardware, include the detection light source 14 and detection circuitry 11 , determine when a finger or other object has interacted with those holographic images and signals that event to output circuitry 3 via microprocessor control 4, causing that signal to be transmitted to the electronic or electro-mechanical device that HMl is intended to actuate or control as well as to audio annunciator 37.
- the annunciator 37 provides an audible indication that the interaction in question has been detected by that HML
- the sixth embodiment of the present invention provides a means for improving holographic HMls such that their holographic images of what would otherwise be keys or other customarily touch-activated tangible input devices of the electronic or electro-mechanical devices being actuated or controlled are larger than the physical footprint of the electronic or electro-mechanical devices they are intended to actuate or control.
- the improved holographic HMl is therefore, larger and more convenient to use than the small tactile keyboards, keypads or touch screens found in conventional electronic or electro-mechanical devices.
- one or more narrow holograms 421 are positioned so that their reconstructing light sources cause each of their holographic images to be viewable by the HMI's operator from a slightly different angle across the horizontal or vertical axes.
- laser-viewable holograms are suitable for recording and reconstructing images of holograms intended to be viewable at different angles across both horizontal and vertical axes because of their favorable parallax qualities, for use in the manner contemplated by the present embodiment.
- Each of the holographic images presented by the holograms contemplated by the present embodiment can be viewed from a slightly different angle, either by the operator moving his or her head slightly to the right or left or up or down, by the operator slightly turning the holographic HMl slightly from right to left or from left to right, or up or down, or by illuminating those holograms with different light sources from different angles, or by the light source moving so as to reconstruct the images of the hologram(s) from different angles.
- sensor 350 is positioned so as to detect the intrusion of a finger or other physical object into the plane of each of holographic images 270 in the present embodiment, at the angle at which those images appear in relation to the HML Using known techniques, the holographic HMl transmits the command or information represented by the holographic image selected by the operator(s) to the HMI's electronic or electro-mechanical device.
- the present embodiment is an improvement with respect to the size of the HMI's physical structure, and, therefore, improves its convenience of use and weight.
Landscapes
- Engineering & Computer Science (AREA)
- Physics & Mathematics (AREA)
- General Physics & Mathematics (AREA)
- General Engineering & Computer Science (AREA)
- Theoretical Computer Science (AREA)
- Human Computer Interaction (AREA)
- Multimedia (AREA)
- Holo Graphy (AREA)
- Position Input By Displaying (AREA)
Priority Applications (4)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CA2530987A CA2530987C (en) | 2003-07-03 | 2004-07-02 | Holographic human-machine interfaces |
| AU2004258513A AU2004258513B2 (en) | 2003-07-03 | 2004-07-02 | Holographic human-machine interfaces |
| EP04756643A EP1649309A4 (en) | 2003-07-03 | 2004-07-02 | Holographic human-machine interfaces |
| JP2006518820A JP4741488B2 (ja) | 2003-07-03 | 2004-07-02 | ホログラフィックヒューマンマシンインタフェース |
Applications Claiming Priority (2)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| US48483803P | 2003-07-03 | 2003-07-03 | |
| US60/484,838 | 2003-07-03 |
Publications (2)
| Publication Number | Publication Date |
|---|---|
| WO2005008378A2 true WO2005008378A2 (en) | 2005-01-27 |
| WO2005008378A3 WO2005008378A3 (en) | 2005-05-06 |
Family
ID=34079077
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| PCT/US2004/021482 Ceased WO2005008378A2 (en) | 2003-07-03 | 2004-07-02 | Holographic human-machine interfaces |
Country Status (6)
| Country | Link |
|---|---|
| US (1) | US7054045B2 (enExample) |
| EP (1) | EP1649309A4 (enExample) |
| JP (2) | JP4741488B2 (enExample) |
| AU (1) | AU2004258513B2 (enExample) |
| CA (1) | CA2530987C (enExample) |
| WO (1) | WO2005008378A2 (enExample) |
Cited By (5)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| US7724407B2 (en) | 2006-01-24 | 2010-05-25 | American Air Liquide, Inc. | Holographic display and controls applied to gas installations |
| US10120335B2 (en) | 2008-07-10 | 2018-11-06 | Real View Imaging Ltd. | Viewer tracking in a projection system |
| US11237673B2 (en) | 2018-02-19 | 2022-02-01 | Murakami Corporation | Operation detection device and operation detection method |
| JP2022124786A (ja) * | 2021-02-16 | 2022-08-26 | 大日本印刷株式会社 | 空中入力装置 |
| US11537240B2 (en) | 2018-05-22 | 2022-12-27 | Murakami Corporation | Virtual image display device |
Families Citing this family (167)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| US20100008551A9 (en) * | 1998-08-18 | 2010-01-14 | Ilya Schiller | Using handwritten information |
| US7268774B2 (en) * | 1998-08-18 | 2007-09-11 | Candledragon, Inc. | Tracking motion of a writing instrument |
| US7257255B2 (en) * | 2001-11-21 | 2007-08-14 | Candledragon, Inc. | Capturing hand motion |
| TWI289708B (en) | 2002-12-25 | 2007-11-11 | Qualcomm Mems Technologies Inc | Optical interference type color display |
| US7190496B2 (en) * | 2003-07-24 | 2007-03-13 | Zebra Imaging, Inc. | Enhanced environment visualization using holographic stereograms |
| US7342705B2 (en) | 2004-02-03 | 2008-03-11 | Idc, Llc | Spatial light modulator with integrated optical compensation structure |
| US20060038094A1 (en) * | 2004-04-29 | 2006-02-23 | Simmons Richard A | Molded bracket to join structural members |
| US20060039050A1 (en) * | 2004-08-23 | 2006-02-23 | Carver John F | Live print scanner with active holographic platen |
| US7750886B2 (en) | 2004-09-27 | 2010-07-06 | Qualcomm Mems Technologies, Inc. | Methods and devices for lighting displays |
| DE102005017313A1 (de) * | 2005-04-14 | 2006-10-19 | Volkswagen Ag | Verfahren zur Darstellung von Informationen in einem Verkehrsmittel und Kombiinstrument für ein Kraftfahrzeug |
| GB0522968D0 (en) | 2005-11-11 | 2005-12-21 | Popovich Milan M | Holographic illumination device |
| US8279168B2 (en) | 2005-12-09 | 2012-10-02 | Edge 3 Technologies Llc | Three-dimensional virtual-touch human-machine interface system and method therefor |
| DE102006006753B4 (de) * | 2006-02-12 | 2021-06-24 | Marcus Werner | Verfahren zur holographischen Detektion von Bewegungen in einer holographischen Darstellung |
| US20080170293A1 (en) * | 2006-03-15 | 2008-07-17 | Lucente Mark E | Dynamic autostereoscopic displays |
| US9843790B2 (en) | 2006-03-15 | 2017-12-12 | Fovi 3D, Inc. | Dynamic autostereoscopic displays |
| US20080144174A1 (en) * | 2006-03-15 | 2008-06-19 | Zebra Imaging, Inc. | Dynamic autostereoscopic displays |
| GB0718706D0 (en) | 2007-09-25 | 2007-11-07 | Creative Physics Ltd | Method and apparatus for reducing laser speckle |
| US7755026B2 (en) * | 2006-05-04 | 2010-07-13 | CandleDragon Inc. | Generating signals representative of sensed light that is associated with writing being done by a user |
| US7766498B2 (en) | 2006-06-21 | 2010-08-03 | Qualcomm Mems Technologies, Inc. | Linear solid state illuminator |
| US7701439B2 (en) * | 2006-07-13 | 2010-04-20 | Northrop Grumman Corporation | Gesture recognition simulation system and method |
| US9696808B2 (en) * | 2006-07-13 | 2017-07-04 | Northrop Grumman Systems Corporation | Hand-gesture recognition method |
| US8589824B2 (en) * | 2006-07-13 | 2013-11-19 | Northrop Grumman Systems Corporation | Gesture recognition interface system |
| US8972902B2 (en) * | 2008-08-22 | 2015-03-03 | Northrop Grumman Systems Corporation | Compound gesture recognition |
| US8180114B2 (en) * | 2006-07-13 | 2012-05-15 | Northrop Grumman Systems Corporation | Gesture recognition interface system with vertical display |
| US20080018591A1 (en) * | 2006-07-20 | 2008-01-24 | Arkady Pittel | User Interfacing |
| US8234578B2 (en) * | 2006-07-25 | 2012-07-31 | Northrop Grumman Systems Corporatiom | Networked gesture collaboration system |
| US8432448B2 (en) * | 2006-08-10 | 2013-04-30 | Northrop Grumman Systems Corporation | Stereo camera intrusion detection system |
| US7845841B2 (en) * | 2006-08-28 | 2010-12-07 | Qualcomm Mems Technologies, Inc. | Angle sweeping holographic illuminator |
| US8316324B2 (en) * | 2006-09-05 | 2012-11-20 | Navisense | Method and apparatus for touchless control of a device |
| US7855827B2 (en) | 2006-10-06 | 2010-12-21 | Qualcomm Mems Technologies, Inc. | Internal optical isolation structure for integrated front or back lighting |
| CN103558686B (zh) | 2006-10-06 | 2017-03-01 | 追踪有限公司 | 集成于显示器的照明设备中的光学损失结构 |
| US8107155B2 (en) | 2006-10-06 | 2012-01-31 | Qualcomm Mems Technologies, Inc. | System and method for reducing visual artifacts in displays |
| WO2008045207A2 (en) | 2006-10-06 | 2008-04-17 | Qualcomm Mems Technologies, Inc. | Light guide |
| EP2069838A2 (en) | 2006-10-06 | 2009-06-17 | Qualcomm Mems Technologies, Inc. | Illumination device with built-in light coupler |
| WO2008045463A2 (en) | 2006-10-10 | 2008-04-17 | Qualcomm Mems Technologies, Inc. | Display device with diffractive optics |
| US7864395B2 (en) | 2006-10-27 | 2011-01-04 | Qualcomm Mems Technologies, Inc. | Light guide including optical scattering elements and a method of manufacture |
| US20080166175A1 (en) * | 2007-01-05 | 2008-07-10 | Candledragon, Inc. | Holding and Using an Electronic Pen and Paper |
| US7777954B2 (en) | 2007-01-30 | 2010-08-17 | Qualcomm Mems Technologies, Inc. | Systems and methods of providing a light guiding layer |
| US20080291156A1 (en) * | 2007-05-23 | 2008-11-27 | Dietz Paul H | Sanitary User Interface |
| US7881901B2 (en) * | 2007-09-18 | 2011-02-01 | Gefemer Research Acquisitions, Llc | Method and apparatus for holographic user interface communication |
| US20090102603A1 (en) * | 2007-10-19 | 2009-04-23 | Fein Gene S | Method and apparatus for providing authentication with a user interface system |
| US20090109215A1 (en) | 2007-10-31 | 2009-04-30 | Fein Gene S | Method and apparatus for user interface communication with an image manipulator |
| US8212768B2 (en) * | 2007-10-31 | 2012-07-03 | Fimed Properties Ag Limited Liability Company | Digital, data, and multimedia user interface with a keyboard |
| US8127251B2 (en) * | 2007-10-31 | 2012-02-28 | Fimed Properties Ag Limited Liability Company | Method and apparatus for a user interface with priority data |
| US8477098B2 (en) | 2007-10-31 | 2013-07-02 | Gene S. Fein | Method and apparatus for user interface of input devices |
| US8139110B2 (en) * | 2007-11-01 | 2012-03-20 | Northrop Grumman Systems Corporation | Calibration of a gesture recognition interface system |
| US9377874B2 (en) * | 2007-11-02 | 2016-06-28 | Northrop Grumman Systems Corporation | Gesture recognition light and video image projector |
| US8586285B2 (en) | 2007-11-27 | 2013-11-19 | 3M Innovative Properties Company | Methods for forming sheeting with a composite image that floats and a master tooling |
| US8068710B2 (en) | 2007-12-07 | 2011-11-29 | Qualcomm Mems Technologies, Inc. | Decoupled holographic film and diffuser |
| WO2009102731A2 (en) | 2008-02-12 | 2009-08-20 | Qualcomm Mems Technologies, Inc. | Devices and methods for enhancing brightness of displays using angle conversion layers |
| EP2248188A2 (en) * | 2008-02-12 | 2010-11-10 | QUALCOMM MEMS Technologies, Inc. | Dual layer thin film holographic solar concentrator/collector |
| WO2009121380A1 (en) * | 2008-04-02 | 2009-10-08 | Nokia Corporation | User interfaces comprising a holographic image provider and associated methods |
| US8049951B2 (en) | 2008-04-15 | 2011-11-01 | Qualcomm Mems Technologies, Inc. | Light with bi-directional propagation |
| US8345920B2 (en) * | 2008-06-20 | 2013-01-01 | Northrop Grumman Systems Corporation | Gesture recognition interface system with a light-diffusive screen |
| US20090323144A1 (en) * | 2008-06-30 | 2009-12-31 | Qualcomm Mems Technologies, Inc. | Illumination device with holographic light guide |
| JP2012503221A (ja) * | 2008-09-18 | 2012-02-02 | クォルコム・メムズ・テクノロジーズ・インコーポレーテッド | 太陽光収集器/集光器における光収集の角度範囲の増大化 |
| US20110212774A1 (en) * | 2008-11-14 | 2011-09-01 | Karl Wudtke | Terminal including a button and button having projected images and method |
| CN202661719U (zh) * | 2009-03-10 | 2013-01-09 | 3M创新有限公司 | 具有浮现的合成图像的用户接口 |
| US11726332B2 (en) | 2009-04-27 | 2023-08-15 | Digilens Inc. | Diffractive projection apparatus |
| US9335604B2 (en) | 2013-12-11 | 2016-05-10 | Milan Momcilo Popovich | Holographic waveguide display |
| US9417700B2 (en) * | 2009-05-21 | 2016-08-16 | Edge3 Technologies | Gesture recognition systems and related methods |
| US20110068955A1 (en) * | 2009-09-22 | 2011-03-24 | Everett Simons | Virtual image labeling of input devices |
| US20110249309A1 (en) * | 2010-01-07 | 2011-10-13 | Holotouch, Inc. | Compact holograhic human-machine interface |
| EP2363055A1 (en) | 2010-03-01 | 2011-09-07 | Electrolux Home Products Corporation N.V. | Projector and household appliance comprising such a projector |
| US8396252B2 (en) | 2010-05-20 | 2013-03-12 | Edge 3 Technologies | Systems and related methods for three dimensional gesture recognition in vehicles |
| WO2012030872A1 (en) | 2010-09-02 | 2012-03-08 | Edge3 Technologies Inc. | Method and apparatus for confusion learning |
| US8655093B2 (en) | 2010-09-02 | 2014-02-18 | Edge 3 Technologies, Inc. | Method and apparatus for performing segmentation of an image |
| US8582866B2 (en) | 2011-02-10 | 2013-11-12 | Edge 3 Technologies, Inc. | Method and apparatus for disparity computation in stereo images |
| US8666144B2 (en) | 2010-09-02 | 2014-03-04 | Edge 3 Technologies, Inc. | Method and apparatus for determining disparity of texture |
| US8902484B2 (en) | 2010-12-15 | 2014-12-02 | Qualcomm Mems Technologies, Inc. | Holographic brightness enhancement film |
| KR101758163B1 (ko) * | 2010-12-31 | 2017-07-14 | 엘지전자 주식회사 | 이동 단말기 및 그의 홀로그램 제어방법 |
| US9582144B2 (en) * | 2011-01-20 | 2017-02-28 | Blackberry Limited | Three-dimensional, multi-depth presentation of icons associated with a user interface |
| US8970589B2 (en) | 2011-02-10 | 2015-03-03 | Edge 3 Technologies, Inc. | Near-touch interaction with a stereo camera grid structured tessellations |
| WO2012136970A1 (en) | 2011-04-07 | 2012-10-11 | Milan Momcilo Popovich | Laser despeckler based on angular diversity |
| EP2995986B1 (en) | 2011-08-24 | 2017-04-12 | Rockwell Collins, Inc. | Data display |
| WO2016020630A2 (en) | 2014-08-08 | 2016-02-11 | Milan Momcilo Popovich | Waveguide laser illuminator incorporating a despeckler |
| US10670876B2 (en) | 2011-08-24 | 2020-06-02 | Digilens Inc. | Waveguide laser illuminator incorporating a despeckler |
| WO2013035553A1 (ja) * | 2011-09-07 | 2013-03-14 | 日東電工株式会社 | ユーザインタフェース表示装置 |
| US9019240B2 (en) | 2011-09-29 | 2015-04-28 | Qualcomm Mems Technologies, Inc. | Optical touch device with pixilated light-turning features |
| US9672609B1 (en) | 2011-11-11 | 2017-06-06 | Edge 3 Technologies, Inc. | Method and apparatus for improved depth-map estimation |
| US20150010265A1 (en) | 2012-01-06 | 2015-01-08 | Milan, Momcilo POPOVICH | Contact image sensor using switchable bragg gratings |
| EP2842003B1 (en) | 2012-04-25 | 2019-02-27 | Rockwell Collins, Inc. | Holographic wide angle display |
| JP2013242850A (ja) * | 2012-04-27 | 2013-12-05 | Nitto Denko Corp | 表示入力装置 |
| US9456744B2 (en) | 2012-05-11 | 2016-10-04 | Digilens, Inc. | Apparatus for eye tracking |
| US10282034B2 (en) | 2012-10-14 | 2019-05-07 | Neonode Inc. | Touch sensitive curved and flexible displays |
| US9164625B2 (en) | 2012-10-14 | 2015-10-20 | Neonode Inc. | Proximity sensor for determining two-dimensional coordinates of a proximal object |
| US9921661B2 (en) | 2012-10-14 | 2018-03-20 | Neonode Inc. | Optical proximity sensor and associated user interface |
| US9933684B2 (en) | 2012-11-16 | 2018-04-03 | Rockwell Collins, Inc. | Transparent waveguide display providing upper and lower fields of view having a specific light output aperture configuration |
| US10721448B2 (en) | 2013-03-15 | 2020-07-21 | Edge 3 Technologies, Inc. | Method and apparatus for adaptive exposure bracketing, segmentation and scene organization |
| US10209517B2 (en) | 2013-05-20 | 2019-02-19 | Digilens, Inc. | Holographic waveguide eye tracker |
| US9727772B2 (en) | 2013-07-31 | 2017-08-08 | Digilens, Inc. | Method and apparatus for contact image sensing |
| US9606506B2 (en) * | 2013-10-15 | 2017-03-28 | Microsoft Technology Licensing, Llc | Holographic interaction device |
| WO2016020632A1 (en) | 2014-08-08 | 2016-02-11 | Milan Momcilo Popovich | Method for holographic mastering and replication |
| US10241330B2 (en) | 2014-09-19 | 2019-03-26 | Digilens, Inc. | Method and apparatus for generating input images for holographic waveguide displays |
| DE102014114049A1 (de) * | 2014-09-26 | 2016-03-31 | Huf Hülsbeck & Fürst Gmbh & Co. Kg | Vorrichtung zur Aktivierung einer Funktion eines Fahrzeuges |
| US10423222B2 (en) | 2014-09-26 | 2019-09-24 | Digilens Inc. | Holographic waveguide optical tracker |
| CN104407786A (zh) * | 2014-09-30 | 2015-03-11 | 深圳市亿思达科技集团有限公司 | 实现全息图像显示的交互式显示方法、控制方法及系统 |
| US20180275402A1 (en) | 2015-01-12 | 2018-09-27 | Digilens, Inc. | Holographic waveguide light field displays |
| WO2016113534A1 (en) | 2015-01-12 | 2016-07-21 | Milan Momcilo Popovich | Environmentally isolated waveguide display |
| JP6867947B2 (ja) | 2015-01-20 | 2021-05-12 | ディジレンズ インコーポレイテッド | ホログラフィック導波路ライダー |
| US9632226B2 (en) | 2015-02-12 | 2017-04-25 | Digilens Inc. | Waveguide grating device |
| WO2016146963A1 (en) | 2015-03-16 | 2016-09-22 | Popovich, Milan, Momcilo | Waveguide device incorporating a light pipe |
| US10591756B2 (en) | 2015-03-31 | 2020-03-17 | Digilens Inc. | Method and apparatus for contact image sensing |
| US10007413B2 (en) | 2015-04-27 | 2018-06-26 | Microsoft Technology Licensing, Llc | Mixed environment display of attached control elements |
| US9713871B2 (en) | 2015-04-27 | 2017-07-25 | Microsoft Technology Licensing, Llc | Enhanced configuration and control of robots |
| US11449146B2 (en) * | 2015-06-10 | 2022-09-20 | Wayne Patrick O'Brien | Interactive holographic human-computer interface |
| GB201510523D0 (en) | 2015-06-16 | 2015-07-29 | Jaguar Land Rover Ltd | Vehicle information display assembly, system and method |
| US10275098B1 (en) * | 2015-07-12 | 2019-04-30 | sigmund lindsay clements | Laser mid-air hologram touch input buttons for a device |
| DE102015213424A1 (de) * | 2015-07-16 | 2017-01-19 | Audi Ag | Verfahren und Bediensystem zum Bedienen von mindestens einer Funktion in einem Fahrzeug |
| EP3359999A1 (en) | 2015-10-05 | 2018-08-15 | Popovich, Milan Momcilo | Waveguide display |
| US11609427B2 (en) | 2015-10-16 | 2023-03-21 | Ostendo Technologies, Inc. | Dual-mode augmented/virtual reality (AR/VR) near-eye wearable displays |
| US11106273B2 (en) * | 2015-10-30 | 2021-08-31 | Ostendo Technologies, Inc. | System and methods for on-body gestural interfaces and projection displays |
| US10345594B2 (en) | 2015-12-18 | 2019-07-09 | Ostendo Technologies, Inc. | Systems and methods for augmented near-eye wearable displays |
| US10578882B2 (en) | 2015-12-28 | 2020-03-03 | Ostendo Technologies, Inc. | Non-telecentric emissive micro-pixel array light modulators and methods of fabrication thereof |
| CN109073889B (zh) | 2016-02-04 | 2021-04-27 | 迪吉伦斯公司 | 全息波导光学跟踪器 |
| EP3433659B1 (en) | 2016-03-24 | 2024-10-23 | DigiLens, Inc. | Method and apparatus for providing a polarization selective holographic waveguide device |
| US10353203B2 (en) | 2016-04-05 | 2019-07-16 | Ostendo Technologies, Inc. | Augmented/virtual reality near-eye displays with edge imaging lens comprising a plurality of display devices |
| US10890707B2 (en) | 2016-04-11 | 2021-01-12 | Digilens Inc. | Holographic waveguide apparatus for structured light projection |
| US10453431B2 (en) | 2016-04-28 | 2019-10-22 | Ostendo Technologies, Inc. | Integrated near-far light field display systems |
| US10522106B2 (en) | 2016-05-05 | 2019-12-31 | Ostendo Technologies, Inc. | Methods and apparatus for active transparency modulation |
| US10140776B2 (en) | 2016-06-13 | 2018-11-27 | Microsoft Technology Licensing, Llc | Altering properties of rendered objects via control points |
| CN106362991A (zh) * | 2016-09-12 | 2017-02-01 | 芜湖能盟信息技术有限公司 | 全息显示自清洁装置 |
| DE102016217398A1 (de) * | 2016-09-13 | 2018-03-15 | Volkswagen Aktiengesellschaft | Verfahren und Vorrichtung zur Erzeugung von Bildeffekten im Innenraum oder außerhalb eines Fahrzeugs |
| DE102016120995A1 (de) * | 2016-11-03 | 2018-05-03 | Visteon Global Technologies, Inc. | Benutzerschnittstelle und Verfahren zur Eingabe und Ausgabe von Informationen in einem Fahrzeug |
| US11513350B2 (en) | 2016-12-02 | 2022-11-29 | Digilens Inc. | Waveguide device with uniform output illumination |
| WO2018129398A1 (en) | 2017-01-05 | 2018-07-12 | Digilens, Inc. | Wearable heads up displays |
| EP3662328A4 (en) * | 2017-07-31 | 2021-05-05 | Driessen Aerospace Group N.V. | VIRTUAL CONTROL DEVICE AND SYSTEM |
| JP7399084B2 (ja) | 2017-10-16 | 2023-12-15 | ディジレンズ インコーポレイテッド | ピクセル化されたディスプレイの画像分解能を倍増させるためのシステムおよび方法 |
| WO2019136476A1 (en) | 2018-01-08 | 2019-07-11 | Digilens, Inc. | Waveguide architectures and related methods of manufacturing |
| KR102768598B1 (ko) | 2018-01-08 | 2025-02-13 | 디지렌즈 인코포레이티드. | 도파관 셀 내의 홀로그래픽 격자의 높은 처리능력의 레코딩을 위한 시스템 및 방법 |
| WO2019136473A1 (en) | 2018-01-08 | 2019-07-11 | Digilens, Inc. | Methods for fabricating optical waveguides |
| KR102819207B1 (ko) | 2018-01-08 | 2025-06-11 | 디지렌즈 인코포레이티드. | 도파관 셀을 제조하기 위한 시스템 및 방법 |
| EP3528092A1 (en) * | 2018-02-15 | 2019-08-21 | Vestel Elektronik Sanayi ve Ticaret A.S. | Three dimensional input device and input method |
| EP3556702A1 (en) | 2018-03-13 | 2019-10-23 | Otis Elevator Company | Augmented reality car operating panel |
| JP7487109B2 (ja) | 2018-03-16 | 2024-05-20 | ディジレンズ インコーポレイテッド | 複屈折制御を組み込むホログラフィック導波管およびその加工のための方法 |
| FR3080470B1 (fr) * | 2018-04-20 | 2020-06-19 | Valeo Vision | Dispositif optique pour l'affichage d'image holographique |
| US11188154B2 (en) * | 2018-05-30 | 2021-11-30 | International Business Machines Corporation | Context dependent projection of holographic objects |
| WO2020023779A1 (en) | 2018-07-25 | 2020-01-30 | Digilens Inc. | Systems and methods for fabricating a multilayer optical structure |
| JP2022503796A (ja) | 2018-10-01 | 2022-01-12 | レイア、インコーポレイテッド | ホログラフィックリアリティシステム、マルチビューディスプレイ、および方法 |
| DE102018221797A1 (de) * | 2018-12-14 | 2020-06-18 | Volkswagen Aktiengesellschaft | Benutzerschnittstelle eines Fahrzeugs und Verfahren zur Konfiguration und Steuerung der Benutzerschnittstelle |
| WO2020149956A1 (en) | 2019-01-14 | 2020-07-23 | Digilens Inc. | Holographic waveguide display with light control layer |
| WO2020163524A1 (en) | 2019-02-05 | 2020-08-13 | Digilens Inc. | Methods for compensating for optical surface nonuniformity |
| EP3924759B1 (en) | 2019-02-15 | 2025-07-30 | Digilens Inc. | Methods and apparatuses for providing a holographic waveguide display using integrated gratings |
| US20220283377A1 (en) | 2019-02-15 | 2022-09-08 | Digilens Inc. | Wide Angle Waveguide Display |
| US20200292745A1 (en) | 2019-03-12 | 2020-09-17 | Digilens Inc. | Holographic Waveguide Backlight and Related Methods of Manufacturing |
| DE102019206196A1 (de) * | 2019-04-30 | 2020-11-05 | Volkswagen Aktiengesellschaft | Fahrzeug mit einer Benutzerschnittstelle |
| CN114207492A (zh) | 2019-06-07 | 2022-03-18 | 迪吉伦斯公司 | 带透射光栅和反射光栅的波导及其生产方法 |
| CN114341729A (zh) | 2019-07-29 | 2022-04-12 | 迪吉伦斯公司 | 用于使像素化显示器的图像分辨率和视场倍增的方法和设备 |
| KR102775783B1 (ko) | 2019-08-29 | 2025-02-28 | 디지렌즈 인코포레이티드. | 진공 격자 및 이의 제조 방법 |
| DE102019217703A1 (de) * | 2019-11-18 | 2021-06-02 | Volkswagen Aktiengesellschaft | Fahrzeugsitz |
| CN110928128A (zh) * | 2019-12-31 | 2020-03-27 | 南京大地建设集团有限责任公司 | 一种指导预制装配式构件生产制作全息投影设备 |
| WO2021138516A1 (en) | 2019-12-31 | 2021-07-08 | Neonode Inc. | Contactless touch input system |
| US11344655B2 (en) | 2020-06-29 | 2022-05-31 | John T. Daugirdas | Holographic control system for hemodialysis |
| WO2022140763A1 (en) | 2020-12-21 | 2022-06-30 | Digilens Inc. | Eye glow suppression in waveguide based displays |
| WO2022150841A1 (en) | 2021-01-07 | 2022-07-14 | Digilens Inc. | Grating structures for color waveguides |
| JP2024508926A (ja) | 2021-03-05 | 2024-02-28 | ディジレンズ インコーポレイテッド | 真空周期的構造体および製造の方法 |
| JP2022180955A (ja) * | 2021-05-25 | 2022-12-07 | 大日本印刷株式会社 | 車両用空中入力装置、車両用空中入力表示装置及び車両 |
| JP7720030B2 (ja) * | 2021-05-25 | 2025-08-07 | 大日本印刷株式会社 | 空中入力装置、空中入力表示装置 |
| DE102021116880B3 (de) * | 2021-06-30 | 2022-09-08 | Preh Gmbh | Bedienelement mit holografischer Funktionsanzeige zur Visualisierung der dem Bedienelement zugeordneten Schaltfunktion und/oder dessen jeweiligen Schaltzustands sowie zugehörige Anordnung |
| DE102021210915A1 (de) * | 2021-09-29 | 2023-03-30 | Carl Zeiss Jena Gmbh | Holographisches bedienelement |
| US12019847B2 (en) | 2021-10-11 | 2024-06-25 | James Christopher Malin | Contactless interactive interface |
| DE102022101316A1 (de) * | 2022-01-20 | 2023-07-20 | Carl Zeiss Jena Gmbh | Haptisches Hologramm |
| DE102022202041A1 (de) * | 2022-02-28 | 2023-08-31 | Carl Zeiss Jena Gmbh | Holographische leuchtvorrichtung mit entlang einer zentralen achse angeordnetetn elementen und einkoppelfläche im randbereich |
| US12366923B2 (en) | 2022-09-26 | 2025-07-22 | Pison Technology, Inc. | Systems and methods for gesture inference using ML model selection |
| US12366920B2 (en) | 2022-09-26 | 2025-07-22 | Pison Technology, Inc. | Systems and methods for gesture inference using transformations |
| US12340627B2 (en) | 2022-09-26 | 2025-06-24 | Pison Technology, Inc. | System and methods for gesture inference using computer vision |
| EP4560381A1 (en) * | 2023-11-24 | 2025-05-28 | Motherson Innovations Company Ltd. | System for camera and holographic display |
Family Cites Families (21)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| US4818048A (en) * | 1987-01-06 | 1989-04-04 | Hughes Aircraft Company | Holographic head-up control panel |
| JPH0266825A (ja) | 1988-08-31 | 1990-03-06 | Aisin Seiki Co Ltd | 空間スイッチ |
| JPH0346724A (ja) | 1989-07-14 | 1991-02-28 | Aisin Seiki Co Ltd | スイッチ装置 |
| JPH03217925A (ja) | 1990-01-23 | 1991-09-25 | Dainippon Printing Co Ltd | ホログラム表示を用いた表示画面上情報入力装置 |
| JP2921704B2 (ja) | 1990-05-31 | 1999-07-19 | 松下電器産業株式会社 | スクリーン印刷機 |
| JPH08511365A (ja) * | 1993-04-28 | 1996-11-26 | マクフェターズ,アール.,ダグラス | ホログラフィックなオペレータ・インタフェース |
| JPH09190278A (ja) * | 1996-01-09 | 1997-07-22 | Mitsubishi Motors Corp | 機器の操作系選択装置 |
| JP4417440B2 (ja) * | 1996-02-16 | 2010-02-17 | 大日本印刷株式会社 | 拡散ホログラムタッチパネル |
| JPH10187332A (ja) * | 1996-12-24 | 1998-07-14 | Dainippon Printing Co Ltd | ホログラム入力キーボード |
| JPH10288971A (ja) * | 1997-04-14 | 1998-10-27 | Dainippon Printing Co Ltd | ホログラム標識 |
| US6031519A (en) * | 1997-12-30 | 2000-02-29 | O'brien; Wayne P. | Holographic direct manipulation interface |
| US6064354A (en) * | 1998-07-01 | 2000-05-16 | Deluca; Michael Joseph | Stereoscopic user interface method and apparatus |
| US6614422B1 (en) * | 1999-11-04 | 2003-09-02 | Canesta, Inc. | Method and apparatus for entering data using a virtual input device |
| US6665100B1 (en) * | 1999-08-10 | 2003-12-16 | Zebra Imaging, Inc. | Autostereoscopic three dimensional display using holographic projection |
| DE20001134U1 (de) * | 2000-01-24 | 2000-05-18 | Peter Fritz | Operations-System |
| US6611252B1 (en) * | 2000-05-17 | 2003-08-26 | Dufaux Douglas P. | Virtual data input device |
| KR100865598B1 (ko) * | 2000-05-29 | 2008-10-27 | 브이케이비 인코포레이티드 | 수문자 조합 및 다른 데이터의 입력을 위한 가상 데이터입력 장치 및 방법 |
| US6650318B1 (en) * | 2000-10-13 | 2003-11-18 | Vkb Inc. | Data input device |
| JP2002055630A (ja) * | 2000-08-08 | 2002-02-20 | Stanley Electric Co Ltd | 表示パネル |
| JP2003005617A (ja) * | 2001-02-23 | 2003-01-08 | Denso Corp | ホログラムディスプレイ装置及びテレビ電話 |
| US7671843B2 (en) * | 2002-11-12 | 2010-03-02 | Steve Montellese | Virtual holographic input method and device |
-
2004
- 2004-07-02 CA CA2530987A patent/CA2530987C/en not_active Expired - Fee Related
- 2004-07-02 WO PCT/US2004/021482 patent/WO2005008378A2/en not_active Ceased
- 2004-07-02 US US10/882,178 patent/US7054045B2/en not_active Expired - Lifetime
- 2004-07-02 AU AU2004258513A patent/AU2004258513B2/en not_active Ceased
- 2004-07-02 JP JP2006518820A patent/JP4741488B2/ja not_active Expired - Fee Related
- 2004-07-02 EP EP04756643A patent/EP1649309A4/en not_active Withdrawn
-
2011
- 2011-03-18 JP JP2011061241A patent/JP5113922B2/ja not_active Expired - Fee Related
Non-Patent Citations (1)
| Title |
|---|
| See references of EP1649309A4 * |
Cited By (7)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| US7724407B2 (en) | 2006-01-24 | 2010-05-25 | American Air Liquide, Inc. | Holographic display and controls applied to gas installations |
| US10120335B2 (en) | 2008-07-10 | 2018-11-06 | Real View Imaging Ltd. | Viewer tracking in a projection system |
| US10585395B2 (en) | 2008-07-10 | 2020-03-10 | Real View Imaging Ltd. | Holographic image display system |
| US12386311B2 (en) | 2008-07-10 | 2025-08-12 | Real View Imaging Ltd. | Holographic image display system |
| US11237673B2 (en) | 2018-02-19 | 2022-02-01 | Murakami Corporation | Operation detection device and operation detection method |
| US11537240B2 (en) | 2018-05-22 | 2022-12-27 | Murakami Corporation | Virtual image display device |
| JP2022124786A (ja) * | 2021-02-16 | 2022-08-26 | 大日本印刷株式会社 | 空中入力装置 |
Also Published As
| Publication number | Publication date |
|---|---|
| JP4741488B2 (ja) | 2011-08-03 |
| EP1649309A4 (en) | 2011-03-09 |
| EP1649309A2 (en) | 2006-04-26 |
| US20050002074A1 (en) | 2005-01-06 |
| WO2005008378A3 (en) | 2005-05-06 |
| AU2004258513A1 (en) | 2005-01-27 |
| CA2530987C (en) | 2012-04-17 |
| US7054045B2 (en) | 2006-05-30 |
| JP5113922B2 (ja) | 2013-01-09 |
| JP2007531067A (ja) | 2007-11-01 |
| AU2004258513B2 (en) | 2009-12-24 |
| CA2530987A1 (en) | 2005-01-27 |
| JP2011154389A (ja) | 2011-08-11 |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| CA2530987C (en) | Holographic human-machine interfaces | |
| US6377238B1 (en) | Holographic control arrangement | |
| US7084859B1 (en) | Programmable tactile touch screen displays and man-machine interfaces for improved vehicle instrumentation and telematics | |
| US8482534B2 (en) | Programmable tactile touch screen displays and man-machine interfaces for improved vehicle instrumentation and telematics | |
| US8482535B2 (en) | Programmable tactile touch screen displays and man-machine interfaces for improved vehicle instrumentation and telematics | |
| US8576199B1 (en) | Computer control systems | |
| US20110018831A1 (en) | Human interfaces for vehicles, homes, and other applications | |
| US20230205369A1 (en) | Input device | |
| US20130057594A1 (en) | Reconfigurable control displays for games, toys, and other applications | |
| JP7172207B2 (ja) | 入力装置 | |
| CN116530099A (zh) | 空间悬浮影像显示装置 | |
| JP2025011189A (ja) | 空間浮遊映像表示装置 | |
| US20240210877A1 (en) | Optical system for floating holograms, comprising a plurality of switchable optical channels | |
| Miyazaki et al. | Visual feedback using semitransparent mirror to enhance depth perception of aerial image in floating touch display | |
| JP7734858B2 (ja) | インタフェース装置及びインタフェースシステム | |
| JP2021067731A (ja) | 情報表示装置 | |
| KR20240137589A (ko) | 햅틱 홀로그램 | |
| KR100410996B1 (ko) | 차량전방의영상출력장치 | |
| JPH1116462A (ja) | 非接触スイッチ | |
| JP2000020217A (ja) | 入力支援装置 |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| AK | Designated states |
Kind code of ref document: A2 Designated state(s): AE AG AL AM AT AU AZ BA BB BG BR BW BY BZ CA CH CN CO CR CU CZ DE DK DM DZ EC EE EG ES FI GB GD GE GH GM HR HU ID IL IN IS JP KE KG KP KR KZ LC LK LR LS LT LU LV MA MD MG MK MN MW MX MZ NA NI NO NZ OM PG PH PL PT RO RU SC SD SE SG SK SL SY TJ TM TN TR TT TZ UA UG US UZ VC VN YU ZA ZM ZW |
|
| AL | Designated countries for regional patents |
Kind code of ref document: A2 Designated state(s): GM KE LS MW MZ NA SD SL SZ TZ UG ZM ZW AM AZ BY KG KZ MD RU TJ TM AT BE BG CH CY CZ DE DK EE ES FI FR GB GR HU IE IT LU MC NL PL PT RO SE SI SK TR BF BJ CF CG CI CM GA GN GQ GW ML MR NE SN TD TG |
|
| 121 | Ep: the epo has been informed by wipo that ep was designated in this application | ||
| WWE | Wipo information: entry into national phase |
Ref document number: 2006518820 Country of ref document: JP |
|
| ENP | Entry into the national phase |
Ref document number: 2530987 Country of ref document: CA |
|
| WWE | Wipo information: entry into national phase |
Ref document number: 2004258513 Country of ref document: AU |
|
| REEP | Request for entry into the european phase |
Ref document number: 2004756643 Country of ref document: EP |
|
| WWE | Wipo information: entry into national phase |
Ref document number: 2004756643 Country of ref document: EP |
|
| ENP | Entry into the national phase |
Ref document number: 2004258513 Country of ref document: AU Date of ref document: 20040702 Kind code of ref document: A |
|
| WWP | Wipo information: published in national office |
Ref document number: 2004258513 Country of ref document: AU |
|
| WWP | Wipo information: published in national office |
Ref document number: 2004756643 Country of ref document: EP |