Connect public, paid and private patent data with Google Patents Public Datasets

Touch sensor for controlling eyewear

Download PDF

Info

Publication number
US20110194029A1
US20110194029A1 US13022112 US201113022112A US20110194029A1 US 20110194029 A1 US20110194029 A1 US 20110194029A1 US 13022112 US13022112 US 13022112 US 201113022112 A US201113022112 A US 201113022112A US 20110194029 A1 US20110194029 A1 US 20110194029A1
Authority
US
Grant status
Application
Patent type
Prior art keywords
video
hmd
user
input
capacitive
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Granted
Application number
US13022112
Other versions
US8665177B2 (en )
Inventor
Frederick P. Herrmann
John Gassel
Jim Johnston
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
Kopin Corp
Original Assignee
Kopin Corp
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date

Links

Images

Classifications

    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04NPICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N13/00Stereoscopic or multiview television systems; Details thereof
    • H04N13/04Picture reproducers
    • H04N13/0429Picture reproducers for viewing by the user with the aid of special glasses or head mounted displays [HMD], i.e. stereoscopic displaying
    • H04N13/044Picture reproducers for viewing by the user with the aid of special glasses or head mounted displays [HMD], i.e. stereoscopic displaying with head mounted left-right displays
    • GPHYSICS
    • G02OPTICS
    • G02BOPTICAL ELEMENTS, SYSTEMS, OR APPARATUS
    • G02B27/00Other optical systems; Other optical apparatus
    • G02B27/01Head-up displays
    • G02B27/017Head mounted
    • GPHYSICS
    • G06COMPUTING; CALCULATING; COUNTING
    • G06FELECTRICAL DIGITAL DATA PROCESSING
    • G06F1/00Details of data-processing equipment not covered by groups G06F3/00 - G06F13/00, e.g. cooling, packaging or power supply specially adapted for computer application
    • G06F1/16Constructional details or arrangements
    • G06F1/1613Constructional details or arrangements for portable computers
    • G06F1/163Wearable computers, e.g. on a belt
    • GPHYSICS
    • G06COMPUTING; CALCULATING; COUNTING
    • G06FELECTRICAL DIGITAL DATA PROCESSING
    • G06F3/00Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
    • G06F3/01Input arrangements or combined input and output arrangements for interaction between user and computer
    • G06F3/011Arrangements for interaction with the human body, e.g. for user immersion in virtual reality
    • G06F3/013Eye tracking input arrangements
    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04NPICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N13/00Stereoscopic or multiview television systems; Details thereof
    • H04N13/04Picture reproducers
    • H04N13/0497Synchronisation or controlling aspects
    • GPHYSICS
    • G06COMPUTING; CALCULATING; COUNTING
    • G06FELECTRICAL DIGITAL DATA PROCESSING
    • G06F2203/00Indexing scheme relating to G06F3/00 - G06F3/048
    • G06F2203/033Indexing scheme relating to G06F3/033
    • G06F2203/0339Touch strips, e.g. orthogonal touch strips to control cursor movement or scrolling; single touch strip to adjust parameter or to implement a row of soft keys

Abstract

Capacitive touch sensors are integrated with a head-mounted display (HMD) device or other video eyewear devices to create a more reliable and more intuitive user interface. The sensors, which may be implemented as an array, control various aspects of a left and right channel multimedia presentation, such as interpupillary distance or stereoscopic convergence, brightness, volume, or power mode.

Description

    RELATED APPLICATION(S)
  • [0001]
    This application claims the benefit of U.S. Provisional Application No. 61/301,865, filed on Feb. 5, 2010. The entire teachings of the above application are incorporated herein by reference.
  • TECHNICAL FIELD
  • [0002]
    This application relates to integration of capacitive sensing with head-mounted display (HMD) technology to create a more reliable and more intuitive user control interface.
  • BACKGROUND
  • [0003]
    The consumer electronics marketplace has witnessed increasing replacement of traditional switches (pushbutton, toggle, etc.) with capacitive sense technology. One of the most recognized implementations of this technology are gesture based touch-screens such as the Apple iPhone's unlock feature (Apple™ and iPhone™ are trademarks of Apple, Inc. of Cupertino, Calif.). The user simply pushes and slides their finger across the bottom of the screen to unlock the device. That motion is intuitive to figure out. Additionally, the action of doing so is such that it cannot be easily done inadvertently if the device is in one's pocket.
  • [0004]
    Another example of a capacitive sense toggle switch can be seen on the Sony Playstation 3 (PS3) console system. (Sony™, Playstation™, and PS3™ are trademarks of Sony Corporation of Tokyo, Japan). The on/off power switch and the eject button of the PS3 are both cap sense buttons with logos imprinted on the plastic so the user knows its function.
  • [0005]
    Capacitive sense technology can also be expanded to proximity sensing. To utilize the iPhone as an example once again, the iPhone senses when it is in close proximity to the users' face during a call. It shuts off the backlight to save power and disables operation off all the buttons so they are not accidentally pressed.
  • [0006]
    Head-mounted displays (HMDs) and video eyewear provide large format pictures in a small form factor. The HMD is a portable media device and as such the unit is designed to be small and lightweight. A typical HMD connects to a battery pack and another portable device that serves as the video source. The controls for the HMD are normally located on the battery pack itself. The controls can also be placed inline with the cable on a small push-button adapter that will lie somewhere between the person's head (HMD location) and the person's waist (battery pack location).
  • [0007]
    Another style of HMD design is the stand-alone configuration. In this type there is no cable and no battery pack. Instead, the batteries and controls are located inside or on the HMD itself. This style of HMD typically has push-buttons and slide switches located on the arms. However, the user must memorize the button locations and functions prior to putting on the eyewear or figure it out through trial and error. It is generally not an intuitive design.
  • SUMMARY OF THE INVENTIONS
  • [0008]
    As mentioned earlier, current HMD designs that offer controls on the HMD itself typically utilize push-button switches and lack an intuitive nature. Another major consequence of the prior designs is that to actuate the switch requires a significant amount of pressure. This can easily cause the HMD to move and thus disrupt the user's viewing of a video. On the other hand, capacitive sense arrays implemented as discussed herein, require little or no contact depending on the sensitivity of the electrode. The user can lightly press their finger to the plastics to control it and continue to watch the video unhindered.
  • [0009]
    The utilization of capacitive touch technology on an HMD greatly improves their design by making user control inputs more intuitive.
  • [0010]
    The capacitive sensor or sensor arrays can be placed on the arms of the HMD in a slider configuration for volume control. The sensed input can be integrated with on screen display to show the volume level, such as while the capacitive array is being pressed. The same concept can be used to control the display brightness, mode, etc.
  • [0011]
    The relative location of either display can be electronically adjusted to adjust the stereoscopic convergence or correct for a person's IPD (interpupillary distance) preference, such as by touching and sliding a finger on a capacitive array located on the front of the unit. Such an input moves the relative location of the two images electronically.
  • [0012]
    HMD power can also be controlled by a capacitive sensor arranged in proximity to the user's face. A low power standby mode is entered when the user's face is not present, and a power off mode is entered if the HMD is not used for some period of time. These features save battery life.
  • [0013]
    To further increase the intuitive nature of capacitive sensor control, their operation can be integrated with an on-screen display. For example, a volume level indication can be displayed as soon as the array is pressed, with adjustment possible after holding the finger on the array for a short period of time. This is desirable so that the user can be sure they are adjusting the proper button. Also, this time delay reduces the risk of inadvertent adjustments being made simply by grabbing the HMD.
  • [0014]
    Capacitive touch sensors also make button placement much more flexible because the electrodes can be positioned against the outer edge of the plastics when patterned on a flexible board. Therefore the volume control can be made closer to the ear, the brightness control a slider near the display. The designer no longer needs the same rigidity and size that would be required to hold physical moving buttons.
  • [0015]
    One of the major design metrics for HMDs is the weight of the unit. Using capacitive sense arrays in place of buttons is a definite advantage. The capacitive sense electrodes can be patterned onto a flex circuit which is very light weight. There is nothing mechanical about the array so there is much less worry about the device breaking from improper use or wear-and-tear over time like a normal switch.
  • [0016]
    Furthermore, interpupillary distance (IPD) is the distance between the centers of one's pupil to the other pupil. This varies a good amount from person to person, with the average adult male having an IPD of 63.5 mm. Typical adjustment methods are mechanical, where the two displays are physically moved by the user. Although this type of control works, it adds weight and complexity to the system adding another mechanism that can break.
  • [0017]
    With the integration of capacitive sense to a binocular HMD, it is possible to handle IPD adjustment electronically. The user can adjust the IPD to fit his personal preference, providing that there are some extra unused pixels horizontally on either side of the displays to allow for moving the image within it. Providing control to do this by sliding a finger near the display is much more intuitive than having to navigate through a menu system to accomplish the same thing. A pinch and spread motion between the two eyes is also an intuitive way to adjust IPD or even used to zoom in and out of the image is the display processing can handle it. The applications of such sensor arrays to control aspects of the multimedia presented on the HMD are really quite extensive.
  • [0018]
    At the HMD, it is also possible to utilize capacitive sensor as a proximity sensor. In portable electronics, battery life is extremely important. There is no need to be running the display or backlights if the user has taken the eyewear off or flipped it up into a stowed position. A capacitive sense electrode that is configured to be very sensitive is able to detect the presence of the user's face. This information can be used to enter standby mode if the viewer takes the eyewear off. Eyewear that is designed to flip up and stow without being removed from the user's head can also utilize this proximity sensor to enter standby. To do so the HMD should be mechanically designed to have a ground shield between the capacitive sensor and the user's head only when in the stowed position. The sensor in this design will have similar readings to that of being totally removed. After a prolonged period of standby time the software could shut the entire system off.
  • [0019]
    The proximity sensor idea can be expanded even further if the device is integrated with an external video player. Once the system enters standby, the HMD can send a message to the player issuing a pause command so that they can pick up right where they left off.
  • [0020]
    Many of these capacitive sense ideas mentioned in the context of HMDs above can be moved (physically) to an external battery pack electronics and not lose any of the added intuitive functionality. In fact, the battery pack allows for a larger rectangular area to work with when designing the electrodes. A push and hold power switch could replace a common slide switch.
  • BRIEF DESCRIPTION OF THE DRAWINGS
  • [0021]
    The foregoing will be apparent from the following more particular description of example embodiments of the invention, as illustrated in the accompanying drawings in which like reference characters refer to the same parts throughout the different views.
  • [0022]
    The drawings are not necessarily to scale, emphasis instead being placed upon illustrating embodiments of the present invention.
  • [0023]
    FIG. 1 is a perspective view of a Head Mounted Display (HMD) apparatus as worn by a user.
  • [0024]
    FIGS. 2A and 2B illustrate how capacitive touch sensor may be utilized to control interpupillary distance (IPD) or stereoscopic convergence in the HMD.
  • [0025]
    FIG. 3 illustrates how a capacitive touch sensor may be used to control volume in a multimedia presentation.
  • [0026]
    FIGS. 4A and 4B illustrate a proximity sensor used to detect when the HMD is moved away from the user's face.
  • [0027]
    FIG. 5 is a high level block diagram of the electronic components within the HMD illustrating how the capacitive sensors are used to control aspects of a multimedia presentation presented to the user on the microdisplays and through audio.
  • [0028]
    FIG. 6 is a more detailed view of an IPD adjust function.
  • [0029]
    FIG. 7 is an alternative type of eyewear device showing other locations for the sensors.
  • [0030]
    FIG. 8 is a still other embodiment where the touch sensors are placed in the front portion of an eyewear device.
  • DETAILED DESCRIPTION OF A PREFERRED EMBODIMENT
  • [0031]
    A description of example embodiments of the invention follows.
  • [0032]
    FIG. 1 is a perspective view of a Head Mounted Display (HMD) 100 that makes use of capacitive touch sensors to implement various functions according to one or more embodiments herein. The HMD apparatus 100 consists of a frame 110 that generally wraps around the back or other portion of a user's head, a strap 120 that generally runs over the top of the user's head, one or more earpieces 125, a left arm 150-L and right arm 150-R, and a bridge portion 170. In the bridge 170 are placed a left microdisplay 160-L and right microdisplay 160-R (not shown in detail in FIG. 1).
  • [0033]
    Of particular interest to the present embodiment is the use of one or more capacitive touch sensors 200, 210, 220.
  • [0034]
    A first capacitive sensor 200 is embodied as a capacitive sensor array placed in the bridge area 170. Sensor array 200 is used for adjusting interpupillary distance (IPD) between the two presented images.
  • [0035]
    A second sensor array 210 is located on the left arm 150-L and is used such as to provide a volume control input.
  • [0036]
    A third sensor 220 is located in a portion of the HMD 100 that located near the user's 105 face when the HMD is being used.
  • [0037]
    Turning attention to FIGS. 2A and 2B the adjustment of IPD is described in more detail. FIG. 2A is a partial view of a portion of the HMD 100 showing the bridge 170. Above the view of the bridge 170 are two rectangles representing the relative viewports presented to the user 105 on the left display 160-L and right display 160-R, respectively. IPD1 is measured as the distance between the centers of the two relative displays, and can be changed by the user providing an adjustment input via touch sensor 200. The user can provide this input such by taking his fingers 200 and making a squeezing or pinch motion. With this type of input, the interpupillary distance can be reduced.
  • [0038]
    FIG. 2B shows the use of a different gesture, such as a spreading or pull type movement of fingers 107 on sensors 200. This is interpreted by the capacitive array 200 as an input requesting an increase in the interpupillary distance to IPD2.
  • [0039]
    FIG. 3 shows one use of capacitive sensors 210 to provide volume control. Here the user takes his finger 107 and slides it along the volume control 210 to indicate an increase or decrease in volume of a multimedia presentation such as a movie, video clip, or audio clip. A finger swipe in one direction may indicate a volume decrease and a finger swipe in the other direction a volume increase. In response to this input, a corresponding adjustment is made to the level of volume in the presentation to the user.
  • [0040]
    Visual feedback can be provided to the user in one of the displays 160-L and/or 160-R, such as by displaying a volume sliding bar 182. The volume bar 182 can be temporarily shown and/or shown only when the user presses their finger 107 against the sensor 210.
  • [0041]
    FIG. 4 shows a possible location for one or more other capacitor sensors 220 that are used as user proximity sensors. These sensors 220 are used to detect whether the arm 150-L (or even some other portion of the HMD 100) as located in close proximity to the user's face 106. Thus, for example, as explained above, when the HMD arms are in the raised position as shown in FIG. 4A, the sensor 220 provides a report that the closest object is at least a distance of d1 away, implying that the HMD device 100 has moved away from the head 106. In this position, the HMD 100 may enter a reduced power or power off mode.
  • [0042]
    When the arms 150 are placed in the lower position (such as shown in FIG. 4B) the sensor 220 reports that the closest object is only a distance of d2 away, and thus that the HMD 100 is now in the active position, proximate to the user's head 106 (and/or eyes). In this position, the HMD 100 may enter a full power on mode.
  • [0043]
    FIG. 5 provides a more detailed view of the electronic components incorporated into the HMD device 100. In this specific example, the HMD 100 connects to host computing devices (not shown) such as to receive a digital video signal over a wired or wireless connection. These components are described in greater detail in a co-pending patent application U.S. application Ser. No. 12/348,627, filed on Jan. 5, 2009, entitled “Method And Apparatus For Transporting Video Signal Over Bluetooth Wireless Interface”, which is incorporated herein by reference.
  • [0044]
    In the preferred embodiment, the HMD 100 uses an Advanced Reduced instruction set computer (RISC) Machine (ARM)/Digital Signal Processor (DSP) 512 (which may be an Open Multimedia Application Platform (OMAP) 3500 series processor, available from Texas Instruments of Dallas, Tex.), memory 514, Bluetooth interface 516 which may be provided by a Class 2 Bluetooth interface available from Cambridge Silicon Radio (CSR) of Cambridge, England), display driver 519 (which may, for example, be an SSD1508 or other suitable display driver available from Kopin Corporation of Westborough, Mass.), video level shifter circuits 520, a power supply 522 supported by a battery 524, universal receiver transmitters (UART) 526 (such as may be used for debugging) and memory 515. A Secure Digital (SD), eXtreme Digital (xD), USB SD (uSD) memory 517 or other similar interfaces may be used to store application programs, kernel directives, or configuration data, and/or connect to devices such as a digital camera. A number of input device 530 may be associated with the device (e.g., switch 1/switch 2/switch 3 and reset inputs), camera 546, Hall effect sensors 547, MIM diodes 548, accelerometers 549, track pads and scroll wheels, and an LED output 532 (led 1). A pair of VGA or better quality microdisplay elements 160-L, 160-R and audio input and output device(s), which may include microphone input 562 and stereo outputs 564, are also provided.
  • [0045]
    A video signal to be displayed to the user may be received over a Bluetooth™ wireless communication link 235 established using Serial Port Profile (SPP), as opposed to using any of the “advanced” Bluetooth modes, which provides greater throughput higher than the higher layer protocols imposed by such advanced modes that have been found not to be needed in this application. In the Bluetooth™ radio 516, a video signal received over the Bluetooth™ connection is sent over the USB connection 518 to the processor 512. One design consideration is to optimize data packet format, given known data buffer sizes. Internal to the Bluetooth™ radio 516 is a packet buffer default size of 1000 bytes. This may be modified to force streaming video signals to use only about a 990 byte buffer size. The processor 512 may expect the received video content to be encoded with the H.264 (Motion Picture Experts Group (MPEG)-4 part 10) formatting, using the so-called baseline profile or better.
  • [0046]
    In a preferred embodiment, the processor 512 may use a multi-tasking embedded operating system. The processor 512 operates on the received video signal as follows. An MPEG format container file (e.g., a .MP4 file) is made available. In one preferred embodiment, this may be a proprietary file format, although the specific details of the input .MP4 file format chosen are not important here, as long as the processor 512 is programmed to correctly process it. The processor 512 then opens a communication port to the host computing device and receives the file over the USB interface 518 from the Bluetooth™ radio 516.
  • [0047]
    An MP4 decoder in the processor 512 strips the file into respective audio and video streams. More particularly, the processor 512 decodes the input file H.264 compressed digital video signal into a YCbCr baseband component video signal. The processor 512 may also divide the associated compressed audio (formatted as an Advanced Audio Coding (AAC) format signal) into baseband stereo audio.
  • [0048]
    The processor 512 may output video in any suitable format such as an 8 bit, International Telecommunication Union Radiocommunication Sector (ITU-R) Recommendation BT. 656 or Society of Motion Picture and Television Engineers (SMPTE) 293M 16 bit YUV progressive scan signals with separate sync signals, to the display driver 519. The decompressed video signal is forwarded over an internal ARM bus of the processor 512. The ARM bus then sends the content directly to the display driver 519 via the SMPTE 293M interface. The Intelligent Interface Controller (I2C) interface 547 is used to configure the microdisplay elements 160. The processor 512 also outputs the baseband audio to the audio output Compression/Decompression Module (CODEC) 560. It may take mono or stereo audio input and produce suitable stereo output signals.
  • [0049]
    Also shown here are the connections of the capacitive sensors 200, 210, 220 to the processor 512. These sensors, as explained above, are used to control a volume for the audio output 564, aspects of the video presentation aspects such as IPD, stereoscopic convergence, or brightness, or control over the operation of the HMD in response to proximity of the user's face. These inputs are then used by the audio circuits 560 and/or display drivers 519 and/or power supply 522 for corresponding control.
  • [0050]
    FIG. 6 is a more detailed view of portions of the OMAP processor 512 and video display driver(s) of FIG. 5. The line buffer 1120 may be implemented as a single buffer, a double buffer, or a pair of FIFOs. The buffer 1120, of whatever design, is often small enough to fit in an FPGA or similar programmable logic device, and may be integrated with other components of the display control logic.
  • [0051]
    In this example embodiment, there are a total of six digital scalers 1130 used (one each for the R, G, B channels for each of the left and right displays), since interpolation of each color channel is preferably done separately from the other channels. Digital scalers 1130 “make up” the difference in horizontal resolution between the higher resolution display and now lower resolution input signal fed to each eye. Digital scalers 1130 can be implemented as a simple repetition of pixels in the horizontal resolution of the input video stream and the two displays 160. In a case where the scale factor is a simple integer reciprocal (such as 2:1), scaling 1130 can be implemented as a simple repetition of pixels. However, in other cases, where the scale factor is not an integer reciprocal, more complicated scaling techniques such as linear interpolation may be used. In either case, scalers 1130 are preferably implemented in the digital domain, such as by the OMAP 512, which may achieve better results than possible with the prior art methods of resampling an analog signal.
  • [0052]
    Some example considerations for the digital scalers 1130 include the following:
      • A standard 2D video stream at 480p resolution is typically encoded with 720 active, “non-square” pixels per horizontal line. For the 3D “side-by-side” input video stream format, there are then 360 pixels available for each eye. The appropriate scaling ratio is slightly greater than in this case (2:1), if the images are cropped for presentation on a pair of wide VGA (WVGA) (864×480) displays. Consider first that some pixels may be omitted from the input stream. For example, SMPTE RP-187 specifies a clean aperture 708 pixels wide, of 720 available. In practice, a 704-pixel aperture is commonly used, which in the side-by-side format results in 352 of 360 pixels being available for each of the left and right input streams. In addition, it is possible that, say, only 854 of the 864 pixels in each output display 150 are available. In that case, the horizontal aspect ratio implemented by scalers 130 aspect ratio might be 854/352 or about 80/33, slightly greater than (2:1).
      • In another implementation, the input video stream is a 720p resolution color video signal with 1280 active square pixels per horizontal line. When 3D “side-by-side” stereo encoding is used with this input video stream, an exact (2:1) scaling ratio is appropriate for driving two 640×720 half input images, to a corresponding pair of 1280×720 displays. In this example, all pixels are available in both the input stream and on the display.
      • Also using the standard 1280×720p format, a horizontal scaling ratio of 4:3 may be used to prepare two half images of (approximate) size 854×720. If vertical scaling by 2:3 is also performed, then the 854×480 output may be displayed on a pair of wide VGA displays.
        • A simple method of vertical scaling is line skipping, which in this case would skip every third line to produce 2 output lines for every three input lines. The resulting image artifacts may be unacceptable in many applications. However, an advantage of line skipping over other methods is that it does not require additional memory.
        • Better scaling results may be obtained by interpolating between successive lines, or by higher-order spatial filtering over multiple lines. In this case the line buffer of FIG. 5 would be expanded to accommodate multiple lines. The same memory may be used for both the horizontal and vertical scaling.
      • The standard 1080p video format has 1920 active square pixels per horizontal line. When a 3D “side-by-side” stereo is used with this type of input signal, a (2:1) scaling ratio is also appropriate for driving the two 960×1080 half images to a pair of 1920×1080 displays.
  • [0059]
    After undergoing any necessary scaling by scalers 1130-L, 1130-R, the output streams pass to the left and right video display drivers 1140-L and 1140-R. Each display driver 1140 typically includes one or more D/A converters and one or more video amplifiers.
  • [0060]
    In an embodiment, the system may implement a 3D viewing mode that can be selectively switched to a 2D mode by changing the scaling factor in the digital scalers 1130. That is, instead of applying interpolation, the same buffer output, without scaling, is sent to each display 160-L, 160-R.
  • Soft IPD and Convergence Adjust
  • [0061]
    In another implementation, the HMD 100 may be adapted to provide soft Inter-Pupilliary Distance (IPD) or convergence adjustments.
  • [0062]
    In particular, it is not uncommon for the available resolution of the physical displays 160 to exceed that of the presented image in the input video stream. For example “wide VGA” displays such as the Kopin CyberDisplay® WVGA mentioned above may have up to 864 active columns, but are often used to display content with horizontal resolutions of only 854, 768, 720, or 640 pixels. In these situations, the drive electronics 100 will typically center the active image horizontally and drive the inactive “side” pixel columns to black. However, by varying the size of the resulting left and right black borders (refer back to FIG. 2), the relative position of the image can be electronically moved horizontally within the active pixel array.
  • [0063]
    Because the HMD provides independent video signals to the two displays, it is possible to control the border sizes on left and right displays independently. For example, moving the left image to the right and the right image to the left would change the stereoscopic convergence and make the image appear closer to the user. In this way, the convergence of the stereoscopic images may be adjusted for optimal viewing via electronic controls, without requiring mechanical adjustments to the display or lens position. Such adjustments may be desirable to accommodate variations in the video source material or in the viewer's Interpupilliary Distance (IPD). This can then affect the 3D depth perceived by the viewer.
  • [0064]
    In such an embodiment, as shown in FIG. 7, IPD adjustment 1145-L, 1145-R can be applied by shifting horizontal line of pixels for the left and right eye with respect to one another. The user may be provided with an input to control the amount of IPD shift via the capacitive touch sensor array 200 as described above.
  • [0065]
    It should be understood that the stereoscopic convergence or IPD adjustment need not depend on a particular scale factor, and indeed can be applied to other 2D or 3D video eyewear systems such as the systems that do not apply scale factors at all. The horizontal shift may be performed before or after scalers 1130-L, 1130-R such as by changing the address from which the digital scalers 1130-L, 1130-R read from the line buffer memory 1120 (as shown in FIG. 6) or by shifting the pixels in each eye after they are output by the scalers 1130-L, 1130-R. As long as such systems produce separate video input streams for the left and right displays, the adjustment technique can be used.
  • [0066]
    It should now be appreciated that the specific physical form of the HMD 100 in FIG. 1 is not a necessary requirement for taking advantage of the novel features described herein. For example, FIG. 7 shows an alternative arrangement where a video eyewear device 2100 uses sensors 2200 and 2220 formed in an upper temple portion and in an arm portion, such as to control IPD and volume only.
  • [0067]
    Likewise, sensors 3200-L and 3200-R may be embedded in a plastic external eyepiece of another type of eyewear device as shown in FIG. 8.
  • [0068]
    Many of the above ideas may also apply to capacitive touch sensors located on other portions of different types of HMDs, such as those that may have an external battery pack. Since the battery pack presents a large surface area it is possible to implement the touch sensors there.
  • [0069]
    The teachings of all patents, published applications and references cited herein are incorporated by reference in their entirety.
  • [0070]
    While this invention has been particularly shown and described with references to example embodiments thereof, it will be understood by those skilled in the art that various changes in form and details may be made therein without departing from the scope of the invention encompassed by the appended claims.

Claims (10)

1. A video eyewear device comprising:
a receiver, disposed in the housing, for receiving an input signal having encoded therein video and audio information representing a multimedia presentation;
a first microdisplay;
a speaker;
a video driver circuit, for receiving the input signal, and providing a video portion of the multimedia presentation to the first microdisplay;
an audio driver circuit, for receiving the input signal, and providing an audio portion of the multimedia presentation to the speaker; and
a capacitive touch sensor, for receiving a user input, and for providing in response thereto a control signal to at least one of the video driver circuit or audio driver circuit, the control signal for controlling an aspect of the multimedia presentation on the video eyewear device.
2. The apparatus of claim 1 wherein the user input is a volume control applied to control a volume level of the audio signal.
3. The apparatus of claim 2 additionally wherein the user input causes a corresponding image of a volume level to appear in the microdisplay.
4. The apparatus of claim 1 wherein the user input is a video control applied to control a brightness or contrast of the multimedia presentation.
5. The apparatus of claim 1 wherein the user input is a power control signal to control power applied to one or more components of the video eyewear device.
6. The apparatus of claim 1 wherein the capacitive touch sensor comprises an array of touch sensors.
7. The apparatus of claim 1 additionally comprising:
a second microdisplay; and
wherein the video driver circuit further provides a video portion of the multimedia presentation to the second microdisplay.
8. The apparatus of claim 7 wherein the user input is applied to adjust a relative offset between video signals presented on the first and second microdisplays.
9. The apparatus of claim 8 wherein a pinch motion input on the capacitive touch sensor is used to reduce the relative offset.
10. The apparatus of claim 8 wherein a spread motion input on the capacitive touch sensor is used to increase the relative offset.
US13022112 2010-02-05 2011-02-07 Touch sensor for controlling eyewear Active 2031-09-10 US8665177B2 (en)

Priority Applications (2)

Application Number Priority Date Filing Date Title
US30186510 true 2010-02-05 2010-02-05
US13022112 US8665177B2 (en) 2010-02-05 2011-02-07 Touch sensor for controlling eyewear

Applications Claiming Priority (1)

Application Number Priority Date Filing Date Title
US13022112 US8665177B2 (en) 2010-02-05 2011-02-07 Touch sensor for controlling eyewear

Publications (2)

Publication Number Publication Date
US20110194029A1 true true US20110194029A1 (en) 2011-08-11
US8665177B2 US8665177B2 (en) 2014-03-04

Family

ID=44353457

Family Applications (1)

Application Number Title Priority Date Filing Date
US13022112 Active 2031-09-10 US8665177B2 (en) 2010-02-05 2011-02-07 Touch sensor for controlling eyewear

Country Status (2)

Country Link
US (1) US8665177B2 (en)
WO (1) WO2011097564A1 (en)

Cited By (90)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US20090209205A1 (en) * 2008-01-04 2009-08-20 Mark Kramer Method and apparatus for transporting video signal over bluetooth wireless interface
US20090251409A1 (en) * 2007-05-14 2009-10-08 Kopin Corporation Mobile wireless display software platform for controlling other systems and devices
US20110231757A1 (en) * 2010-02-28 2011-09-22 Osterhout Group, Inc. Tactile control in an augmented reality eyepiece
US20120200601A1 (en) * 2010-02-28 2012-08-09 Osterhout Group, Inc. Ar glasses with state triggered eye control interaction with advertising facility
US20120274750A1 (en) * 2011-04-26 2012-11-01 Echostar Technologies L.L.C. Apparatus, systems and methods for shared viewing experience using head mounted displays
US20120314034A1 (en) * 2011-06-10 2012-12-13 Eurocopter Piloting assistance system and an aircraft
US20130002545A1 (en) * 2011-06-30 2013-01-03 Google Inc. Wearable computer with curved display and navigation tool
WO2013033170A2 (en) * 2011-08-30 2013-03-07 Lewis John R Adjustment of a mixed reality display for inter-pupillary distance alignment
CN103064187A (en) * 2011-10-24 2013-04-24 索尼公司 Head-mounted display and method of controlling same
CN103076678A (en) * 2011-10-26 2013-05-01 索尼公司 Head mount display and display control method
US8467133B2 (en) 2010-02-28 2013-06-18 Osterhout Group, Inc. See-through display with an optical assembly including a wedge-shaped illumination system
US8472120B2 (en) 2010-02-28 2013-06-25 Osterhout Group, Inc. See-through near-eye display glasses with a small scale image source
US8477425B2 (en) 2010-02-28 2013-07-02 Osterhout Group, Inc. See-through near-eye display glasses including a partially reflective, partially transmitting optical element
US20130169683A1 (en) * 2011-08-30 2013-07-04 Kathryn Stone Perez Head mounted display with iris scan profiling
WO2013098376A1 (en) * 2011-12-30 2013-07-04 Thales Augmented reality mask ensuring good reproducibility and good repeatability of the display of information from the sensors relative to the real environment
US8482859B2 (en) 2010-02-28 2013-07-09 Osterhout Group, Inc. See-through near-eye display glasses wherein image light is transmitted to and reflected from an optically flat film
WO2013103560A1 (en) * 2012-01-04 2013-07-11 Bohn David D Eyebox adjustment for interpupillary distance
US8488246B2 (en) 2010-02-28 2013-07-16 Osterhout Group, Inc. See-through near-eye display glasses including a curved polarizing film in the image source, a partially reflective, partially transmitting optical element and an optically flat film
JP2013150118A (en) * 2012-01-18 2013-08-01 Sony Corp Head-mounted display
US20130229409A1 (en) * 2010-06-08 2013-09-05 Junyong Song Image processing method and image display device according to the method
CN103323950A (en) * 2012-03-22 2013-09-25 精工爱普生株式会社 Head-mounted display device
US20130278886A1 (en) * 2012-04-24 2013-10-24 Gregg Vollet Ear-engaging and eye-covering head assembly
CN103530038A (en) * 2013-10-23 2014-01-22 叶晨光 Program control method and device for head-mounted intelligent terminal
US20140092029A1 (en) * 2012-09-28 2014-04-03 Nokia Corporation Method and apparatus for interacting with a head mounted display
CN103843322A (en) * 2011-10-11 2014-06-04 索尼公司 Head-mounted display and display control method
US20140176609A1 (en) * 2011-08-09 2014-06-26 Pioneer Corporation Mixed reality apparatus
CN103946734A (en) * 2011-09-21 2014-07-23 谷歌公司 Wearable computer with superimposed controls and instructions for external device
US8810600B2 (en) 2012-01-23 2014-08-19 Microsoft Corporation Wearable display device calibration
US8823603B1 (en) * 2013-07-26 2014-09-02 Lg Electronics Inc. Head mounted display and method of controlling therefor
JP2014529098A (en) * 2011-08-18 2014-10-30 グーグル・インク Wearable with the input and output structure equipment
US8917453B2 (en) 2011-12-23 2014-12-23 Microsoft Corporation Reflective array waveguide
US8928558B2 (en) 2011-08-29 2015-01-06 Microsoft Corporation Gaze detection in a see-through, near-eye, mixed reality display
US8947323B1 (en) 2012-03-20 2015-02-03 Hayes Solos Raffle Content display methods
US20150070251A1 (en) * 2013-09-11 2015-03-12 Lg Electronics Inc. Wearable computing device and user interface method
WO2015034617A1 (en) * 2013-09-04 2015-03-12 Qualcomm Incorporated Wearable display device use-based data processing control
JP2015510713A (en) * 2012-01-19 2015-04-09 グーグル・インク Wearable device having an input and output structures
US20150103021A1 (en) * 2013-10-15 2015-04-16 Lg Electronics Inc. Glass type terminal having three-dimensional input device and screen control method thereof
US9064436B1 (en) * 2012-01-06 2015-06-23 Google Inc. Text input on touch sensitive interface
US9091851B2 (en) 2010-02-28 2015-07-28 Microsoft Technology Licensing, Llc Light control in head mounted displays
US9097890B2 (en) 2010-02-28 2015-08-04 Microsoft Technology Licensing, Llc Grating in a light transmissive illumination system for see-through near-eye display glasses
US9097891B2 (en) 2010-02-28 2015-08-04 Microsoft Technology Licensing, Llc See-through near-eye display glasses including an auto-brightness control for the display brightness based on the brightness in the environment
US20150222870A1 (en) * 2012-08-16 2015-08-06 Essilor International (Compagnie Générale d'Optique) Pictures positioning on display elements
US9128281B2 (en) 2010-09-14 2015-09-08 Microsoft Technology Licensing, Llc Eyepiece with uniformly illuminated reflective display
US9129295B2 (en) 2010-02-28 2015-09-08 Microsoft Technology Licensing, Llc See-through near-eye display glasses with a fast response photochromic film system for quick transition from dark to clear
US9134534B2 (en) 2010-02-28 2015-09-15 Microsoft Technology Licensing, Llc See-through near-eye display glasses including a modular image source
US20150269779A1 (en) * 2014-03-20 2015-09-24 Syndiant Inc. Head-Mounted Augumented Reality Display System
US9176325B2 (en) * 2014-02-18 2015-11-03 Merge Labs, Inc. Soft head mounted display goggles for use with mobile computing devices
US9182596B2 (en) 2010-02-28 2015-11-10 Microsoft Technology Licensing, Llc See-through near-eye display glasses with the optical assembly including absorptive polarizers or anti-reflective coatings to reduce stray light
US20150347074A1 (en) * 2014-05-28 2015-12-03 Samsung Electronics Co., Ltd. Methods and devices for processing images
US9213163B2 (en) 2011-08-30 2015-12-15 Microsoft Technology Licensing, Llc Aligning inter-pupillary distance in a near-eye display system
US9223134B2 (en) 2010-02-28 2015-12-29 Microsoft Technology Licensing, Llc Optical imperfections in a light transmissive illumination system for see-through near-eye display glasses
US9223138B2 (en) 2011-12-23 2015-12-29 Microsoft Technology Licensing, Llc Pixel opacity for augmented reality
US9223451B1 (en) * 2013-10-25 2015-12-29 Google Inc. Active capacitive sensing on an HMD
US9229227B2 (en) 2010-02-28 2016-01-05 Microsoft Technology Licensing, Llc See-through near-eye display glasses with a light transmissive wedge shaped illumination system
EP2859399A4 (en) * 2012-06-01 2016-01-06 Esight Corp Apparatus and method for a bioptic real time video system
US9261700B2 (en) 2013-11-20 2016-02-16 Google Inc. Systems and methods for performing multi-touch operations on a head-mountable device
JP2016505939A (en) * 2012-12-03 2016-02-25 クゥアルコム・インコーポレイテッドQualcomm Incorporated Apparatus and method for infrared noncontact gesture system
US20160062457A1 (en) * 2014-09-01 2016-03-03 Seiko Epson Corporation Display device, method of controlling the same, and computer program
US9285589B2 (en) 2010-02-28 2016-03-15 Microsoft Technology Licensing, Llc AR glasses with event and sensor triggered control of AR eyepiece applications
US9297996B2 (en) 2012-02-15 2016-03-29 Microsoft Technology Licensing, Llc Laser illumination scanning
US9298298B2 (en) 2013-12-18 2016-03-29 Microsoft Technology Licensing, Llc Wearable display input system
US9304235B2 (en) 2014-07-30 2016-04-05 Microsoft Technology Licensing, Llc Microfabrication
WO2016056699A1 (en) * 2014-10-07 2016-04-14 주식회사 힘스인터내셔널 Wearable display device
US9316830B1 (en) * 2012-09-28 2016-04-19 Google Inc. User interface
US9341843B2 (en) 2010-02-28 2016-05-17 Microsoft Technology Licensing, Llc See-through near-eye display glasses with a small scale image source
EP3029551A1 (en) * 2014-12-04 2016-06-08 HTC Corporation Virtual reality system and method for controlling operation modes of virtual reality system
US20160163110A1 (en) * 2014-12-04 2016-06-09 Htc Corporation Virtual reality system and method for controlling operation modes of virtual reality system
US9366862B2 (en) 2010-02-28 2016-06-14 Microsoft Technology Licensing, Llc System and method for delivering content to a group of see-through near eye display eyepieces
US9368546B2 (en) 2012-02-15 2016-06-14 Microsoft Technology Licensing, Llc Imaging structure with embedded light sources
US9372347B1 (en) 2015-02-09 2016-06-21 Microsoft Technology Licensing, Llc Display system
WO2016107419A1 (en) * 2014-12-31 2016-07-07 青岛歌尔声学科技有限公司 Adjustable head-mounted display
US9423360B1 (en) 2015-02-09 2016-08-23 Microsoft Technology Licensing, Llc Optical components
US9429692B1 (en) 2015-02-09 2016-08-30 Microsoft Technology Licensing, Llc Optical components
JP2016167844A (en) * 2016-04-21 2016-09-15 ソニー株式会社 Head-mounted display, control method of head-mounted display, and display system and control method of the same
US9513480B2 (en) 2015-02-09 2016-12-06 Microsoft Technology Licensing, Llc Waveguide
US9535253B2 (en) 2015-02-09 2017-01-03 Microsoft Technology Licensing, Llc Display system
US9578318B2 (en) 2012-03-14 2017-02-21 Microsoft Technology Licensing, Llc Imaging structure emitter calibration
US9581820B2 (en) 2012-06-04 2017-02-28 Microsoft Technology Licensing, Llc Multiple waveguide imaging structure
EP3019929A4 (en) * 2013-07-10 2017-03-01 Lg Electronics Inc Head mounted display device including multiple user interface formats and method of controlling therefor
US20170075120A1 (en) * 2015-09-11 2017-03-16 Syndiant Inc. See-Through Near-to-Eye Viewing Optical System
US9606586B2 (en) 2012-01-23 2017-03-28 Microsoft Technology Licensing, Llc Heat transfer device
US9664902B1 (en) * 2014-02-05 2017-05-30 Google Inc. On-head detection for wearable computing device
US9668921B2 (en) 2012-04-24 2017-06-06 Gregg Vollet Ear-engaging and eye-covering head assembly
US9717981B2 (en) 2012-04-05 2017-08-01 Microsoft Technology Licensing, Llc Augmented reality and physical games
US9726887B2 (en) 2012-02-15 2017-08-08 Microsoft Technology Licensing, Llc Imaging structure color conversion
US9759917B2 (en) 2010-02-28 2017-09-12 Microsoft Technology Licensing, Llc AR glasses with event and sensor triggered AR eyepiece interface to external devices
US9779643B2 (en) 2012-02-15 2017-10-03 Microsoft Technology Licensing, Llc Imaging structure emitter configurations
US9827209B2 (en) 2015-02-09 2017-11-28 Microsoft Technology Licensing, Llc Display system
US9857965B1 (en) 2012-01-06 2018-01-02 Google Inc. Resolution of directional ambiguity on touch-based interface gesture
US9875406B2 (en) 2011-03-16 2018-01-23 Microsoft Technology Licensing, Llc Adjustable extension for temple arm

Families Citing this family (6)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US20130176626A1 (en) * 2012-01-05 2013-07-11 Google Inc. Wearable device assembly with input and output structures
US8860634B2 (en) * 2012-10-11 2014-10-14 Sony Computer Entertainment Europe Limited Head mountable display
US9298011B2 (en) * 2013-05-21 2016-03-29 Kopin Corporation Wearable electronic eyewear display
JP2015076628A (en) * 2013-10-04 2015-04-20 ソニー株式会社 Communication device
USD737821S1 (en) * 2014-03-04 2015-09-01 Samsung Electronics Co., Ltd. Electronic device
US9535267B2 (en) 2015-03-15 2017-01-03 iWare LLC Eyewear providing anatomically stabilized control of an associated electronic device

Citations (74)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US3936869A (en) * 1973-11-02 1976-02-03 Zenith Radio Corporation Automatic color level circuit with peak detector
US5129716A (en) * 1987-10-23 1992-07-14 Laszlo Holakovszky Stereoscopic video image display appliance wearable on head like spectacles
US5990793A (en) * 1994-09-02 1999-11-23 Safety Tech Industries, Inc. Firefighters integrated communication and safety system
US6108197A (en) * 1992-05-15 2000-08-22 Via, Inc. Flexible wearable computer
US6124976A (en) * 1998-03-17 2000-09-26 Sony Corporation Voltage controlling method for head mounted display unit and head mounted display apparatus
US6204974B1 (en) * 1996-10-08 2001-03-20 The Microoptical Corporation Compact image display system for eyeglasses or other head-borne frames
US6325507B1 (en) * 2000-06-02 2001-12-04 Oakley, Inc. Eyewear retention system extending across the top of a wearer's head
US20020015008A1 (en) * 2000-07-14 2002-02-07 Ken Kishida Computer system and headset-mounted display device
US6349001B1 (en) * 1997-10-30 2002-02-19 The Microoptical Corporation Eyeglass interface system
US20020094845A1 (en) * 2001-01-16 2002-07-18 Rei Inasaka Body worn display system
US20030068057A1 (en) * 2001-10-06 2003-04-10 Miller Eric C. Information system using eyewear for communication
US20040174605A1 (en) * 2001-07-23 2004-09-09 Ck Management Ab Method and device for image display
US6798391B2 (en) * 2001-01-02 2004-09-28 Xybernaut Corporation Wearable computer system
US6853293B2 (en) * 1993-05-28 2005-02-08 Symbol Technologies, Inc. Wearable communication system
US6900777B1 (en) * 2001-01-03 2005-05-31 Stryker Corporation Infrared audio/video interface for head-mounted display
US6922184B2 (en) * 2001-06-04 2005-07-26 Hewlett-Packard Development Company, L.P. Foot activated user interface
US20050168438A1 (en) * 2001-09-07 2005-08-04 Microsoft Corporation Capacitive sensing and data input device power management
US6956614B1 (en) * 2000-11-22 2005-10-18 Bath Iron Works Apparatus and method for using a wearable computer in collaborative applications
US20050264527A1 (en) * 2002-11-06 2005-12-01 Lin Julius J Audio-visual three-dimensional input/output
US20060007176A1 (en) * 2004-07-06 2006-01-12 Chung-Yi Shen Input method and control module defined with an initial position and moving directions and electronic product thereof
US7004582B2 (en) * 2002-07-26 2006-02-28 Oakley, Inc. Electronically enabled eyewear
US20060132382A1 (en) * 2004-12-22 2006-06-22 Jannard James H Data input management system for wearable electronically enabled interface
US7082393B2 (en) * 2001-03-27 2006-07-25 Rast Associates, Llc Head-worn, trimodal device to increase transcription accuracy in a voice recognition system and to process unvocalized speech
US7150526B2 (en) * 2000-06-02 2006-12-19 Oakley, Inc. Wireless interactive headset
US20070052672A1 (en) * 2005-09-08 2007-03-08 Swisscom Mobile Ag Communication device, system and method
US7249846B2 (en) * 2005-05-03 2007-07-31 Grand Joseph B Eyewear with an image projected off of an unassisted eyewear lens to the user
US7278734B2 (en) * 2000-06-02 2007-10-09 Oakley, Inc. Wireless interactive headset
US7331666B2 (en) * 2001-04-30 2008-02-19 Q.R. Spex, Inc. Eyewear with a mounted radio frequency transceiver
US20080088529A1 (en) * 2006-10-13 2008-04-17 Apple Computer, Inc. Enhanced image display in head-mounted displays
US20080198324A1 (en) * 2007-01-02 2008-08-21 Fuziak Robert J Eyeglasses having integrated telescoping video camera and video display
US7461936B2 (en) * 2000-06-02 2008-12-09 Oakley, Inc. Eyeglasses with detachable adjustable electronics module
US20090128448A1 (en) * 2007-11-15 2009-05-21 Patrick Riechel User Interface for a Head Mounted Display
US20090153389A1 (en) * 2007-12-14 2009-06-18 Apple Inc. Scroll bar with video region in a media system
US20090154719A1 (en) * 2007-12-13 2009-06-18 Thomas Wulff Modular Mobile Computing Headset
US20090174685A1 (en) * 2008-01-03 2009-07-09 Albert Langella System for controlling an audio-video system
US20090180195A1 (en) * 2007-10-25 2009-07-16 University Of Central Florida Research Foundation, Inc. Imaging Systems for Eyeglass-Based Display Devices
US20100020229A1 (en) * 2007-04-30 2010-01-28 General Electric Company Wearable personal video/audio device method and system
US20100033830A1 (en) * 2008-08-11 2010-02-11 Man Fat Yung Wearable image display device
US20100053069A1 (en) * 2008-08-26 2010-03-04 Symbol Technologies, Inc. Mobile computing system facilitating adaptive display of content among a plurality of display components including at least one virtual image display component
US7696657B2 (en) * 2006-05-19 2010-04-13 Pratt & Whitney Canada Corp. Fault monitoring of electric machines
US20100121480A1 (en) * 2008-09-05 2010-05-13 Knapp Systemintegration Gmbh Method and apparatus for visual support of commission acts
US20100149073A1 (en) * 2008-11-02 2010-06-17 David Chaum Near to Eye Display System and Appliance
US7740535B2 (en) * 2004-10-29 2010-06-22 Universal Entertainment Corporation Roulette gaming machine
US7740353B2 (en) * 2006-12-14 2010-06-22 Oakley, Inc. Wearable high resolution audio visual interface
US20100171680A1 (en) * 2007-06-04 2010-07-08 Lumus Ltd. Distributed head-mounted display system
US7753520B2 (en) * 2007-01-02 2010-07-13 Hind-Sight Industries, Inc. Eyeglasses with integrated telescoping video display
US20100188245A1 (en) * 2008-10-02 2010-07-29 Certusview Technologies, Llc Locate apparatus having enhanced features for underground facility locate operations, and associated methods and systems
US20100238184A1 (en) * 2009-03-19 2010-09-23 Michael Janicki Method and apparatus for three-dimensional visualization in mobile devices
US7806525B2 (en) * 2003-10-09 2010-10-05 Ipventure, Inc. Eyeglasses having a camera
US20100271587A1 (en) * 2007-06-07 2010-10-28 Panagiotis Pavlopoulos eyewear comprising at least one display device
US20100277563A1 (en) * 2009-04-29 2010-11-04 Embarq Holdings Company, Llc Video conferencing eyewear
US20100283711A1 (en) * 2009-05-05 2010-11-11 Lsi Corporation An integrated computation and communication system, a framed interface therefor and a method of operating thereof
US20100289817A1 (en) * 2007-09-25 2010-11-18 Metaio Gmbh Method and device for illustrating a virtual object in a real environment
US20110001699A1 (en) * 2009-05-08 2011-01-06 Kopin Corporation Remote control of host application using motion and voice commands
US7918556B2 (en) * 2005-10-07 2011-04-05 Lewis Scott W Digital eyewear
US20110089207A1 (en) * 2009-10-21 2011-04-21 Symbol Technologies, Inc. Mounting device couplable to a human head
US20110090135A1 (en) * 2009-10-21 2011-04-21 Symbol Technologies, Inc. Interchangeable display device for a head-mounted display system
US7966189B2 (en) * 2002-02-28 2011-06-21 Accenture Global Services Limited Wearable computer system and modes of operating the system
US7969383B2 (en) * 2001-01-30 2011-06-28 Metaio Gmbh Interactive data view and command system
US7997723B2 (en) * 2008-12-31 2011-08-16 Nokia Corporation Display apparatus and device
US20110214082A1 (en) * 2010-02-28 2011-09-01 Osterhout Group, Inc. Projection triggering through an external marker in an augmented reality eyepiece
US20110221669A1 (en) * 2010-02-28 2011-09-15 Osterhout Group, Inc. Gesture control in an augmented reality eyepiece
US20110273662A1 (en) * 2010-04-27 2011-11-10 Hoosung Hwang Wearable Electronic Display
US8092011B2 (en) * 2009-03-25 2012-01-10 Olympus Corporation Eyeglass-mounted type image display device
US8098439B2 (en) * 2004-06-17 2012-01-17 Lumus Ltd. High brightness optical device
US20120026071A1 (en) * 2009-02-03 2012-02-02 Laster Portable augmented-reality head-up display device
US8123352B2 (en) * 2009-03-30 2012-02-28 Brother Kogyo Kabushiki Kaisha Head mounted display
US20120056846A1 (en) * 2010-03-01 2012-03-08 Lester F. Ludwig Touch-based user interfaces employing artificial neural networks for hdtp parameter and symbol derivation
US8140197B2 (en) * 2005-02-17 2012-03-20 Lumus Ltd. Personal navigation system
US8144129B2 (en) * 2007-01-05 2012-03-27 Apple Inc. Flexible touch sensing circuits
US20120088245A1 (en) * 2008-10-31 2012-04-12 Cedars-Sinai Medical Center Methods of diagnosing insulin resistance and sensitivity
US20120105740A1 (en) * 2000-06-02 2012-05-03 Oakley, Inc. Eyewear with detachable adjustable electronics module
US20120114131A1 (en) * 2010-11-08 2012-05-10 Symbol Technologies, Inc. User configurable headset
US8212859B2 (en) * 2006-10-13 2012-07-03 Apple Inc. Peripheral treatment for head-mounted displays

Family Cites Families (5)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
JPH08510568A (en) 1994-03-04 1996-11-05 モトローラ・インコーポレイテッド Information display device
WO2000079327A1 (en) 1999-06-21 2000-12-28 The Microoptical Corporation Eyeglass display lens system employing off-axis optical design
EP2494388A1 (en) 2009-10-27 2012-09-05 Popovich, Milan Momcilo Compact holographic edge illuminated eyeglass display
EP2619749A4 (en) 2010-09-21 2017-11-15 4Iiii Innovations Inc Head-mounted peripheral vision display systems and methods
US20120188245A1 (en) 2011-01-20 2012-07-26 Apple Inc. Display resolution increase with mechanical actuation

Patent Citations (97)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US3936869A (en) * 1973-11-02 1976-02-03 Zenith Radio Corporation Automatic color level circuit with peak detector
US5129716A (en) * 1987-10-23 1992-07-14 Laszlo Holakovszky Stereoscopic video image display appliance wearable on head like spectacles
US6108197A (en) * 1992-05-15 2000-08-22 Via, Inc. Flexible wearable computer
US6853293B2 (en) * 1993-05-28 2005-02-08 Symbol Technologies, Inc. Wearable communication system
US5990793A (en) * 1994-09-02 1999-11-23 Safety Tech Industries, Inc. Firefighters integrated communication and safety system
US6204974B1 (en) * 1996-10-08 2001-03-20 The Microoptical Corporation Compact image display system for eyeglasses or other head-borne frames
US6349001B1 (en) * 1997-10-30 2002-02-19 The Microoptical Corporation Eyeglass interface system
US6124976A (en) * 1998-03-17 2000-09-26 Sony Corporation Voltage controlling method for head mounted display unit and head mounted display apparatus
US7150526B2 (en) * 2000-06-02 2006-12-19 Oakley, Inc. Wireless interactive headset
US20120105740A1 (en) * 2000-06-02 2012-05-03 Oakley, Inc. Eyewear with detachable adjustable electronics module
US20110255050A1 (en) * 2000-06-02 2011-10-20 Oakley, Inc. Telecommunications enabled eyeglass
US8020989B2 (en) * 2000-06-02 2011-09-20 Oakley, Inc. Wireless interactive headset
US7278734B2 (en) * 2000-06-02 2007-10-09 Oakley, Inc. Wireless interactive headset
US6325507B1 (en) * 2000-06-02 2001-12-04 Oakley, Inc. Eyewear retention system extending across the top of a wearer's head
US7988283B2 (en) * 2000-06-02 2011-08-02 Oakley, Inc. Eyeglasses with detachable adjustable electronics module
US7967433B2 (en) * 2000-06-02 2011-06-28 Oakley, Inc. Electronically enabled audio device
US7744213B2 (en) * 2000-06-02 2010-06-29 Oakley, Inc. Telecommunications enabled eyeglass
US7452073B2 (en) * 2000-06-02 2008-11-18 Oakley, Inc. Telecommunications enabled eyeglass
US6966647B2 (en) * 2000-06-02 2005-11-22 Oakley, Inc. Telecommunications enabled eyeglass
US7682018B2 (en) * 2000-06-02 2010-03-23 Oakley, Inc. Eyeglasses with detachable adjustable electronics module
US7461936B2 (en) * 2000-06-02 2008-12-09 Oakley, Inc. Eyeglasses with detachable adjustable electronics module
US7219994B2 (en) * 2000-06-02 2007-05-22 Oakley, Inc. Eyeglass with MP3 player
US20020015008A1 (en) * 2000-07-14 2002-02-07 Ken Kishida Computer system and headset-mounted display device
US6956614B1 (en) * 2000-11-22 2005-10-18 Bath Iron Works Apparatus and method for using a wearable computer in collaborative applications
US6798391B2 (en) * 2001-01-02 2004-09-28 Xybernaut Corporation Wearable computer system
US6900777B1 (en) * 2001-01-03 2005-05-31 Stryker Corporation Infrared audio/video interface for head-mounted display
US20020094845A1 (en) * 2001-01-16 2002-07-18 Rei Inasaka Body worn display system
US20110254698A1 (en) * 2001-01-30 2011-10-20 Metaio Gmbh Interactive Data View and Command System
US7969383B2 (en) * 2001-01-30 2011-06-28 Metaio Gmbh Interactive data view and command system
US7082393B2 (en) * 2001-03-27 2006-07-25 Rast Associates, Llc Head-worn, trimodal device to increase transcription accuracy in a voice recognition system and to process unvocalized speech
US7331666B2 (en) * 2001-04-30 2008-02-19 Q.R. Spex, Inc. Eyewear with a mounted radio frequency transceiver
US6922184B2 (en) * 2001-06-04 2005-07-26 Hewlett-Packard Development Company, L.P. Foot activated user interface
US20040174605A1 (en) * 2001-07-23 2004-09-09 Ck Management Ab Method and device for image display
US20050168438A1 (en) * 2001-09-07 2005-08-04 Microsoft Corporation Capacitive sensing and data input device power management
US20030068057A1 (en) * 2001-10-06 2003-04-10 Miller Eric C. Information system using eyewear for communication
US7966189B2 (en) * 2002-02-28 2011-06-21 Accenture Global Services Limited Wearable computer system and modes of operating the system
US7004582B2 (en) * 2002-07-26 2006-02-28 Oakley, Inc. Electronically enabled eyewear
US7445332B2 (en) * 2002-07-26 2008-11-04 Oakley, Inc. Wireless interactive headset
US7494216B2 (en) * 2002-07-26 2009-02-24 Oakely, Inc. Electronic eyewear with hands-free operation
US7512414B2 (en) * 2002-07-26 2009-03-31 Oakley, Inc. Wireless interactive headset
US7147324B2 (en) * 2002-07-26 2006-12-12 Oakley, Inc. Speaker mounts for eyeglass with MP3 player
US7216973B2 (en) * 2002-07-26 2007-05-15 Oakley, Inc. Eyeglass with MP3 player
US7213917B2 (en) * 2002-07-26 2007-05-08 Oakley, Inc. Electronically enabled eyewear
US20050264527A1 (en) * 2002-11-06 2005-12-01 Lin Julius J Audio-visual three-dimensional input/output
US7806525B2 (en) * 2003-10-09 2010-10-05 Ipventure, Inc. Eyeglasses having a camera
US8098439B2 (en) * 2004-06-17 2012-01-17 Lumus Ltd. High brightness optical device
US20060007176A1 (en) * 2004-07-06 2006-01-12 Chung-Yi Shen Input method and control module defined with an initial position and moving directions and electronic product thereof
US7740535B2 (en) * 2004-10-29 2010-06-22 Universal Entertainment Corporation Roulette gaming machine
US20060132382A1 (en) * 2004-12-22 2006-06-22 Jannard James H Data input management system for wearable electronically enabled interface
US8140197B2 (en) * 2005-02-17 2012-03-20 Lumus Ltd. Personal navigation system
US7249846B2 (en) * 2005-05-03 2007-07-31 Grand Joseph B Eyewear with an image projected off of an unassisted eyewear lens to the user
US20070052672A1 (en) * 2005-09-08 2007-03-08 Swisscom Mobile Ag Communication device, system and method
US7918556B2 (en) * 2005-10-07 2011-04-05 Lewis Scott W Digital eyewear
US7696657B2 (en) * 2006-05-19 2010-04-13 Pratt & Whitney Canada Corp. Fault monitoring of electric machines
US8212859B2 (en) * 2006-10-13 2012-07-03 Apple Inc. Peripheral treatment for head-mounted displays
US20080088529A1 (en) * 2006-10-13 2008-04-17 Apple Computer, Inc. Enhanced image display in head-mounted displays
US7740353B2 (en) * 2006-12-14 2010-06-22 Oakley, Inc. Wearable high resolution audio visual interface
US8025398B2 (en) * 2006-12-14 2011-09-27 Oakley, Inc. Wearable high resolution audio visual interface
US20120013843A1 (en) * 2006-12-14 2012-01-19 Oakley, Inc. Wearable high resolution audio visual interface
US7753520B2 (en) * 2007-01-02 2010-07-13 Hind-Sight Industries, Inc. Eyeglasses with integrated telescoping video display
US20080198324A1 (en) * 2007-01-02 2008-08-21 Fuziak Robert J Eyeglasses having integrated telescoping video camera and video display
US8144129B2 (en) * 2007-01-05 2012-03-27 Apple Inc. Flexible touch sensing circuits
US20100020229A1 (en) * 2007-04-30 2010-01-28 General Electric Company Wearable personal video/audio device method and system
US20100171680A1 (en) * 2007-06-04 2010-07-08 Lumus Ltd. Distributed head-mounted display system
US20100271587A1 (en) * 2007-06-07 2010-10-28 Panagiotis Pavlopoulos eyewear comprising at least one display device
US20100289817A1 (en) * 2007-09-25 2010-11-18 Metaio Gmbh Method and device for illustrating a virtual object in a real environment
US20090180195A1 (en) * 2007-10-25 2009-07-16 University Of Central Florida Research Foundation, Inc. Imaging Systems for Eyeglass-Based Display Devices
US20090128448A1 (en) * 2007-11-15 2009-05-21 Patrick Riechel User Interface for a Head Mounted Display
US8072393B2 (en) * 2007-11-15 2011-12-06 Symbol Technologies, Inc. User interface for a head mounted display
US20090154719A1 (en) * 2007-12-13 2009-06-18 Thomas Wulff Modular Mobile Computing Headset
US20090153389A1 (en) * 2007-12-14 2009-06-18 Apple Inc. Scroll bar with video region in a media system
US20090174685A1 (en) * 2008-01-03 2009-07-09 Albert Langella System for controlling an audio-video system
US20100033830A1 (en) * 2008-08-11 2010-02-11 Man Fat Yung Wearable image display device
US20100053069A1 (en) * 2008-08-26 2010-03-04 Symbol Technologies, Inc. Mobile computing system facilitating adaptive display of content among a plurality of display components including at least one virtual image display component
US20100121480A1 (en) * 2008-09-05 2010-05-13 Knapp Systemintegration Gmbh Method and apparatus for visual support of commission acts
US20100188245A1 (en) * 2008-10-02 2010-07-29 Certusview Technologies, Llc Locate apparatus having enhanced features for underground facility locate operations, and associated methods and systems
US20120088245A1 (en) * 2008-10-31 2012-04-12 Cedars-Sinai Medical Center Methods of diagnosing insulin resistance and sensitivity
US20100149073A1 (en) * 2008-11-02 2010-06-17 David Chaum Near to Eye Display System and Appliance
US7997723B2 (en) * 2008-12-31 2011-08-16 Nokia Corporation Display apparatus and device
US20120026071A1 (en) * 2009-02-03 2012-02-02 Laster Portable augmented-reality head-up display device
US20100238184A1 (en) * 2009-03-19 2010-09-23 Michael Janicki Method and apparatus for three-dimensional visualization in mobile devices
US8092011B2 (en) * 2009-03-25 2012-01-10 Olympus Corporation Eyeglass-mounted type image display device
US8123352B2 (en) * 2009-03-30 2012-02-28 Brother Kogyo Kabushiki Kaisha Head mounted display
US20100277563A1 (en) * 2009-04-29 2010-11-04 Embarq Holdings Company, Llc Video conferencing eyewear
US20100283711A1 (en) * 2009-05-05 2010-11-11 Lsi Corporation An integrated computation and communication system, a framed interface therefor and a method of operating thereof
US20110001699A1 (en) * 2009-05-08 2011-01-06 Kopin Corporation Remote control of host application using motion and voice commands
US20110089207A1 (en) * 2009-10-21 2011-04-21 Symbol Technologies, Inc. Mounting device couplable to a human head
US20110090135A1 (en) * 2009-10-21 2011-04-21 Symbol Technologies, Inc. Interchangeable display device for a head-mounted display system
US20110221671A1 (en) * 2010-02-28 2011-09-15 Osterhout Group, Inc. Method and apparatus for audio biometric data capture
US20120062445A1 (en) * 2010-02-28 2012-03-15 Osterhout Group, Inc. Adjustable wrap around extendable arm for a head-mounted display
US20110214082A1 (en) * 2010-02-28 2011-09-01 Osterhout Group, Inc. Projection triggering through an external marker in an augmented reality eyepiece
US20110227813A1 (en) * 2010-02-28 2011-09-22 Osterhout Group, Inc. Augmented reality eyepiece with secondary attached optic for surroundings environment vision correction
US20110227812A1 (en) * 2010-02-28 2011-09-22 Osterhout Group, Inc. Head nod detection and control in an augmented reality eyepiece
US20110221669A1 (en) * 2010-02-28 2011-09-15 Osterhout Group, Inc. Gesture control in an augmented reality eyepiece
US20120056846A1 (en) * 2010-03-01 2012-03-08 Lester F. Ludwig Touch-based user interfaces employing artificial neural networks for hdtp parameter and symbol derivation
US20110273662A1 (en) * 2010-04-27 2011-11-10 Hoosung Hwang Wearable Electronic Display
US20120114131A1 (en) * 2010-11-08 2012-05-10 Symbol Technologies, Inc. User configurable headset

Cited By (133)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US20090251409A1 (en) * 2007-05-14 2009-10-08 Kopin Corporation Mobile wireless display software platform for controlling other systems and devices
US8909296B2 (en) 2007-05-14 2014-12-09 Kopin Corporation Mobile wireless display software platform for controlling other systems and devices
US8355671B2 (en) * 2008-01-04 2013-01-15 Kopin Corporation Method and apparatus for transporting video signal over Bluetooth wireless interface
US20090209205A1 (en) * 2008-01-04 2009-08-20 Mark Kramer Method and apparatus for transporting video signal over bluetooth wireless interface
US9223134B2 (en) 2010-02-28 2015-12-29 Microsoft Technology Licensing, Llc Optical imperfections in a light transmissive illumination system for see-through near-eye display glasses
US8472120B2 (en) 2010-02-28 2013-06-25 Osterhout Group, Inc. See-through near-eye display glasses with a small scale image source
US9091851B2 (en) 2010-02-28 2015-07-28 Microsoft Technology Licensing, Llc Light control in head mounted displays
US9182596B2 (en) 2010-02-28 2015-11-10 Microsoft Technology Licensing, Llc See-through near-eye display glasses with the optical assembly including absorptive polarizers or anti-reflective coatings to reduce stray light
US9097890B2 (en) 2010-02-28 2015-08-04 Microsoft Technology Licensing, Llc Grating in a light transmissive illumination system for see-through near-eye display glasses
US9759917B2 (en) 2010-02-28 2017-09-12 Microsoft Technology Licensing, Llc AR glasses with event and sensor triggered AR eyepiece interface to external devices
US9097891B2 (en) 2010-02-28 2015-08-04 Microsoft Technology Licensing, Llc See-through near-eye display glasses including an auto-brightness control for the display brightness based on the brightness in the environment
US8814691B2 (en) 2010-02-28 2014-08-26 Microsoft Corporation System and method for social networking gaming with an augmented reality
US9229227B2 (en) 2010-02-28 2016-01-05 Microsoft Technology Licensing, Llc See-through near-eye display glasses with a light transmissive wedge shaped illumination system
US9366862B2 (en) 2010-02-28 2016-06-14 Microsoft Technology Licensing, Llc System and method for delivering content to a group of see-through near eye display eyepieces
US20120200601A1 (en) * 2010-02-28 2012-08-09 Osterhout Group, Inc. Ar glasses with state triggered eye control interaction with advertising facility
US8467133B2 (en) 2010-02-28 2013-06-18 Osterhout Group, Inc. See-through display with an optical assembly including a wedge-shaped illumination system
US20110231757A1 (en) * 2010-02-28 2011-09-22 Osterhout Group, Inc. Tactile control in an augmented reality eyepiece
US8477425B2 (en) 2010-02-28 2013-07-02 Osterhout Group, Inc. See-through near-eye display glasses including a partially reflective, partially transmitting optical element
US8488246B2 (en) 2010-02-28 2013-07-16 Osterhout Group, Inc. See-through near-eye display glasses including a curved polarizing film in the image source, a partially reflective, partially transmitting optical element and an optically flat film
US9341843B2 (en) 2010-02-28 2016-05-17 Microsoft Technology Licensing, Llc See-through near-eye display glasses with a small scale image source
US9329689B2 (en) 2010-02-28 2016-05-03 Microsoft Technology Licensing, Llc Method and apparatus for biometric data capture
US8482859B2 (en) 2010-02-28 2013-07-09 Osterhout Group, Inc. See-through near-eye display glasses wherein image light is transmitted to and reflected from an optically flat film
US9285589B2 (en) 2010-02-28 2016-03-15 Microsoft Technology Licensing, Llc AR glasses with event and sensor triggered control of AR eyepiece applications
US9134534B2 (en) 2010-02-28 2015-09-15 Microsoft Technology Licensing, Llc See-through near-eye display glasses including a modular image source
US9129295B2 (en) 2010-02-28 2015-09-08 Microsoft Technology Licensing, Llc See-through near-eye display glasses with a fast response photochromic film system for quick transition from dark to clear
US20130229409A1 (en) * 2010-06-08 2013-09-05 Junyong Song Image processing method and image display device according to the method
US9128281B2 (en) 2010-09-14 2015-09-08 Microsoft Technology Licensing, Llc Eyepiece with uniformly illuminated reflective display
US9875406B2 (en) 2011-03-16 2018-01-23 Microsoft Technology Licensing, Llc Adjustable extension for temple arm
US8836771B2 (en) * 2011-04-26 2014-09-16 Echostar Technologies L.L.C. Apparatus, systems and methods for shared viewing experience using head mounted displays
US9602859B2 (en) * 2011-04-26 2017-03-21 Echostar Technologies L.L.C. Apparatus, systems and methods for shared viewing experience using head mounted displays
US9253509B2 (en) * 2011-04-26 2016-02-02 Echostar Technologies L.L.C. Apparatus, systems and methods for shared viewing experience using head mounted displays
US20120274750A1 (en) * 2011-04-26 2012-11-01 Echostar Technologies L.L.C. Apparatus, systems and methods for shared viewing experience using head mounted displays
US20160150267A1 (en) * 2011-04-26 2016-05-26 Echostar Technologies L.L.C. Apparatus, systems and methods for shared viewing experience using head mounted displays
US20150007225A1 (en) * 2011-04-26 2015-01-01 Echostar Technologies L.L.C. Apparatus, systems and methods for shared viewing experience using head mounted displays
US9244649B2 (en) * 2011-06-10 2016-01-26 Airbus Helicopters Piloting assistance system and an aircraft
US20120314034A1 (en) * 2011-06-10 2012-12-13 Eurocopter Piloting assistance system and an aircraft
US20130002545A1 (en) * 2011-06-30 2013-01-03 Google Inc. Wearable computer with curved display and navigation tool
US9024843B2 (en) * 2011-06-30 2015-05-05 Google Inc. Wearable computer with curved display and navigation tool
US20140176609A1 (en) * 2011-08-09 2014-06-26 Pioneer Corporation Mixed reality apparatus
JP2014529098A (en) * 2011-08-18 2014-10-30 グーグル・インク Wearable with the input and output structure equipment
US9110504B2 (en) 2011-08-29 2015-08-18 Microsoft Technology Licensing, Llc Gaze detection in a see-through, near-eye, mixed reality display
US8928558B2 (en) 2011-08-29 2015-01-06 Microsoft Corporation Gaze detection in a see-through, near-eye, mixed reality display
WO2013033170A3 (en) * 2011-08-30 2013-05-02 Lewis John R Adjustment of a mixed reality display for inter-pupillary distance alignment
US9025252B2 (en) 2011-08-30 2015-05-05 Microsoft Technology Licensing, Llc Adjustment of a mixed reality display for inter-pupillary distance alignment
WO2013033170A2 (en) * 2011-08-30 2013-03-07 Lewis John R Adjustment of a mixed reality display for inter-pupillary distance alignment
US9213163B2 (en) 2011-08-30 2015-12-15 Microsoft Technology Licensing, Llc Aligning inter-pupillary distance in a near-eye display system
US20130169683A1 (en) * 2011-08-30 2013-07-04 Kathryn Stone Perez Head mounted display with iris scan profiling
US9202443B2 (en) * 2011-08-30 2015-12-01 Microsoft Technology Licensing, Llc Improving display performance with iris scan profiling
CN103946734A (en) * 2011-09-21 2014-07-23 谷歌公司 Wearable computer with superimposed controls and instructions for external device
US9678654B2 (en) 2011-09-21 2017-06-13 Google Inc. Wearable computer with superimposed controls and instructions for external device
CN103843322A (en) * 2011-10-11 2014-06-04 索尼公司 Head-mounted display and display control method
EP2768218A4 (en) * 2011-10-11 2015-05-27 Sony Corp Head-mounted display and display control method
US9197840B2 (en) * 2011-10-24 2015-11-24 Sony Corporation Head mount display and method for controlling head mount display
CN103064187A (en) * 2011-10-24 2013-04-24 索尼公司 Head-mounted display and method of controlling same
JP2013093663A (en) * 2011-10-24 2013-05-16 Sony Corp Head-mounted display and head-mounted display control method
US9341847B2 (en) 2011-10-26 2016-05-17 Sony Corporation Head mount display and display control method
EP2587300A1 (en) * 2011-10-26 2013-05-01 Sony Corporation Head mount display and display control method
CN103076678A (en) * 2011-10-26 2013-05-01 索尼公司 Head mount display and display control method
US9495029B2 (en) 2011-10-26 2016-11-15 Sony Corporation Head mount display and display control method
JP2013093768A (en) * 2011-10-26 2013-05-16 Sony Corp Head-mounted display and display control method
US8917453B2 (en) 2011-12-23 2014-12-23 Microsoft Corporation Reflective array waveguide
US9223138B2 (en) 2011-12-23 2015-12-29 Microsoft Technology Licensing, Llc Pixel opacity for augmented reality
FR2985321A1 (en) * 2011-12-30 2013-07-05 Thales Sa Mask augmented reality providing good reproducibility and good repeatability visualization of sensor information with respect to the real environment
WO2013098376A1 (en) * 2011-12-30 2013-07-04 Thales Augmented reality mask ensuring good reproducibility and good repeatability of the display of information from the sensors relative to the real environment
US9298012B2 (en) 2012-01-04 2016-03-29 Microsoft Technology Licensing, Llc Eyebox adjustment for interpupillary distance
US8638498B2 (en) 2012-01-04 2014-01-28 David D. Bohn Eyebox adjustment for interpupillary distance
WO2013103560A1 (en) * 2012-01-04 2013-07-11 Bohn David D Eyebox adjustment for interpupillary distance
US9064436B1 (en) * 2012-01-06 2015-06-23 Google Inc. Text input on touch sensitive interface
US9857965B1 (en) 2012-01-06 2018-01-02 Google Inc. Resolution of directional ambiguity on touch-based interface gesture
JP2013150118A (en) * 2012-01-18 2013-08-01 Sony Corp Head-mounted display
JP2015510713A (en) * 2012-01-19 2015-04-09 グーグル・インク Wearable device having an input and output structures
US8810600B2 (en) 2012-01-23 2014-08-19 Microsoft Corporation Wearable display device calibration
US9606586B2 (en) 2012-01-23 2017-03-28 Microsoft Technology Licensing, Llc Heat transfer device
US9368546B2 (en) 2012-02-15 2016-06-14 Microsoft Technology Licensing, Llc Imaging structure with embedded light sources
US9779643B2 (en) 2012-02-15 2017-10-03 Microsoft Technology Licensing, Llc Imaging structure emitter configurations
US9684174B2 (en) 2012-02-15 2017-06-20 Microsoft Technology Licensing, Llc Imaging structure with embedded light sources
US9297996B2 (en) 2012-02-15 2016-03-29 Microsoft Technology Licensing, Llc Laser illumination scanning
US9726887B2 (en) 2012-02-15 2017-08-08 Microsoft Technology Licensing, Llc Imaging structure color conversion
US9578318B2 (en) 2012-03-14 2017-02-21 Microsoft Technology Licensing, Llc Imaging structure emitter calibration
US9807381B2 (en) 2012-03-14 2017-10-31 Microsoft Technology Licensing, Llc Imaging structure emitter calibration
US8947323B1 (en) 2012-03-20 2015-02-03 Hayes Solos Raffle Content display methods
CN103323950A (en) * 2012-03-22 2013-09-25 精工爱普生株式会社 Head-mounted display device
US9717981B2 (en) 2012-04-05 2017-08-01 Microsoft Technology Licensing, Llc Augmented reality and physical games
US9668921B2 (en) 2012-04-24 2017-06-06 Gregg Vollet Ear-engaging and eye-covering head assembly
US20130278886A1 (en) * 2012-04-24 2013-10-24 Gregg Vollet Ear-engaging and eye-covering head assembly
EP2859399A4 (en) * 2012-06-01 2016-01-06 Esight Corp Apparatus and method for a bioptic real time video system
US9581820B2 (en) 2012-06-04 2017-02-28 Microsoft Technology Licensing, Llc Multiple waveguide imaging structure
US20150222870A1 (en) * 2012-08-16 2015-08-06 Essilor International (Compagnie Générale d'Optique) Pictures positioning on display elements
US9661297B2 (en) * 2012-08-16 2017-05-23 Essilor International (Compagnie Générale d'Optique) Pictures positioning on display elements
US9582081B1 (en) 2012-09-28 2017-02-28 Google Inc. User interface
US9316830B1 (en) * 2012-09-28 2016-04-19 Google Inc. User interface
US20140092029A1 (en) * 2012-09-28 2014-04-03 Nokia Corporation Method and apparatus for interacting with a head mounted display
JP2016505939A (en) * 2012-12-03 2016-02-25 クゥアルコム・インコーポレイテッドQualcomm Incorporated Apparatus and method for infrared noncontact gesture system
EP3019929A4 (en) * 2013-07-10 2017-03-01 Lg Electronics Inc Head mounted display device including multiple user interface formats and method of controlling therefor
CN105745566A (en) * 2013-07-26 2016-07-06 微软技术许可有限责任公司 Head mounted display and method of controlling therefor
US8823603B1 (en) * 2013-07-26 2014-09-02 Lg Electronics Inc. Head mounted display and method of controlling therefor
US9772494B2 (en) 2013-09-04 2017-09-26 Qualcomm Incorporated Wearable display device use-based data processing control
WO2015034617A1 (en) * 2013-09-04 2015-03-12 Qualcomm Incorporated Wearable display device use-based data processing control
US9183612B2 (en) 2013-09-04 2015-11-10 Qualcomm Incorporated Wearable display device use-based data processing control
US20150070251A1 (en) * 2013-09-11 2015-03-12 Lg Electronics Inc. Wearable computing device and user interface method
US9471101B2 (en) * 2013-09-11 2016-10-18 Lg Electronics Inc. Wearable computing device and user interface method
WO2015037804A1 (en) * 2013-09-11 2015-03-19 Lg Electronics Inc. Wearable computing device and user interface method
US9658452B2 (en) * 2013-10-15 2017-05-23 Lg Electronics Inc. Glass type terminal having three-dimensional input device and screen control method thereof
US20150103021A1 (en) * 2013-10-15 2015-04-16 Lg Electronics Inc. Glass type terminal having three-dimensional input device and screen control method thereof
CN103530038A (en) * 2013-10-23 2014-01-22 叶晨光 Program control method and device for head-mounted intelligent terminal
US9223451B1 (en) * 2013-10-25 2015-12-29 Google Inc. Active capacitive sensing on an HMD
US9804682B2 (en) 2013-11-20 2017-10-31 Google Inc. Systems and methods for performing multi-touch operations on a head-mountable device
US9261700B2 (en) 2013-11-20 2016-02-16 Google Inc. Systems and methods for performing multi-touch operations on a head-mountable device
US9298298B2 (en) 2013-12-18 2016-03-29 Microsoft Technology Licensing, Llc Wearable display input system
US9664902B1 (en) * 2014-02-05 2017-05-30 Google Inc. On-head detection for wearable computing device
US9599824B2 (en) 2014-02-18 2017-03-21 Merge Labs, Inc. Soft head mounted display goggles for use with mobile computing devices
US9176325B2 (en) * 2014-02-18 2015-11-03 Merge Labs, Inc. Soft head mounted display goggles for use with mobile computing devices
US9696553B2 (en) 2014-02-18 2017-07-04 Merge Labs, Inc. Soft head mounted display goggles for use with mobile computing devices
US9377626B2 (en) * 2014-02-18 2016-06-28 Merge Labs, Inc. Remote control augmented motion data capture
US9274340B2 (en) * 2014-02-18 2016-03-01 Merge Labs, Inc. Soft head mounted display goggles for use with mobile computing devices
US20150269779A1 (en) * 2014-03-20 2015-09-24 Syndiant Inc. Head-Mounted Augumented Reality Display System
US9830120B2 (en) * 2014-05-28 2017-11-28 Samsung Electronics Co., Ltd. Methods and devices for processing images
US20150347074A1 (en) * 2014-05-28 2015-12-03 Samsung Electronics Co., Ltd. Methods and devices for processing images
US9304235B2 (en) 2014-07-30 2016-04-05 Microsoft Technology Licensing, Llc Microfabrication
US9836120B2 (en) * 2014-09-01 2017-12-05 Seiko Epson Corporation Display device, method of controlling the same, and computer program
US20160062457A1 (en) * 2014-09-01 2016-03-03 Seiko Epson Corporation Display device, method of controlling the same, and computer program
WO2016056699A1 (en) * 2014-10-07 2016-04-14 주식회사 힘스인터내셔널 Wearable display device
EP3029551A1 (en) * 2014-12-04 2016-06-08 HTC Corporation Virtual reality system and method for controlling operation modes of virtual reality system
US20160163110A1 (en) * 2014-12-04 2016-06-09 Htc Corporation Virtual reality system and method for controlling operation modes of virtual reality system
WO2016107419A1 (en) * 2014-12-31 2016-07-07 青岛歌尔声学科技有限公司 Adjustable head-mounted display
US9535253B2 (en) 2015-02-09 2017-01-03 Microsoft Technology Licensing, Llc Display system
US9372347B1 (en) 2015-02-09 2016-06-21 Microsoft Technology Licensing, Llc Display system
US9429692B1 (en) 2015-02-09 2016-08-30 Microsoft Technology Licensing, Llc Optical components
US9827209B2 (en) 2015-02-09 2017-11-28 Microsoft Technology Licensing, Llc Display system
US9513480B2 (en) 2015-02-09 2016-12-06 Microsoft Technology Licensing, Llc Waveguide
US9423360B1 (en) 2015-02-09 2016-08-23 Microsoft Technology Licensing, Llc Optical components
US20170075120A1 (en) * 2015-09-11 2017-03-16 Syndiant Inc. See-Through Near-to-Eye Viewing Optical System
JP2016167844A (en) * 2016-04-21 2016-09-15 ソニー株式会社 Head-mounted display, control method of head-mounted display, and display system and control method of the same

Also Published As

Publication number Publication date Type
US8665177B2 (en) 2014-03-04 grant
WO2011097564A1 (en) 2011-08-11 application

Similar Documents

Publication Publication Date Title
US20120033048A1 (en) 3d image display apparatus, 3d image playback apparatus, and 3d image viewing system
US20080278894A1 (en) Docking station for projection display applications
US20010026263A1 (en) Input unit and capturing apparatus using the same
US20070024736A1 (en) Electronic camera for capturing image as digital data
US20150022542A1 (en) Transmissive display device and method of controlling transmissive display device
US5808588A (en) Shutter synchronization circuit for stereoscopic systems
US20060140621A1 (en) Imaging apparatus with display and image display apparatus
US7123215B2 (en) Glasses type display and controlling method thereof
US20040130576A1 (en) Touchscreen display device
US20110273540A1 (en) Method for operating an image display apparatus and an image display apparatus
US20060019614A1 (en) Mobile information apparatus
US20100103318A1 (en) Picture-in-picture display apparatus having stereoscopic display functionality and picture-in-picture display method
US20120249587A1 (en) Keyboard avatar for heads up display (hud)
JP2004280496A (en) Operation panel device
US20090153671A1 (en) Image display apparatus having pointing function and method thereof
US20090303373A1 (en) Image processing apparatus and image processing method
CN101697556A (en) Double main screen handheld device
KR20110101944A (en) 3-dimension glasses, method for driving 3-dimension glass and system for providing 3d image
US20110316847A1 (en) Display Apparatus and Associated Glasses
US20110283314A1 (en) Configurable computer system
US20130182062A1 (en) Apparatus and method for taking image and conducting video communication
US20090172986A1 (en) Media display device and method of operation thereof
US7440036B2 (en) Television receiver that produces a contracted image
US20090209205A1 (en) Method and apparatus for transporting video signal over bluetooth wireless interface
US20120176353A1 (en) Mobile information apparatus and display control method

Legal Events

Date Code Title Description
AS Assignment

Owner name: KOPIN CORPORATION, MASSACHUSETTS

Free format text: ASSIGNMENT OF ASSIGNORS INTEREST;ASSIGNORS:HERRMANN, FREDERICK P.;GASSEL, JOHN;JOHNSTON, JIM;SIGNING DATES FROM 20110324 TO 20110329;REEL/FRAME:026092/0121

FPAY Fee payment

Year of fee payment: 4