US20180277114A1 - Context Sensitive Overlays In Voice Controlled Headset Computer Displays - Google Patents

Context Sensitive Overlays In Voice Controlled Headset Computer Displays Download PDF

Info

Publication number
US20180277114A1
US20180277114A1 US15/993,005 US201815993005A US2018277114A1 US 20180277114 A1 US20180277114 A1 US 20180277114A1 US 201815993005 A US201815993005 A US 201815993005A US 2018277114 A1 US2018277114 A1 US 2018277114A1
Authority
US
United States
Prior art keywords
cue
control
user interface
voice command
user
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Abandoned
Application number
US15/993,005
Inventor
James Woodall
Christopher Parkinson
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
IKANOS CONSULTING Ltd
Kopin Corp
Original Assignee
IKANOS CONSULTING Ltd
Kopin Corp
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Priority to US38458610P priority Critical
Priority to US13/234,916 priority patent/US9122307B2/en
Priority to US201261653127P priority
Priority to US201361749240P priority
Priority to US13/799,888 priority patent/US9377862B2/en
Priority to US13/799,790 priority patent/US10013976B2/en
Priority to US15/993,005 priority patent/US20180277114A1/en
Application filed by IKANOS CONSULTING Ltd, Kopin Corp filed Critical IKANOS CONSULTING Ltd
Assigned to KOPIN CORPORATION reassignment KOPIN CORPORATION ASSIGNMENT OF ASSIGNORS INTEREST (SEE DOCUMENT FOR DETAILS). Assignors: IKANOS CONSULTING LTD
Assigned to IKANOS CONSULTING LTD reassignment IKANOS CONSULTING LTD ASSIGNMENT OF ASSIGNORS INTEREST (SEE DOCUMENT FOR DETAILS). Assignors: WOODALL, JAMES
Assigned to KOPIN CORPORATION reassignment KOPIN CORPORATION ASSIGNMENT OF ASSIGNORS INTEREST (SEE DOCUMENT FOR DETAILS). Assignors: PARKINSON, CHRISTOPHER
Publication of US20180277114A1 publication Critical patent/US20180277114A1/en
Priority claimed from US16/421,360 external-priority patent/US20190279636A1/en
Application status is Abandoned legal-status Critical

Links

Images

Classifications

    • GPHYSICS
    • G10MUSICAL INSTRUMENTS; ACOUSTICS
    • G10LSPEECH ANALYSIS OR SYNTHESIS; SPEECH RECOGNITION; SPEECH OR VOICE PROCESSING; SPEECH OR AUDIO CODING OR DECODING
    • G10L15/00Speech recognition
    • G10L15/22Procedures used during a speech recognition process, e.g. man-machine dialogue
    • GPHYSICS
    • G06COMPUTING; CALCULATING; COUNTING
    • G06FELECTRIC DIGITAL DATA PROCESSING
    • G06F3/00Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
    • G06F3/01Input arrangements or combined input and output arrangements for interaction between user and computer
    • G06F3/011Arrangements for interaction with the human body, e.g. for user immersion in virtual reality
    • GPHYSICS
    • G06COMPUTING; CALCULATING; COUNTING
    • G06FELECTRIC DIGITAL DATA PROCESSING
    • G06F3/00Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
    • G06F3/01Input arrangements or combined input and output arrangements for interaction between user and computer
    • G06F3/011Arrangements for interaction with the human body, e.g. for user immersion in virtual reality
    • G06F3/012Head tracking input arrangements
    • GPHYSICS
    • G06COMPUTING; CALCULATING; COUNTING
    • G06FELECTRIC DIGITAL DATA PROCESSING
    • G06F3/00Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
    • G06F3/01Input arrangements or combined input and output arrangements for interaction between user and computer
    • G06F3/011Arrangements for interaction with the human body, e.g. for user immersion in virtual reality
    • G06F3/013Eye tracking input arrangements
    • GPHYSICS
    • G06COMPUTING; CALCULATING; COUNTING
    • G06FELECTRIC DIGITAL DATA PROCESSING
    • G06F3/00Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
    • G06F3/01Input arrangements or combined input and output arrangements for interaction between user and computer
    • G06F3/017Gesture based interaction, e.g. based on a set of recognized hand gestures
    • GPHYSICS
    • G06COMPUTING; CALCULATING; COUNTING
    • G06FELECTRIC DIGITAL DATA PROCESSING
    • G06F3/00Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
    • G06F3/16Sound input; Sound output
    • G06F3/167Audio in a user interface, e.g. using voice commands for navigating, audio feedback

Abstract

In headset computers that leverage voice commands, often the user does not know what voice commands are available. In one embodiment, a method includes providing a user interface in a headset computer and, in response to user utterance of a cue toggle command, displaying at least one cue in the user interface. Each cue can correspond to a voice command associated with code to execute. In response to user utterance of the voice command, the method can also include executing the code associated with the voice command. The user can therefore ascertain what voice commands are available.

Description

    RELATED APPLICATIONS
  • This application is a continuation of U.S. application Ser. No. 13/799,790 filed Mar. 13, 2013 (Attorney docket no. 0717.2116-005), which claims the benefit of U.S. Application No. 61/749,240 filed Jan. 4, 2013 (Attorney docket no. 0717.2116-003) and is a continuation-in-part of U.S. application Ser. No. 13/234,916 filed Sep. 16, 2011, now U.S. Pat. No. 9,122,307 (Attorney docket no. 0717.2116-001), which claims the benefit of 61/384,586 filed Sep. 20, 2010 (Attorney docket no. 0717.2116-000). U.S. application Ser. No. 13/799,790 filed Mar. 13, 2013, now U.S. Pat. No. 9,377,862 (Attorney docket no. 0717.2116-005) also claims priority to and is a continuation-in-part of U.S. application Ser. No. 13/799,888, filed Mar. 13, 2013, now U.S. Pat. No. 9,377,862 (Attorney docket no. 0717.2173-001) which claims the benefit of U.S. Application No. 61/653,127, filed May 30, 2012 (Attorney docket no. 0717.2173-000). The entire teachings of the above applications are incorporated herein by reference.
  • BACKGROUND OF THE INVENTION
  • Mobile computing devices, such as notebook PCs, smart phones, and tablet computing devices, are now common tools used for producing, analyzing, communicating, and consuming data in both business and personal life. Consumers continue to embrace a mobile digital lifestyle as the ease of access to digital information increases with high-speed wireless communications technologies becoming ubiquitous. Popular uses of mobile computing devices include displaying large amounts of high-resolution computer graphics information and video content, often wirelessly streamed to the device. While these devices typically include a display screen, the preferred visual experience of a high-resolution, large format display cannot be easily replicated in such mobile devices because the physical size of such device is limited to promote mobility. Another drawback of the aforementioned device types is that the user interface is hands-dependent, typically requiring a user to enter data or make selections using a keyboard (physical or virtual) or touch-screen display. As a result, consumers are now seeking a hands-free, high-quality, portable, color display solution to augment or replace their hands-dependent mobile devices.
  • SUMMARY OF THE INVENTION
  • Recently developed micro-displays can provide large-format, high-resolution color pictures and streaming video in a very small form factor. One application for such displays can be integrated into a wireless headset computer worn on the head of the user with a display within the field of view of the user, similar in format to either eyeglasses, audio headset or video eyewear. A “wireless computing headset” device includes one or more small high-resolution micro-displays and optics to magnify the image. The WVGA microdisplays can provide super video graphics array (SVGA) (800×600) resolution or extended graphic arrays (XGA) (1024×768) or even higher resolutions. A wireless computing headset contains one or more wireless computing and communication interfaces, enabling data and streaming video capability, and provides greater convenience and mobility through hands dependent devices. For more information concerning such devices, see co-pending patent applications entitled “Mobile Wireless Display Software Platform for Controlling Other Systems and Devices,” U.S. application Ser. No. 12/348,648 filed Jan. 5, 2009, “Handheld Wireless Display Devices Having High Resolution Display Suitable For Use as a Mobile Internet Device,” PCT International Application No. PCT/US09/38601 filed Mar. 27, 2009, and “Improved Headset Computer,” U.S. Application No. 61/638,419 filed Apr. 25, 2012, each of which are incorporated herein by reference in their entirety.
  • In one embodiment, a method includes providing a user interface in a headset computer and, in response to user utterance of a cue toggle command, displaying at least one cue in the user interface. Each cue can correspond to a voice command associated with code to execute. In response to user utterance of the voice command, the method can also include executing the code associated with the voice command. In another embodiment, the method can further includes displaying the interface without the cue at least one of prior to the cue toggle command and after a subsequent cue toggle command. Displaying the cue can include displaying words that activate the voice command. Displaying the cue can also include displaying the cue in the user interface corresponding to the voice command associated with the control, where the control is displayed in the user interface. Displaying the cue can include displaying the cue in the user interface corresponding to the voice command associated with the control, where the control is hidden from the user interface. Displaying the cue can include displaying the cue in the user interface corresponding to the voice command associated with the control, where the control is a global headset control. The cue can be loaded from a control, the control indicating the cue and voice command.
  • In another embodiment, a system for displaying a user interface in a headset computer can include a display module configured to provide a user interface in a headset computer. The display module can be further configured to, in response to user utterance of a cue toggle command, display at least one cue in the user interface. Each cue can correspond to a voice command associated with code to execute. The system can further include a command module configured to, in response to user utterance of the voice command, execute code associated with the voice command.
  • In another embedment, a method of developing a user interface in a headset computer includes embedding a cue and a voice command in a control for the user interface. The method also includes providing the control to the user interface, the user interface configured to display the cue responsive to a cue toggle command.
  • BRIEF DESCRIPTION OF DRAWINGS
  • The foregoing will be apparent from the following more particular description of example embodiments of the invention, as illustrated in the accompanying drawings in which like reference characters refer to the same parts throughout the different views. The drawings are not necessarily to scale, emphasis instead being placed upon illustrating embodiments of the present invention.
  • FIGS. 1A-1B are schematic illustrations of a headset computer cooperating with a host computer (e.g., Smart Phone, laptop, etc.) according to principles of the present invention.
  • FIG. 2 is a block diagram of flow of data and control in the embodiment of FIGS. 1A-1B.
  • FIG. 3 is a diagram illustrating an example embodiment of a user interface employed in the HSC.
  • FIG. 4 is a diagram illustrating an example embodiment of a user interface after receiving a show commands voice command.
  • FIG. 5 is a flow diagram illustrating an example embodiment of a method employed by the present invention.
  • FIG. 6 illustrates a computer network or similar digital processing environment in which the present invention may be implemented.
  • FIG. 7 is a diagram of the internal structure of a computer (e.g., client processor/device or server computers) in the computer system of FIG. 6.
  • DETAILED DESCRIPTION OF THE INVENTION
  • FIGS. 1A and 1B show an example embodiment of a wireless computing headset device 100 (also referred to herein as a headset computer (HSC)) that incorporates a high-resolution (VGA or better) microdisplay element 1010, and other features described below. The HSC 100 can include audio input and/or output devices, including one or more microphones, input and output speakers, geo-positional sensors (GPS), three to nine axis degrees of freedom orientation sensors, atmospheric sensors, health condition sensors, digital compass, pressure sensors, environmental sensors, energy sensors, acceleration sensors, position, attitude, motion, velocity and/or optical sensors, cameras (visible light, infrared, etc.), multiple wireless radios, auxiliary lighting, rangefinders, or the like and/or an array of sensors embedded and/or integrated into the headset and/or attached to the device via one or more peripheral ports (not shown in detail in FIG. 1B). Typically located within the housing of headset computing device 100 are various electronic circuits including, a microcomputer (single or multicore processors), one or more wired and/or wireless communications interfaces, memory or storage devices, various sensors and a peripheral mount or mount, such as a “hot shoe.”
  • Example embodiments of the HSC 100 can receive user input through sensing voice commands, head movements, 110, 111, 112 and hand gestures 113, or any combination thereof. Microphone(s) operatively coupled or preferably integrated into the HSC 100 can be used to capture speech commands which are then digitized and processed using automatic speech recognition techniques. Gyroscopes, accelerometers, and other micro-electromechanical system sensors can be integrated into the HSC 100 and used to track the user's head movement to provide user input commands. Cameras or other motion tracking sensors can be used to monitor a user's hand gestures for user input commands. Such a user interface overcomes the hands-dependent formats of other mobile devices.
  • The HSC 100 can be used in various ways. It can be used as a remote display for streaming video signals received from a remote host computing device 200 (shown in FIG. 1A). The host 200 may be, for example, a notebook PC, smart phone, tablet device, or other computing device having less or greater computational complexity than the wireless computing headset device 100, such as cloud-based network resources. The host may be further connected to other networks 210, such as the Internet. The headset computing device 100 and host 200 can wirelessly communicate via one or more wireless protocols, such as Bluetooth®, Wi-Fi, WiMAX, 4G LTE or other wireless radio link 150. (Bluetooth is a registered trademark of Bluetooth Sig, Inc. of 5209 Lake Washington Boulevard, Kirkland, Wash. 98033.) In an example embodiment, the host 200 may be further connected to other networks, such as through a wireless connection to the Internet or other cloud-based network resources, so that the host 200 can act as a wireless relay. Alternatively, some example embodiments of the HSC 100 can wirelessly connect to the Internet and cloud-based network resources without the use of a host wireless relay.
  • FIG. 1B is a perspective view showing some details of an example embodiment of a headset computer 100. The example embodiment HSC 100 generally includes, a frame 1000, strap 1002, rear housing 1004, speaker 1006, cantilever, or alternatively referred to as an arm or boom 1008 with a built-in microphone, and a micro-display subassembly 1010.
  • A head worn frame 1000 and strap 1002 are generally configured so that a user can wear the headset computer device 100 on the user's head. A housing 1004 is generally a low profile unit which houses the electronics, such as the microprocessor, memory or other storage device, along with other associated circuitry. Speakers 1006 provide audio output to the user so that the user can hear information. Microdisplay subassembly 1010 is used to render visual information to the user. It is coupled to the arm 1008. The arm 1008 generally provides physical support such that the microdisplay subassembly is able to be positioned within the user's field of view 300 (FIG. 1A), preferably in front of the eye of the user or within its peripheral vision preferably slightly below or above the eye. Arm 1008 also provides the electrical or optical connections between the microdisplay subassembly 1010 and the control circuitry housed within housing unit 1004.
  • According to aspects that will be explained in more detail below, the HSC display device 100 allows a user to select a field of view 300 within a much larger area defined by a virtual display 400. The user can typically control the position, extent (e.g., X-Y or 3D range), and/or magnification of the field of view 300.
  • While what is shown in FIG. 1A is a monocular microdisplay presenting a single fixed display element supported on the face of the user with a cantilevered boom, it should be understood that other mechanical configurations for the remote control display device 100 are possible.
  • FIG. 2 is a block diagram showing more detail of the HSC device 100, host 200 and the data that travels between them. The HSC device 100 receives vocal input from the user via the microphone, hand movements or body gestures via positional and orientation sensors, the camera or optical sensor(s), and head movement inputs via the head tracking circuitry such as 3 axis to 9 axis degrees of freedom orientational sensing. These are translated by software in the HSC device 100 into keyboard and/or mouse commands that are then sent over the Bluetooth or other wireless interface 150 to the host 200. The host 200 then interprets these translated commands in accordance with its own operating system/application software to perform various functions. Among the commands is one to select a field of view 300 within the virtual display 400 and return that selected screen data to the HSC device 100. Thus, it should be understood that a very large format virtual display area might be associated with application software or an operating system running on the host 200. However, only a portion of that large virtual display area 400 within the field of view 300 is returned to and actually displayed by the micro display 1010 of HSC device 100.
  • In one embodiment the HSC 100 may take the form of the HSC described in a co-pending US Patent Publication Number 2011/0187640 which is hereby incorporated by reference in its entirety.
  • In another embodiment, the invention relates to the concept of using a Head Mounted Display (HMD) 1010 in conjunction with an external ‘smart’ device 200 (such as a smartphone or tablet) to provide information and control to the user hands-free. The invention requires transmission of small amounts of data, providing a more reliable data transfer method running in real-time.
  • In this sense therefore, the amount of data to be transmitted over the connection 150 is small-simple instructions on how to lay out a screen, which text to display, and other stylistic information such as drawing arrows, or the background colors, images to include, etc.
  • Additional data could be streamed over the same 150 or another connection and displayed on screen 1010, such as a video stream if required by the Host 200.
  • This invention relates to the viewing of context sensitive overlays within applications, on voice controlled HSCs 100.
  • The concept is the presentation of data, contextually, over a visual, on demand. Overlays can be called up by the user with a voice command, typically “Show commands.” The voice command is standard across the system 100 and available at all times. This command causes HSC 100 to display applicable voice commands and other information in a context sensitive and intuitive way.
  • The applicable commands are shown on a semi-transparent overlay of the current screen view of display unit 1010. This allows the user to retain the context of the screen he called the overlay up for.
  • The overlay and displayed applicable commands fade away after a short period of time. This is accomplished by a timing mechanism that refreshes the screen view.
  • The applicable commands are displayed in order of relevance. The most relevant command is given more prominence in terms of placement over less relevant commands. 100 determines relevancy based on the current context of the display 1010 contents.
  • Each screen in the relevant system is made up of user-interface (UI) components, some of which are ‘controls’. A control is a UI component that provides information to the user or enables some form of functionality. Examples of controls are buttons, radio buttons, text boxes, check boxes, drop down menus, file menus, ribbon menus, live tiles, etc. Within the software developer's component library, these are available in their various forms, allowing customization of certain features. For example, one such control might be a ‘button,’ simply enabling the user to press it using a voice command available on the button. Controls, such as the ‘button’ control, are available to the developer, for example, as part of the developer's component library or other library. The developer can insert the pre-coded control and customize it to his or her liking, instead of manually coding the control from scratch.
  • A “Show Commands” function is built into the controls of the developer library. When the developer, for example, creates a button and specifies a text string to be written onto the button, the text string becomes the default voice command to activate the button, unless the developer (or user) overrides the voice command. The control (e.g., the button) is configured to react to a “show commands” voice command by overlaying the text string to activate the control over the control itself, or near the control.
  • Every User Interface screen made available on the HSC 100 has the ability to receive a “Show Commands” voice command (e.g., a system command, available by default). Therefore, when a screen is constructed using controls from the UI library, show commands functionality is built in, providing guidance as to the voice commands available to the user. These voice commands are (by default) shown in context of the current displayed contents (screen view).
  • Other available voice commands can also be placed within the show commands overlay that are not associated with a visible control. These are placed in the overlay by the developer, adding a voice-command only control, or adding a hidden control, and provide a visual cue for voice commands that are not associated with a button or other control.
  • FIG. 3 is a diagram 250 illustrating an example embodiment of a user interface 202 employed in the HSC. The user interface 202, in this embodiment, is an email application displaying a user's inbox. Each email listing is a respective email control 1-6 204 a-f. The user can open each email by selecting each control. Each email control 204 a-f is programmed to be selected at least by a respective voice command.
  • FIG. 4 is a diagram 300 illustrating an example embodiment of a user interface 302 after receiving a show commands voice command. The user interface displays voice commands corresponding to each of the email controls 204 a-f of FIG. 2. With respect to FIG. 3, voice commands 1-6 304 a-4 correspond with email controls 1-6 204 a-f, respectively. For example, saying voice command 1 304 a (i.e., “Open E-mail 1”) causes the HSC to open the first email in the list.
  • The user interface 302 in show commands mode also shows a plurality of implicit voice commands 1-9 306 a-i. The implicit voice commands 1-9 306 a-i do not correspond to any particular visual control of the user interface, they are voice commands that are available to the user. For example, the user can say implicit voice commands 1 and 2 306 a-b to move to the previous and next page, respectively. The user can draft an email by saying implicit command 3 306 c. The user can manage his or her email account by saying implicit command 4 306 d. The user can see his or her accounts by saying implicit command 5 306 e. The user can switch folders by saying implicit voice command 6 306 f The user can refresh the inbox by saying implicit voice command 7 306 g.
  • Further, the user can go back to a previous screen by saying implicit voice command 8 306 h. The user can return to a home screen by saying implicit voice command 9 306 i. Implicit voice commands 8 and 9 can be universal to all screens on the HSC. Voice commands 1-6 304 a-f and implicit voice commands 1-7 306 a-g are local commands for this particular application. However, in other embodiments, implicit voice commands 1-2 306 a-b can be global commands for moving to previous and next pages of applications.
  • The voice command overlay aids the user by de-cluttering the screen of options and buttons. The voice commands further help prompt the user to how to use the system, which is especially useful while the user is learning how to use the device and voice commands.
  • FIG. 5 is a flow diagram 500 illustrating an example embodiment of a method employed by the present invention. First, the method provides a user interface in a headset computer (502). Then, the method determines whether it has received a cue toggle command, for example, over an audio channel from a user utterance (504). If not, the method continues listening for the cue toggle command (504). If so, however, the method then displays at least one cue in the user interface (506). Each cue is associated with a corresponding voice command, which, when uttered, causes the system to execute code.
  • The system then determines whether it has received a voice command (e.g., a voice command shown by one of the cues) (508). If not, it keeps listening for a voice command (508). If so, however, it executes the code associated with the voice command (510).
  • FIG. 6 illustrates a computer network or similar digital processing environment in which the present invention may be implemented.
  • Client computer(s)/devices 50 and server computer(s) 60 provide processing, storage, and input/output devices executing application programs and the like. Client computer(s)/devices 50 can also be linked through communications network 70 to other computing devices, including other client devices/processes 50 and server computer(s) 60. Communications network 70 can be part of a remote access network, a global network (e.g., the Internet), a worldwide collection of computers, Local area or Wide area networks, and gateways that currently use respective protocols (TCP/IP, Bluetooth, etc.) to communicate with one another. Other electronic device/computer network architectures are suitable.
  • FIG. 7 is a diagram of the internal structure of a computer (e.g., client processor/device 50 or server computers 60) in the computer system of FIG. 6. Each computer 50, 60 contains system bus 79, where a bus is a set of hardware lines used for data transfer among the components of a computer or processing system. Bus 79 is essentially a shared conduit that connects different elements of a computer system (e.g., processor, disk storage, memory, input/output ports, network ports, etc.) that enables the transfer of information between the elements. Attached to system bus 79 is I/O device interface 82 for connecting various input and output devices (e.g., keyboard, mouse, displays, printers, speakers, etc.) to the computer 50, 60. Network interface 86 allows the computer to connect to various other devices attached to a network (e.g., network 70 of FIG. 6). Memory 90 provides volatile storage for computer software instructions 92 and data 94 used to implement an embodiment of the present invention (e.g., context sensitive overlays in a user interface code detailed above). Disk storage 95 provides non-volatile storage for computer software instructions 92 and data 94 used to implement an embodiment of the present invention. Central processor unit 84 is also attached to system bus 79 and provides for the execution of computer instructions.
  • In one embodiment, the processor routines 92 and data 94 are a computer program product (generally referenced 92), including a computer readable medium (e.g., a removable storage medium such as one or more DVD-ROM's, CD-ROM's, diskettes, tapes, etc.) that provides at least a portion of the software instructions for the invention system. Computer program product 92 can be installed by any suitable software installation procedure, as is well known in the art. In another embodiment, at least a portion of the software instructions may also be downloaded over a cable, communication and/or wireless connection. In other embodiments, the invention programs are a computer program propagated signal product 107 embodied on a propagated signal on a propagation medium (e.g., a radio wave, an infrared wave, a laser wave, a sound wave, or an electrical wave propagated over a global network such as the Internet, or other network(s)). Such carrier medium or signals provide at least a portion of the software instructions for the present invention routines/program 92.
  • In alternate embodiments, the propagated signal is an analog carrier wave or digital signal carried on the propagated medium. For example, the propagated signal may be a digitized signal propagated over a global network (e.g., the Internet), a telecommunications network, or other network. In one embodiment, the propagated signal is a signal that is transmitted over the propagation medium over a period of time, such as the instructions for a software application sent in packets over a network over a period of milliseconds, seconds, minutes, or longer. In another embodiment, the computer readable medium of computer program product 92 is a propagation medium that the computer system 50 may receive and read, such as by receiving the propagation medium and identifying a propagated signal embodied in the propagation medium, as described above for computer program propagated signal product.
  • Generally speaking, the term “carrier medium” or transient carrier encompasses the foregoing transient signals, propagated signals, propagated medium, storage medium and the like.
  • While this invention has been particularly shown and described with references to example embodiments thereof, it will be understood by those skilled in the art that various changes in form and details may be made therein without departing from the scope of the invention encompassed by the appended claims.

Claims (20)

1. A method comprising:
providing a user interface in a headset computer, the user interface having a graphical user interface portion;
in response to user utterance of a cue toggle command, displaying at least one cue, each cue corresponding to a voice command associated with code to execute, in the user interface; and
in response to user utterance of the voice command, executing the code associated with the voice command.
2. The method of claim 1, further comprising:
displaying the interface without the cue at least one of prior to the cue toggle command and after a subsequent cue toggle command.
3. The method of claim 1, wherein displaying the cue includes displaying words that activate the voice command.
4. The method of claim 1, wherein displaying the cue includes displaying the cue in the user interface corresponding to the voice command associated with the control, the control displayed in the user interface.
5. The method of claim 1, wherein displaying the cue includes displaying the cue in the user interface corresponding to the voice command associated with the control, the control hidden from the user interface.
6. The method of claim 1, wherein displaying the cue includes displaying the cue in the user interface corresponding to the voice command associated with the control, the control being a global headset control.
7. The method of claim 1, wherein the cue is loaded from a control, the control indicating the cue and voice command.
8. A system for displaying a user interface in a headset computer, the system comprising:
a display module configured to provide a graphical user interface portion to a user interface in a headset computer and further configured to, in response to user utterance of a cue toggle command, display at least one cue, each cue corresponding to a voice command associated with code to execute, in the user interface; and
a command module configured to, in response to user utterance of the voice command, execute code associated with the voice command.
9. The system of claim 8, wherein the display is further configured to display the interface without the cue at least one of prior to the cue toggle command and after a subsequent cue toggle command.
10. The system of claim 8, wherein the display module is further configured to display words that activate the voice command.
11. The system of claim 8, wherein the display module is further configured to display a cue includes displaying a cue in the user interface corresponding to a voice command associated with the control, the control displayed in the user interface.
12. The system of claim 8, wherein the display module is further configured to display the cue in the user interface corresponding to the voice command associated with the control, the control hidden from the user interface.
13. The system of claim 8, wherein the display module is further configured to display the cue in the user interface corresponding to the voice command associated with the control, the control being a global headset control.
14. The system of claim 8, wherein the cue is loaded from a control, the control indicating the cue and voice command.
15. A method of developing a user interface in a headset computer, the method comprising:
embedding a cue and a voice command in a control for the user interface; and
providing the control to the user interface, the user interface configured to display the cue responsive to a cue toggle command.
16. The method of claim 1, wherein the cue includes words that activate the voice command.
17. The method of claim 1, wherein the cue corresponds to the voice command associated with the control displayed in the user interface.
18. The method of claim 1, wherein the cue corresponds to the voice command associated with the control hidden from the user interface.
19. The method of claim 1, wherein the cue corresponds to the voice command associated with the control being a global headset control.
20. The method of claim 1, wherein the cue is loaded from a control, the control indicating the cue and voice command.
US15/993,005 2010-09-20 2018-05-30 Context Sensitive Overlays In Voice Controlled Headset Computer Displays Abandoned US20180277114A1 (en)

Priority Applications (7)

Application Number Priority Date Filing Date Title
US38458610P true 2010-09-20 2010-09-20
US13/234,916 US9122307B2 (en) 2010-09-20 2011-09-16 Advanced remote control of host application using motion and voice commands
US201261653127P true 2012-05-30 2012-05-30
US201361749240P true 2013-01-04 2013-01-04
US13/799,790 US10013976B2 (en) 2010-09-20 2013-03-13 Context sensitive overlays in voice controlled headset computer displays
US13/799,888 US9377862B2 (en) 2010-09-20 2013-03-13 Searchlight navigation using headtracker to reveal hidden or extra document data
US15/993,005 US20180277114A1 (en) 2010-09-20 2018-05-30 Context Sensitive Overlays In Voice Controlled Headset Computer Displays

Applications Claiming Priority (2)

Application Number Priority Date Filing Date Title
US15/993,005 US20180277114A1 (en) 2010-09-20 2018-05-30 Context Sensitive Overlays In Voice Controlled Headset Computer Displays
US16/421,360 US20190279636A1 (en) 2010-09-20 2019-05-23 Context Sensitive Overlays in Voice Controlled Headset Computer Displays

Related Parent Applications (1)

Application Number Title Priority Date Filing Date
US13/799,790 Continuation US10013976B2 (en) 2010-09-20 2013-03-13 Context sensitive overlays in voice controlled headset computer displays

Related Child Applications (1)

Application Number Title Priority Date Filing Date
US16/421,360 Continuation US20190279636A1 (en) 2010-09-20 2019-05-23 Context Sensitive Overlays in Voice Controlled Headset Computer Displays

Publications (1)

Publication Number Publication Date
US20180277114A1 true US20180277114A1 (en) 2018-09-27

Family

ID=49043347

Family Applications (2)

Application Number Title Priority Date Filing Date
US13/799,790 Active 2031-09-24 US10013976B2 (en) 2010-09-20 2013-03-13 Context sensitive overlays in voice controlled headset computer displays
US15/993,005 Abandoned US20180277114A1 (en) 2010-09-20 2018-05-30 Context Sensitive Overlays In Voice Controlled Headset Computer Displays

Family Applications Before (1)

Application Number Title Priority Date Filing Date
US13/799,790 Active 2031-09-24 US10013976B2 (en) 2010-09-20 2013-03-13 Context sensitive overlays in voice controlled headset computer displays

Country Status (1)

Country Link
US (2) US10013976B2 (en)

Cited By (1)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US10474418B2 (en) 2008-01-04 2019-11-12 BlueRadios, Inc. Head worn wireless computer having high-resolution display suitable for use as a mobile internet device

Families Citing this family (14)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
WO2010129679A1 (en) 2009-05-08 2010-11-11 Kopin Corporation Remote control of host application using motion and voice commands
US10013976B2 (en) 2010-09-20 2018-07-03 Kopin Corporation Context sensitive overlays in voice controlled headset computer displays
US9316827B2 (en) 2010-09-20 2016-04-19 Kopin Corporation LifeBoard—series of home pages for head mounted displays (HMD) that respond to head tracking
US9122307B2 (en) 2010-09-20 2015-09-01 Kopin Corporation Advanced remote control of host application using motion and voice commands
US9442290B2 (en) 2012-05-10 2016-09-13 Kopin Corporation Headset computer operation using vehicle sensor feedback for remote control vehicle
WO2013101438A1 (en) 2011-12-29 2013-07-04 Kopin Corporation Wireless hands-free computing head mounted video eyewear for local/remote diagnosis and repair
CN104303177B (en) 2012-04-25 2018-08-17 寇平公司 Execute the method and earphone computing device of real-time phonetic translation
US9301085B2 (en) 2013-02-20 2016-03-29 Kopin Corporation Computer headset with detachable 4G radio
WO2015100107A1 (en) * 2013-12-26 2015-07-02 Kopin Corporation User configurable speech commands
CN105022579A (en) * 2014-04-30 2015-11-04 中国海洋大学 Image processing-based implement method and device of virtual keyboard
CN104834446B (en) * 2015-05-04 2018-10-26 惠州Tcl移动通信有限公司 A kind of display screen multi-screen control method and system based on eyeball tracking technology
US10437070B2 (en) 2016-12-23 2019-10-08 Realwear, Inc. Interchangeable optics for a head-mounted display
US10365493B2 (en) 2016-12-23 2019-07-30 Realwear, Incorporated Modular components for a head-mounted display
US10393312B2 (en) 2016-12-23 2019-08-27 Realwear, Inc. Articulating components for a head-mounted display

Citations (5)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US20030046401A1 (en) * 2000-10-16 2003-03-06 Abbott Kenneth H. Dynamically determing appropriate computer user interfaces
US20050114140A1 (en) * 2003-11-26 2005-05-26 Brackett Charles C. Method and apparatus for contextual voice cues
US20080120141A1 (en) * 2006-11-22 2008-05-22 General Electric Company Methods and systems for creation of hanging protocols using eye tracking and voice command and control
US20120089392A1 (en) * 2010-10-07 2012-04-12 Microsoft Corporation Speech recognition user interface
US20130001918A1 (en) * 2005-11-14 2013-01-03 Santa Cruz Bicycles, Inc. Bicycle rear suspension system with controlled variable shock rate

Family Cites Families (235)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US4567479A (en) 1982-12-23 1986-01-28 Boyd Barry S Directional controller apparatus for a video or computer input
US5005213A (en) 1986-07-10 1991-04-02 Varo, Inc. Head mounted video display and remote camera system
US5208449A (en) 1991-09-09 1993-05-04 Psc, Inc. Portable transaction terminal
US5491651A (en) 1992-05-15 1996-02-13 Key, Idea Development Flexible wearable computer
US9513744B2 (en) 1994-08-15 2016-12-06 Apple Inc. Control systems employing novel physical controls and touch screens
US6010216A (en) 1993-01-19 2000-01-04 Jesiek; Daniel Stephen "Hear speak" two-way voice radio communications eyeglasses
US5698834A (en) 1993-03-16 1997-12-16 Worthington Data Solutions Voice prompt with voice recognition for portable data collection terminal
US6853293B2 (en) 1993-05-28 2005-02-08 Symbol Technologies, Inc. Wearable communication system
US5818455A (en) 1993-07-21 1998-10-06 Xerox Corporation Method and apparatus for operating on the model data structure of an image to produce human perceptible output using a viewing operation region having explicit multiple regions
CA2158271A1 (en) 1994-03-04 1995-09-08 John Wayne Mckown Information display apparatus
US5642129A (en) 1994-03-23 1997-06-24 Kopin Corporation Color sequential display panels
US6369952B1 (en) 1995-07-14 2002-04-09 I-O Display Systems Llc Head-mounted personal visual display apparatus with image generator and holder
US5990793A (en) 1994-09-02 1999-11-23 Safety Tech Industries, Inc. Firefighters integrated communication and safety system
US6198462B1 (en) 1994-10-14 2001-03-06 Hughes Electronics Corporation Virtual display screen system
US5594469A (en) 1995-02-21 1997-01-14 Mitsubishi Electric Information Technology Center America Inc. Hand gesture machine control system
JPH0934895A (en) 1995-07-14 1997-02-07 Sony Corp Translation system
US6127990A (en) 1995-11-28 2000-10-03 Vega Vista, Inc. Wearable display and methods for controlling same
US5742263A (en) 1995-12-18 1998-04-21 Telxon Corporation Head tracking system for a head mounted display system
JPH1020867A (en) 1996-07-05 1998-01-23 Masanobu Kujirada Mouth opposite type muffler
US5689619A (en) 1996-08-09 1997-11-18 The United States Of America As Represented By The Secretary Of The Army Eyetracker control of heads-up displays
US6204974B1 (en) 1996-10-08 2001-03-20 The Microoptical Corporation Compact image display system for eyeglasses or other head-borne frames
JP3771989B2 (en) 1997-03-24 2006-05-10 オリンパス株式会社 Image / audio communication system and videophone transmission / reception method
US5929748A (en) 1997-06-12 1999-07-27 Microsoft Corporation Automated home control using existing electrical lines as a communications medium
EP0923759A2 (en) 1997-07-03 1999-06-23 Philips Electronics N.V. Apparatus and method for creating and controlling a virtual workspace of a windowing system
US6270414B2 (en) 1997-12-31 2001-08-07 U.S. Philips Corporation Exoskeletal platform for controlling multi-directional avatar kinetics in a virtual environment
US7860725B2 (en) 1998-05-26 2010-12-28 Ineedmd.Com, Inc. Method for remote medical consultation and care
WO2000017848A1 (en) 1998-09-22 2000-03-30 Vega Vista, Inc. Intuitive control of portable data displays
US6192343B1 (en) * 1998-12-17 2001-02-20 International Business Machines Corporation Speech command input recognition system for interactive computer display with term weighting means used in interpreting potential commands from relevant speech terms
US7035897B1 (en) 1999-01-15 2006-04-25 California Institute Of Technology Wireless augmented reality communication system
US20060061551A1 (en) 1999-02-12 2006-03-23 Vega Vista, Inc. Motion detection and tracking system to control navigation and display of portable displays including on-chip gesture detection
EP1194806A4 (en) 1999-06-21 2008-07-23 Microoptical Corp Eyeglass display lens system employing off-axis optical design
US7158096B1 (en) 1999-06-21 2007-01-02 The Microoptical Corporation Compact, head-mountable display device with suspended eyepiece assembly
US6408257B1 (en) 1999-08-31 2002-06-18 Xerox Corporation Augmented-reality display method and system
JP2001100878A (en) 1999-09-29 2001-04-13 Toshiba Corp Multi-modal input/output device
US6538676B1 (en) 1999-10-04 2003-03-25 Intel Corporation Video token tracking system for overlay of metadata upon video data
US6532446B1 (en) 1999-11-24 2003-03-11 Openwave Systems Inc. Server based speech recognition user interface for wireless devices
US6621508B1 (en) 2000-01-18 2003-09-16 Seiko Epson Corporation Information processing system
JP2001216069A (en) 2000-02-01 2001-08-10 Toshiba Corp Operation inputting device and direction detecting method
US6981229B1 (en) 2000-04-28 2005-12-27 Alias Systems Corp. System for dynamically mapping input device movement as a user's viewpoint changes
US7278734B2 (en) 2000-06-02 2007-10-09 Oakley, Inc. Wireless interactive headset
US20120105740A1 (en) 2000-06-02 2012-05-03 Oakley, Inc. Eyewear with detachable adjustable electronics module
US7461936B2 (en) 2000-06-02 2008-12-09 Oakley, Inc. Eyeglasses with detachable adjustable electronics module
US6325507B1 (en) 2000-06-02 2001-12-04 Oakley, Inc. Eyewear retention system extending across the top of a wearer's head
US7150526B2 (en) 2000-06-02 2006-12-19 Oakley, Inc. Wireless interactive headset
US7487112B2 (en) * 2000-06-29 2009-02-03 Barnes Jr Melvin L System, method, and computer program product for providing location based services and mobile e-commerce
JP2002032212A (en) 2000-07-14 2002-01-31 Toshiba Corp Computer system and headset type display device
US20020044152A1 (en) 2000-10-16 2002-04-18 Abbott Kenneth H. Dynamic integration of computer generated and real world images
US6956614B1 (en) 2000-11-22 2005-10-18 Bath Iron Works Apparatus and method for using a wearable computer in collaborative applications
GB2369742A (en) 2000-11-30 2002-06-05 Nokia Mobile Phones Ltd Neck strap accessory for audio device having wired earpiece
US6798391B2 (en) 2001-01-02 2004-09-28 Xybernaut Corporation Wearable computer system
US6900777B1 (en) 2001-01-03 2005-05-31 Stryker Corporation Infrared audio/video interface for head-mounted display
US20020094845A1 (en) 2001-01-16 2002-07-18 Rei Inasaka Body worn display system
DE10103922A1 (en) 2001-01-30 2002-08-01 Physoptics Opto Electronic Gmb Interactive Datensicht- and operating system
JP4649050B2 (en) 2001-03-13 2011-03-09 キヤノン株式会社 Image processing apparatus, image processing method, and control program
WO2002077972A1 (en) 2001-03-27 2002-10-03 Rast Associates, Llc Head-worn, trimodal device to increase transcription accuracy in a voice recognition system and to process unvocalized speech
CN1282155C (en) 2001-03-28 2006-10-25 三菱电机株式会社 Noise suppressor and method
US6769767B2 (en) 2001-04-30 2004-08-03 Qr Spex, Inc. Eyewear with exchangeable temples housing a transceiver forming ad hoc networks with other devices
US6678906B1 (en) 2001-04-30 2004-01-20 Sleepmakers Incorporated Hydrophobic layered blanket
GB2376283B (en) 2001-06-04 2005-03-16 Hewlett Packard Co Foot activated user input
US7013009B2 (en) 2001-06-21 2006-03-14 Oakley, Inc. Eyeglasses with wireless communication features
US6961912B2 (en) 2001-07-18 2005-11-01 Xerox Corporation Feedback mechanism for use with visual selection methods
US6778906B1 (en) 2001-08-14 2004-08-17 The United States Of America As Represented By The Secretary Of The Navy Apparatus and method for ensuring retention of situational awareness by employing an active network guidance and emergency logic (angel) system
US6583808B2 (en) 2001-10-04 2003-06-24 National Research Council Of Canada Method and system for stereo videoconferencing
US7313246B2 (en) 2001-10-06 2007-12-25 Stryker Corporation Information system using eyewear for communication
AU2002362095A1 (en) 2001-12-05 2003-06-17 Kopin Corporation Head-mounted display system
GB2388209C (en) 2001-12-20 2005-08-23 Canon Kk Control apparatus
JP4114859B2 (en) 2002-01-09 2008-07-09 松下電器産業株式会社 Motion vector encoding method and motion vector decoding method
US7035091B2 (en) 2002-02-28 2006-04-25 Accenture Global Services Gmbh Wearable computer system and modes of operating the system
US6965862B2 (en) 2002-04-11 2005-11-15 Carroll King Schuller Reading machine
US7519918B2 (en) 2002-05-30 2009-04-14 Intel Corporation Mobile virtual desktop
US7110799B1 (en) 2002-06-14 2006-09-19 Symbol Technologies, Inc. Mobile terminal for interoperating with a standard or push-button enabled headset
CN1720763B (en) 2002-07-26 2013-06-12 奥克利有限公司 Glasses
US7330740B2 (en) 2002-10-22 2008-02-12 Broadcom Corporation Cell phone wireless speaker-microphone sleep modes
TW200417228A (en) 2002-09-17 2004-09-01 Ginganet Corp Sign language image presentation apparatus, sign language image input/output apparatus, and system for sign language translation
US7774075B2 (en) 2002-11-06 2010-08-10 Lin Julius J Y Audio-visual three-dimensional input/output
US7620433B2 (en) 2003-01-15 2009-11-17 Gn Netcom, Inc. Display headset
JP4135520B2 (en) 2003-01-29 2008-08-20 トヨタ自動車株式会社 Vehicle communication device
US8745541B2 (en) 2003-03-25 2014-06-03 Microsoft Corporation Architecture for controlling a computer using hand gestures
US7806525B2 (en) 2003-10-09 2010-10-05 Ipventure, Inc. Eyeglasses having a camera
US7760898B2 (en) 2003-10-09 2010-07-20 Ip Venture, Inc. Eyeglasses with hearing enhanced and other audio signal-generating capabilities
AT447205T (en) 2003-05-12 2009-11-15 Elbit Systems Ltd Method and system for audiovisual communication
JP4197271B2 (en) 2003-06-17 2008-12-17 シャープ株式会社 COMMUNICATION TERMINAL, COMMUNICATION TERMINAL CONTROL METHOD, VOICE RECOGNITION PROCESSING DEVICE, VOICE RECOGNITION PROCESSING DEVICE CONTROL METHOD, COMMUNICATION TERMINAL CONTROL PROGRAM, RECORDING MEDIUM RECORDING COMMUNICATION TERMINAL CONTROL PROGRAM, VOICE RECOGNITION PROCESSING DEVICE CONTROL PROGRAM, AND VOICE RECOGNITION PROCESSING DEVICE Recording medium recording control program
US20040267527A1 (en) 2003-06-25 2004-12-30 International Business Machines Corporation Voice-to-text reduction for real time IM/chat/SMS
ITTO20030640A1 (en) 2003-08-19 2005-02-20 Luigi Giubbolini Apparatus man-machine interface means
US20050047629A1 (en) 2003-08-25 2005-03-03 International Business Machines Corporation System and method for selectively expanding or contracting a portion of a display using eye-gaze tracking
DE10344062A1 (en) 2003-09-23 2005-04-21 Zeiss Carl Head-mounted display device e.g. for image and textural information, includes translation unit for detecting speech recorded by voice recording device
US20050108643A1 (en) 2003-11-17 2005-05-19 Nokia Corporation Topographic presentation of media files in a media diary application
EP2148504B1 (en) 2003-12-03 2012-01-25 Nikon Corporation Information Display Device
KR20050102803A (en) 2004-04-23 2005-10-27 삼성전자주식회사 Apparatus, system and method for virtual user interface
US20050261890A1 (en) 2004-05-21 2005-11-24 Sterling Robinson Method and apparatus for providing language translation
KR100926658B1 (en) 2004-06-04 2009-11-17 퀄컴 인코포레이티드 High data rate interface apparatus and method
IL162572A (en) 2004-06-17 2013-02-28 Lumus Ltd High brightness optical device
US7284192B2 (en) 2004-06-24 2007-10-16 Avaya Technology Corp. Architecture for ink annotations on web documents
EP1782228A1 (en) 2004-08-03 2007-05-09 Silverbrook Research Pty. Ltd Walk-up printing
KR100725385B1 (en) 2004-08-14 2007-06-07 삼성전자주식회사 System and method for displaying content using message communication
US7501995B2 (en) 2004-11-24 2009-03-10 General Electric Company System and method for presentation of enterprise, clinical, and decision support information utilizing eye tracking navigation
US7976480B2 (en) 2004-12-09 2011-07-12 Motorola Solutions, Inc. Wearable auscultation system and method
US8482488B2 (en) 2004-12-22 2013-07-09 Oakley, Inc. Data input management system for wearable electronically enabled interface
CN100399247C (en) 2004-12-22 2008-07-02 联想(北京)有限公司 System and method for controlling cursor of display device
US7877115B2 (en) 2005-01-24 2011-01-25 Broadcom Corporation Battery management in a modular earpiece microphone combination
US8083569B2 (en) 2005-02-04 2011-12-27 Nicholas Sotereanos Remotely controlled vehicle
WO2006087709A1 (en) 2005-02-17 2006-08-24 Lumus Ltd. Personal navigation system
US7249846B2 (en) 2005-05-03 2007-07-31 Grand Joseph B Eyewear with an image projected off of an unassisted eyewear lens to the user
US8606333B2 (en) 2005-06-10 2013-12-10 At&T Mobility Ii Llc Push to lower hearing assisted device
US7437223B2 (en) 2005-08-05 2008-10-14 The Boeing Company Heading reference command and control algorithm and cueing systems and methods for aircraft turn-to-target maneuvers
US20100164990A1 (en) 2005-08-15 2010-07-01 Koninklijke Philips Electronics, N.V. System, apparatus, and method for augmented reality glasses for end-user programming
TWI284481B (en) 2005-09-02 2007-07-21 Kye Systems Corp Wireless earphone device
JP2007079978A (en) 2005-09-14 2007-03-29 Fuji Xerox Co Ltd Translation system and translation method
US20070081123A1 (en) 2005-10-07 2007-04-12 Lewis Scott W Digital eyewear
US20070093279A1 (en) 2005-10-12 2007-04-26 Craig Janik Wireless headset system for the automobile
US20070265495A1 (en) 2005-12-15 2007-11-15 Medivision, Inc. Method and apparatus for field of view tracking
US7732694B2 (en) 2006-02-03 2010-06-08 Outland Research, Llc Portable music player with synchronized transmissive visual overlays
JP5007510B2 (en) 2006-02-13 2012-08-22 コニカミノルタビジネステクノロジーズ株式会社 Document processing apparatus and document processing system
US20070220108A1 (en) 2006-03-15 2007-09-20 Whitaker Jerry M Mobile global virtual browser with heads-up display for browsing and interacting with the World Wide Web
US20070238475A1 (en) 2006-03-30 2007-10-11 Goedken Terrance J Wireless communications device with priority list
JP5045669B2 (en) 2006-05-09 2012-10-10 株式会社ニコン Head mounted display
US8947531B2 (en) 2006-06-19 2015-02-03 Oshkosh Corporation Vehicle diagnostics based on information communicated between vehicles
JP4267648B2 (en) 2006-08-25 2009-05-27 株式会社東芝 Interface device and method thereof
US20080055194A1 (en) 2006-08-31 2008-03-06 Motorola, Inc. Method and system for context based user interface information presentation and positioning
US8611889B2 (en) 2006-09-26 2013-12-17 Samsung Electronics Co., Ltd. Remote handset diagnostics
US8212859B2 (en) 2006-10-13 2012-07-03 Apple Inc. Peripheral treatment for head-mounted displays
KR101304461B1 (en) 2006-12-04 2013-09-04 삼성전자주식회사 Method and apparatus of gesture-based user interface
US20080211768A1 (en) 2006-12-07 2008-09-04 Randy Breen Inertial Sensor Input Device
US20080144854A1 (en) 2006-12-13 2008-06-19 Marcio Marc Abreu Biologically fit wearable electronics apparatus and methods
EP2095178B1 (en) 2006-12-14 2015-08-12 Oakley, Inc. Wearable high resolution audio visual interface
US7798638B2 (en) 2007-01-02 2010-09-21 Hind-Sight Industries, Inc. Eyeglasses with integrated video display
US7484847B2 (en) 2007-01-02 2009-02-03 Hind-Sight Industries, Inc. Eyeglasses having integrated telescoping video camera and video display
US7547101B2 (en) 2007-01-02 2009-06-16 Hind-Sight Industries, Inc. Eyeglasses with integrated telescoping video display
JP4395792B2 (en) 2007-01-29 2010-01-13 セイコーエプソン株式会社 Projector
US9044136B2 (en) 2007-02-16 2015-06-02 Cim Technology Inc. Wearable mini-size intelligent healthcare system
US20080201634A1 (en) 2007-02-20 2008-08-21 Gibb Erik W System and method for customizing a user interface
US8949130B2 (en) 2007-03-07 2015-02-03 Vlingo Corporation Internal and external speech recognition use with a mobile communication facility
US20080239080A1 (en) 2007-03-26 2008-10-02 Moscato Jonathan D Head-mounted rear vision system
US20100020229A1 (en) 2007-04-30 2010-01-28 General Electric Company Wearable personal video/audio device method and system
JP2010527557A (en) 2007-05-14 2010-08-12 コピン コーポレーション Mobile radio display for accessing data from host and method for controlling the same
US8909296B2 (en) 2007-05-14 2014-12-09 Kopin Corporation Mobile wireless display software platform for controlling other systems and devices
US8825468B2 (en) 2007-07-31 2014-09-02 Kopin Corporation Mobile wireless display providing speech to speech translation and avatar simulating human attributes
WO2009017797A2 (en) 2007-07-31 2009-02-05 Kopin Corporation Mobile wireless display providing speech to speech translation and avatar simulating human attributes
FR2916541B1 (en) 2007-05-25 2014-11-21 Thales Sa High head visualization device for aircraft comprising display means for a symbology dedicated to the avoidance of obstacles.
IL183637A (en) 2007-06-04 2013-06-27 Zvi Lapidot Distributed head-mounted display
EP2165234A1 (en) 2007-06-07 2010-03-24 Panagiotis Pavlopoulos An eyewear comprising at least one display device
KR20080114391A (en) 2007-06-27 2008-12-31 삼성전기주식회사 Display device and method using laser light sources and record media recoded program realizing the same
US7458682B1 (en) 2007-09-06 2008-12-02 Double Hero Corporation Eyeglass with multimedia functions of music playing and remote communication
DE102007045835B4 (en) 2007-09-25 2012-12-20 Metaio Gmbh Method and device for displaying a virtual object in a real environment
FR2921735B1 (en) 2007-09-28 2017-09-22 Joel Pedre Method and device for translation and a helmet implemented by said device
JP5116424B2 (en) 2007-10-09 2013-01-09 任天堂株式会社 Game program and game device
US7969657B2 (en) 2007-10-25 2011-06-28 University Of Central Florida Research Foundation, Inc. Imaging systems for eyeglass-based display devices
US8072393B2 (en) 2007-11-15 2011-12-06 Symbol Technologies, Inc. User interface for a head mounted display
US8520860B2 (en) 2007-12-13 2013-08-27 Symbol Technologies, Inc. Modular mobile computing headset
US8108143B1 (en) 2007-12-20 2012-01-31 U-Blox Ag Navigation system enabled wireless headset
US20090182562A1 (en) 2008-01-14 2009-07-16 Garmin Ltd. Dynamic user interface for automated speech recognition
US8099289B2 (en) 2008-02-13 2012-01-17 Sensory, Inc. Voice interface and search for electronic devices including bluetooth headsets and remote systems
US8352264B2 (en) 2008-03-19 2013-01-08 Canyon IP Holdings, LLC Corrective feedback loop for automated speech recognition
US9886231B2 (en) 2008-03-28 2018-02-06 Kopin Corporation Head worn wireless computer having high-resolution display suitable for use as a mobile internet device
JP2009294728A (en) 2008-06-02 2009-12-17 Sony Ericsson Mobilecommunications Japan Inc Display processor, display processing method, display processing program, and portable terminal device
CA2727951A1 (en) 2008-06-19 2009-12-23 E-Lane Systems Inc. Communication system with voice mail access and call by spelling functionality
US7959084B2 (en) 2008-07-01 2011-06-14 Symbol Technologies, Inc. Multi-functional mobile computing device utilizing a removable processor module
JP2010015238A (en) 2008-07-01 2010-01-21 Sony Corp Information processor and display method for auxiliary information
US20100001699A1 (en) 2008-07-02 2010-01-07 Murata Power Solutions Output voltage control circuit for modular power supplies
US20100033830A1 (en) 2008-08-11 2010-02-11 Man Fat Yung Wearable image display device
US8498425B2 (en) 2008-08-13 2013-07-30 Onvocal Inc Wearable headset with self-contained vocal feedback and vocal command
US20100053069A1 (en) 2008-08-26 2010-03-04 Symbol Technologies, Inc. Mobile computing system facilitating adaptive display of content among a plurality of display components including at least one virtual image display component
CN101349944A (en) 2008-09-03 2009-01-21 宏碁股份有限公司 Gesticulation guidance system and method for controlling computer system by touch control gesticulation
AT10520U3 (en) 2008-09-05 2013-10-15 Knapp Systemintegration Gmbh Device and method for the visual support of picking processes
US8242884B2 (en) 2008-09-24 2012-08-14 Denso International America, Inc. Car finder by cell phone
JP5154363B2 (en) 2008-10-24 2013-02-27 クラリオン株式会社 Car interior voice dialogue system
WO2010051483A1 (en) 2008-10-31 2010-05-06 Cedars-Sinai Medical Center Methods of diagnosing insulin resistance and sensitivity
US8249243B2 (en) 2008-11-13 2012-08-21 Aspect Software, Inc. Method of remotely operating contact center systems
US8547342B2 (en) 2008-12-22 2013-10-01 Verizon Patent And Licensing Inc. Gesture-based delivery from mobile device
US7997723B2 (en) 2008-12-31 2011-08-16 Nokia Corporation Display apparatus and device
US20100169073A1 (en) 2008-12-31 2010-07-01 Voice Muffler Corporation Foldable Wireless Device for Language Translation
US20100171696A1 (en) 2009-01-06 2010-07-08 Chi Kong Wu Motion actuation system and related motion database
FR2941786B1 (en) 2009-02-03 2011-04-29 Laster Portable high head display device and increased reality
US8326601B2 (en) 2009-02-11 2012-12-04 Microsoft Corporation Queue based mechanism to support multi-language chat rooms
JP5616367B2 (en) 2009-02-27 2014-10-29 ファウンデーション プロダクションズ エルエルシー Communication platform based on headset
US20100225734A1 (en) 2009-03-03 2010-09-09 Horizon Semiconductors Ltd. Stereoscopic three-dimensional interactive system and method
US20100250231A1 (en) 2009-03-07 2010-09-30 Voice Muffler Corporation Mouthpiece with sound reducer to enhance language translation
KR101589433B1 (en) 2009-03-11 2016-01-28 삼성전자주식회사 Simultaneous Interpretation System
US20100238184A1 (en) 2009-03-19 2010-09-23 Michael Janicki Method and apparatus for three-dimensional visualization in mobile devices
JP5389493B2 (en) 2009-03-25 2014-01-15 オリンパス株式会社 Glasses-mounted image display device
JP5245981B2 (en) 2009-03-30 2013-07-24 ブラザー工業株式会社 Head mounted display
US8170262B1 (en) 2009-04-15 2012-05-01 Frank Kung Fu Liu Wireless air tube headset
US8212855B2 (en) 2009-04-29 2012-07-03 Embarq Holdings Company, Llc Video conferencing eyewear
WO2011097226A1 (en) 2010-02-02 2011-08-11 Kopin Corporation Wireless hands-free computing headset with detachable accessories controllable by motion, body gesture and/or vocal commands
US8855719B2 (en) 2009-05-08 2014-10-07 Kopin Corporation Wireless hands-free computing headset with detachable accessories controllable by motion, body gesture and/or vocal commands
WO2010129679A1 (en) 2009-05-08 2010-11-11 Kopin Corporation Remote control of host application using motion and voice commands
JP2009179062A (en) 2009-05-14 2009-08-13 Seiko Epson Corp Exposure device and image forming apparatus
US9529437B2 (en) 2009-05-26 2016-12-27 Dp Technologies, Inc. Method and apparatus for a motion state aware device
US8581856B2 (en) 2009-05-27 2013-11-12 Microsoft Corporation Touch sensitive display apparatus using sensor input
CN102484730A (en) 2009-06-04 2012-05-30 寇平公司 3d video processor integrated with head mounted display
US9503555B2 (en) 2009-10-21 2016-11-22 Symbol Technologies, Llc Mounting device couplable to a human head
US20110090135A1 (en) 2009-10-21 2011-04-21 Symbol Technologies, Inc. Interchangeable display device for a head-mounted display system
EP2494388B1 (en) 2009-10-27 2018-11-21 DigiLens Inc. Compact holographic eyeglass display
US8279861B2 (en) 2009-12-08 2012-10-02 International Business Machines Corporation Real-time VoIP communications using n-Way selective language processing
US20110214082A1 (en) 2010-02-28 2011-09-01 Osterhout Group, Inc. Projection triggering through an external marker in an augmented reality eyepiece
AU2011220382A1 (en) 2010-02-28 2012-10-18 Microsoft Corporation Local advertising content on an interactive head-mounted eyepiece
US20120056846A1 (en) 2010-03-01 2012-03-08 Lester F. Ludwig Touch-based user interfaces employing artificial neural networks for hdtp parameter and symbol derivation
GB2478738A (en) 2010-03-16 2011-09-21 Belron Hungary Kft Zug Branch Eye level display in communication with electronic device
JP5564300B2 (en) 2010-03-19 2014-07-30 富士フイルム株式会社 Head mounted augmented reality video presentation device and virtual display object operating method thereof
JP5499854B2 (en) 2010-04-08 2014-05-21 ソニー株式会社 Optical position adjustment method for head mounted display
US8982160B2 (en) 2010-04-16 2015-03-17 Qualcomm, Incorporated Apparatus and methods for dynamically correlating virtual keyboard dimensions to user finger size
US8545013B2 (en) 2010-04-27 2013-10-01 Kopin Corporation Wearable electronic display
US20150279354A1 (en) 2010-05-19 2015-10-01 Google Inc. Personalization and Latency Reduction for Voice-Activated Commands
JP2012002568A (en) 2010-06-15 2012-01-05 Brother Ind Ltd Navigation system, portable apparatus and program for portable apparatus
JP5630141B2 (en) 2010-08-18 2014-11-26 ブラザー工業株式会社 Image display system, computer program for portable information processing apparatus included in image display system, head mounted display included in image display system, and image display method
EP2437163A1 (en) 2010-09-09 2012-04-04 Harman Becker Automotive Systems GmbH User interface for a vehicle system
US10013976B2 (en) 2010-09-20 2018-07-03 Kopin Corporation Context sensitive overlays in voice controlled headset computer displays
US8706170B2 (en) 2010-09-20 2014-04-22 Kopin Corporation Miniature communications gateway for head mounted display
US9377862B2 (en) 2010-09-20 2016-06-28 Kopin Corporation Searchlight navigation using headtracker to reveal hidden or extra document data
US9122307B2 (en) 2010-09-20 2015-09-01 Kopin Corporation Advanced remote control of host application using motion and voice commands
US9316827B2 (en) 2010-09-20 2016-04-19 Kopin Corporation LifeBoard—series of home pages for head mounted displays (HMD) that respond to head tracking
US8862186B2 (en) 2010-09-21 2014-10-14 Kopin Corporation Lapel microphone micro-display system incorporating mobile information access system
WO2012040386A1 (en) 2010-09-21 2012-03-29 4Iiii Innovations Inc. Head-mounted peripheral vision display systems and methods
US20120110456A1 (en) 2010-11-01 2012-05-03 Microsoft Corporation Integrated voice command modal user interface
US8994610B2 (en) 2010-11-08 2015-03-31 Symbol Technologies, Inc. User configurable headset
US8184983B1 (en) 2010-11-12 2012-05-22 Google Inc. Wireless directional identification and subsequent communication between wearable electronic devices
WO2012087900A2 (en) 2010-12-20 2012-06-28 Bio-Nexus Ltd. System and method for mobile workflow processing
US8290669B2 (en) 2010-12-29 2012-10-16 Honda Motor Co., Ltd. System and method for controlling an engine
US20120188245A1 (en) 2011-01-20 2012-07-26 Apple Inc. Display resolution increase with mechanical actuation
JP5977922B2 (en) 2011-02-24 2016-08-24 セイコーエプソン株式会社 Information processing apparatus, information processing apparatus control method, and transmissive head-mounted display apparatus
CN109116985A (en) 2011-05-10 2019-01-01 寇平公司 The method that control information is shown
US9442290B2 (en) 2012-05-10 2016-09-13 Kopin Corporation Headset computer operation using vehicle sensor feedback for remote control vehicle
US20120302288A1 (en) 2011-05-23 2012-11-29 Joe Born Cellular Telephone Docking Interface
US9131296B2 (en) 2011-09-19 2015-09-08 Apple Inc. Auto-configuring audio output for audio performance and fault detection
WO2013101438A1 (en) 2011-12-29 2013-07-04 Kopin Corporation Wireless hands-free computing head mounted video eyewear for local/remote diagnosis and repair
US8577427B2 (en) 2012-03-08 2013-11-05 Lee Serota Headset with adjustable display and integrated computing system
US8818606B2 (en) 2012-04-16 2014-08-26 GM Global Technology Operations LLC System and method for vehicle lateral control
US8929954B2 (en) 2012-04-25 2015-01-06 Kopin Corporation Headset computer (HSC) as auxiliary display with ASR and HT input
CN104303177B (en) 2012-04-25 2018-08-17 寇平公司 Execute the method and earphone computing device of real-time phonetic translation
US9436220B2 (en) 2012-05-04 2016-09-06 Jpmorgan Chase Bank, N.A. System and method for mobile device docking station
US9100757B2 (en) 2012-07-02 2015-08-04 Apple Inc. Headset impedance detection
US9099967B2 (en) 2012-09-28 2015-08-04 Apple Inc. Increasing ground noise rejection in audio systems
US9319019B2 (en) 2013-02-11 2016-04-19 Symphonic Audio Technologies Corp. Method for augmenting a listening experience
US9301085B2 (en) 2013-02-20 2016-03-29 Kopin Corporation Computer headset with detachable 4G radio
US9548047B2 (en) 2013-07-31 2017-01-17 Google Technology Holdings LLC Method and apparatus for evaluating trigger phrase enrollment

Patent Citations (5)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US20030046401A1 (en) * 2000-10-16 2003-03-06 Abbott Kenneth H. Dynamically determing appropriate computer user interfaces
US20050114140A1 (en) * 2003-11-26 2005-05-26 Brackett Charles C. Method and apparatus for contextual voice cues
US20130001918A1 (en) * 2005-11-14 2013-01-03 Santa Cruz Bicycles, Inc. Bicycle rear suspension system with controlled variable shock rate
US20080120141A1 (en) * 2006-11-22 2008-05-22 General Electric Company Methods and systems for creation of hanging protocols using eye tracking and voice command and control
US20120089392A1 (en) * 2010-10-07 2012-04-12 Microsoft Corporation Speech recognition user interface

Cited By (1)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US10474418B2 (en) 2008-01-04 2019-11-12 BlueRadios, Inc. Head worn wireless computer having high-resolution display suitable for use as a mobile internet device

Also Published As

Publication number Publication date
US20130231937A1 (en) 2013-09-05
US10013976B2 (en) 2018-07-03

Similar Documents

Publication Publication Date Title
KR101252169B1 (en) Mobile terminal and operation control method thereof
EP2872945B1 (en) A head mounted dipslay and method of outputting a content using the same
US9204397B2 (en) On-head detection for head-mounted display
US8355914B2 (en) Mobile terminal and method for correcting text thereof
CN103890836B (en) The bluetooth with power management or other wave points for head mounted display
CN102812417B (en) The wireless hands-free with the detachable accessory that can be controlled by motion, body gesture and/or verbal order calculates headset
US10133438B2 (en) User interface for augmented reality
KR20100047719A (en) Terminal and method for controlling the same
US20130027572A1 (en) Head-Mounted Display That Displays A Visual Representation Of Physical Interaction With An Input Interface Located Outside Of The Field Of View
US20130021374A1 (en) Manipulating And Displaying An Image On A Wearable Computing System
US8825468B2 (en) Mobile wireless display providing speech to speech translation and avatar simulating human attributes
KR20140112910A (en) Input controlling Method and Electronic Device supporting the same
US10514758B2 (en) Visibility improvement method based on eye tracking, machine-readable storage medium and electronic device
KR20110035563A (en) Mobile terminal and operation control method thereof
KR20110123142A (en) Operating a mobile termianl with a vibration module
KR20150026336A (en) Wearable display device and method of outputting content thereof
KR20140052294A (en) Method for providing user with virtual image in head-mounted display device, machine-readable storage medium and head-mounted display device
KR20140138178A (en) Eye tracking based selectively backlighting a display
EP3435373A1 (en) Mobile wireless display providing speech to speech translation and avatar simulating human attributes
JP2012510659A (en) Portable electronic device and method with shared visual content sharing control function
US9959129B2 (en) Headless task completion within digital personal assistants
KR20150058286A (en) Leveraging head mounted displays to enable person-to-person interactions
US20150143283A1 (en) Information processing device, display control method, and program
KR20120001476A (en) Mobile terminal and operation control method thereof
KR20150125554A (en) Mobile terminal and method for controlling the same

Legal Events

Date Code Title Description
AS Assignment

Owner name: IKANOS CONSULTING LTD, UNITED KINGDOM

Free format text: ASSIGNMENT OF ASSIGNORS INTEREST;ASSIGNOR:WOODALL, JAMES;REEL/FRAME:046564/0878

Effective date: 20130412

Owner name: KOPIN CORPORATION, MASSACHUSETTS

Free format text: ASSIGNMENT OF ASSIGNORS INTEREST;ASSIGNOR:IKANOS CONSULTING LTD;REEL/FRAME:046564/0854

Effective date: 20130208

Owner name: KOPIN CORPORATION, MASSACHUSETTS

Free format text: ASSIGNMENT OF ASSIGNORS INTEREST;ASSIGNOR:PARKINSON, CHRISTOPHER;REEL/FRAME:046565/0040

Effective date: 20140113

STCB Information on status: application discontinuation

Free format text: FINAL REJECTION MAILED

STCB Information on status: application discontinuation

Free format text: ABANDONED -- FAILURE TO RESPOND TO AN OFFICE ACTION