US20150324568A1 - Systems and methods for using eye signals with secure mobile communications - Google Patents

Systems and methods for using eye signals with secure mobile communications Download PDF

Info

Publication number
US20150324568A1
US20150324568A1 US14/708,229 US201514708229A US2015324568A1 US 20150324568 A1 US20150324568 A1 US 20150324568A1 US 201514708229 A US201514708229 A US 201514708229A US 2015324568 A1 US2015324568 A1 US 2015324568A1
Authority
US
United States
Prior art keywords
eye
data
user
state
processors
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Abandoned
Application number
US14/708,229
Other languages
English (en)
Inventor
Nelson George Publicover
Lewis James Marggraff
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
Google LLC
Original Assignee
Eyefluence Inc
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Eyefluence Inc filed Critical Eyefluence Inc
Priority to US14/708,229 priority Critical patent/US20150324568A1/en
Publication of US20150324568A1 publication Critical patent/US20150324568A1/en
Priority to US15/237,581 priority patent/US10564714B2/en
Assigned to EYEFLUENCE, INC. reassignment EYEFLUENCE, INC. ASSIGNMENT OF ASSIGNORS INTEREST (SEE DOCUMENT FOR DETAILS). Assignors: DRAKE, ELIOT FRANCIS, MARGGRAFF, LEWIS JAMES, PUBLICOVER, NELSON GEORGE
Assigned to GOOGLE INC. reassignment GOOGLE INC. ASSIGNMENT OF ASSIGNORS INTEREST (SEE DOCUMENT FOR DETAILS). Assignors: EYEFLUENCE, INC.
Assigned to GOOGLE LLC reassignment GOOGLE LLC CHANGE OF NAME Assignors: GOOGLE INC.
Abandoned legal-status Critical Current

Links

Images

Classifications

    • G—PHYSICS
    • G06—COMPUTING OR CALCULATING; COUNTING
    • G06F—ELECTRIC DIGITAL DATA PROCESSING
    • G06F3/00—Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
    • G06F3/01—Input arrangements or combined input and output arrangements for interaction between user and computer
    • G06F3/011—Arrangements for interaction with the human body, e.g. for user immersion in virtual reality
    • G06F3/013—Eye tracking input arrangements
    • G—PHYSICS
    • G02—OPTICS
    • G02B—OPTICAL ELEMENTS, SYSTEMS OR APPARATUS
    • G02B27/00—Optical systems or apparatus not provided for by any of the groups G02B1/00 - G02B26/00, G02B30/00
    • G02B27/0093—Optical systems or apparatus not provided for by any of the groups G02B1/00 - G02B26/00, G02B30/00 with means for monitoring data relating to the user, e.g. head-tracking, eye-tracking
    • G—PHYSICS
    • G02—OPTICS
    • G02B—OPTICAL ELEMENTS, SYSTEMS OR APPARATUS
    • G02B27/00—Optical systems or apparatus not provided for by any of the groups G02B1/00 - G02B26/00, G02B30/00
    • G02B27/01—Head-up displays
    • G02B27/017—Head mounted
    • G—PHYSICS
    • G02—OPTICS
    • G02B—OPTICAL ELEMENTS, SYSTEMS OR APPARATUS
    • G02B27/00—Optical systems or apparatus not provided for by any of the groups G02B1/00 - G02B26/00, G02B30/00
    • G02B27/01—Head-up displays
    • G02B27/017—Head mounted
    • G02B27/0172—Head mounted characterised by optical features
    • G—PHYSICS
    • G06—COMPUTING OR CALCULATING; COUNTING
    • G06F—ELECTRIC DIGITAL DATA PROCESSING
    • G06F21/00—Security arrangements for protecting computers, components thereof, programs or data against unauthorised activity
    • G06F21/30—Authentication, i.e. establishing the identity or authorisation of security principals
    • G06F21/31—User authentication
    • G06F21/316—User authentication by observing the pattern of computer usage, e.g. typical user behaviour
    • G—PHYSICS
    • G06—COMPUTING OR CALCULATING; COUNTING
    • G06F—ELECTRIC DIGITAL DATA PROCESSING
    • G06F21/00—Security arrangements for protecting computers, components thereof, programs or data against unauthorised activity
    • G06F21/30—Authentication, i.e. establishing the identity or authorisation of security principals
    • G06F21/31—User authentication
    • G06F21/32—User authentication using biometric data, e.g. fingerprints, iris scans or voiceprints
    • G—PHYSICS
    • G06—COMPUTING OR CALCULATING; COUNTING
    • G06F—ELECTRIC DIGITAL DATA PROCESSING
    • G06F21/00—Security arrangements for protecting computers, components thereof, programs or data against unauthorised activity
    • G06F21/60—Protecting data
    • G06F21/64—Protecting data integrity, e.g. using checksums, certificates or signatures
    • G—PHYSICS
    • G06—COMPUTING OR CALCULATING; COUNTING
    • G06F—ELECTRIC DIGITAL DATA PROCESSING
    • G06F3/00—Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
    • G06F3/01—Input arrangements or combined input and output arrangements for interaction between user and computer
    • G06F3/011—Arrangements for interaction with the human body, e.g. for user immersion in virtual reality
    • G06F3/012—Head tracking input arrangements
    • G—PHYSICS
    • G06—COMPUTING OR CALCULATING; COUNTING
    • G06F—ELECTRIC DIGITAL DATA PROCESSING
    • G06F3/00—Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
    • G06F3/01—Input arrangements or combined input and output arrangements for interaction between user and computer
    • G06F3/017—Gesture based interaction, e.g. based on a set of recognized hand gestures
    • G—PHYSICS
    • G06—COMPUTING OR CALCULATING; COUNTING
    • G06F—ELECTRIC DIGITAL DATA PROCESSING
    • G06F3/00—Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
    • G06F3/01—Input arrangements or combined input and output arrangements for interaction between user and computer
    • G06F3/03—Arrangements for converting the position or the displacement of a member into a coded form
    • G06F3/0304—Detection arrangements using opto-electronic means
    • G—PHYSICS
    • G06—COMPUTING OR CALCULATING; COUNTING
    • G06F—ELECTRIC DIGITAL DATA PROCESSING
    • G06F3/00—Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
    • G06F3/01—Input arrangements or combined input and output arrangements for interaction between user and computer
    • G06F3/048—Interaction techniques based on graphical user interfaces [GUI]
    • G06F3/0481—Interaction techniques based on graphical user interfaces [GUI] based on specific properties of the displayed interaction object or a metaphor-based environment, e.g. interaction with desktop elements like windows or icons, or assisted by a cursor's changing behaviour or appearance
    • G06F3/04817—Interaction techniques based on graphical user interfaces [GUI] based on specific properties of the displayed interaction object or a metaphor-based environment, e.g. interaction with desktop elements like windows or icons, or assisted by a cursor's changing behaviour or appearance using icons
    • G—PHYSICS
    • G06—COMPUTING OR CALCULATING; COUNTING
    • G06F—ELECTRIC DIGITAL DATA PROCESSING
    • G06F3/00—Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
    • G06F3/01—Input arrangements or combined input and output arrangements for interaction between user and computer
    • G06F3/048—Interaction techniques based on graphical user interfaces [GUI]
    • G06F3/0481—Interaction techniques based on graphical user interfaces [GUI] based on specific properties of the displayed interaction object or a metaphor-based environment, e.g. interaction with desktop elements like windows or icons, or assisted by a cursor's changing behaviour or appearance
    • G06F3/0482—Interaction with lists of selectable items, e.g. menus
    • G—PHYSICS
    • G06—COMPUTING OR CALCULATING; COUNTING
    • G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
    • G06T19/00—Manipulating three-dimensional [3D] models or images for computer graphics
    • G06T19/006—Mixed reality
    • G—PHYSICS
    • G06—COMPUTING OR CALCULATING; COUNTING
    • G06V—IMAGE OR VIDEO RECOGNITION OR UNDERSTANDING
    • G06V40/00—Recognition of biometric, human-related or animal-related patterns in image or video data
    • G06V40/10—Human or animal bodies, e.g. vehicle occupants or pedestrians; Body parts, e.g. hands
    • G06V40/18—Eye characteristics, e.g. of the iris
    • G—PHYSICS
    • G06—COMPUTING OR CALCULATING; COUNTING
    • G06V—IMAGE OR VIDEO RECOGNITION OR UNDERSTANDING
    • G06V40/00—Recognition of biometric, human-related or animal-related patterns in image or video data
    • G06V40/10—Human or animal bodies, e.g. vehicle occupants or pedestrians; Body parts, e.g. hands
    • G06V40/18—Eye characteristics, e.g. of the iris
    • G06V40/19—Sensors therefor
    • G—PHYSICS
    • G06—COMPUTING OR CALCULATING; COUNTING
    • G06V—IMAGE OR VIDEO RECOGNITION OR UNDERSTANDING
    • G06V40/00—Recognition of biometric, human-related or animal-related patterns in image or video data
    • G06V40/10—Human or animal bodies, e.g. vehicle occupants or pedestrians; Body parts, e.g. hands
    • G06V40/18—Eye characteristics, e.g. of the iris
    • G06V40/193—Preprocessing; Feature extraction
    • G—PHYSICS
    • G06—COMPUTING OR CALCULATING; COUNTING
    • G06V—IMAGE OR VIDEO RECOGNITION OR UNDERSTANDING
    • G06V40/00—Recognition of biometric, human-related or animal-related patterns in image or video data
    • G06V40/10—Human or animal bodies, e.g. vehicle occupants or pedestrians; Body parts, e.g. hands
    • G06V40/18—Eye characteristics, e.g. of the iris
    • G06V40/197—Matching; Classification
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04L—TRANSMISSION OF DIGITAL INFORMATION, e.g. TELEGRAPHIC COMMUNICATION
    • H04L63/00—Network architectures or network communication protocols for network security
    • H04L63/08—Network architectures or network communication protocols for network security for authentication of entities
    • H04L63/0861—Network architectures or network communication protocols for network security for authentication of entities using biometrical features, e.g. fingerprint, retina-scan
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N23/00—Cameras or camera modules comprising electronic image sensors; Control thereof
    • H04N23/90—Arrangement of cameras or camera modules, e.g. multiple cameras in TV studios or sports stadiums
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N5/00—Details of television systems
    • H04N5/44—Receiver circuitry for the reception of television signals according to analogue transmission standards
    • H04N5/445—Receiver circuitry for the reception of television signals according to analogue transmission standards for displaying additional information
    • H04N5/44504—Circuit details of the additional information generator, e.g. details of the character or graphics signal generator, overlay mixing circuits
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04W—WIRELESS COMMUNICATION NETWORKS
    • H04W12/00—Security arrangements; Authentication; Protecting privacy or anonymity
    • H04W12/06—Authentication
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04W—WIRELESS COMMUNICATION NETWORKS
    • H04W12/00—Security arrangements; Authentication; Protecting privacy or anonymity
    • H04W12/06—Authentication
    • H04W12/065—Continuous authentication
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04W—WIRELESS COMMUNICATION NETWORKS
    • H04W12/00—Security arrangements; Authentication; Protecting privacy or anonymity
    • H04W12/30—Security of mobile devices; Security of mobile applications
    • H04W12/33—Security of mobile devices; Security of mobile applications using wearable devices, e.g. using a smartwatch or smart-glasses
    • G—PHYSICS
    • G02—OPTICS
    • G02B—OPTICAL ELEMENTS, SYSTEMS OR APPARATUS
    • G02B27/00—Optical systems or apparatus not provided for by any of the groups G02B1/00 - G02B26/00, G02B30/00
    • G02B27/01—Head-up displays
    • G02B27/0101—Head-up displays characterised by optical features
    • G02B2027/0138—Head-up displays characterised by optical features comprising image capture systems, e.g. camera
    • G—PHYSICS
    • G02—OPTICS
    • G02B—OPTICAL ELEMENTS, SYSTEMS OR APPARATUS
    • G02B27/00—Optical systems or apparatus not provided for by any of the groups G02B1/00 - G02B26/00, G02B30/00
    • G02B27/01—Head-up displays
    • G02B27/0101—Head-up displays characterised by optical features
    • G02B2027/014—Head-up displays characterised by optical features comprising information/image processing systems
    • G—PHYSICS
    • G02—OPTICS
    • G02B—OPTICAL ELEMENTS, SYSTEMS OR APPARATUS
    • G02B27/00—Optical systems or apparatus not provided for by any of the groups G02B1/00 - G02B26/00, G02B30/00
    • G02B27/01—Head-up displays
    • G02B27/017—Head mounted
    • G02B2027/0178—Eyeglass type
    • G—PHYSICS
    • G06—COMPUTING OR CALCULATING; COUNTING
    • G06F—ELECTRIC DIGITAL DATA PROCESSING
    • G06F2203/00—Indexing scheme relating to G06F3/00 - G06F3/048
    • G06F2203/01—Indexing scheme relating to G06F3/01
    • G06F2203/011—Emotion or mood input determined on the basis of sensed human body parameters such as pulse, heart rate or beat, temperature of skin, facial expressions, iris, voice pitch, brain activity patterns

Definitions

  • the present invention relates to portable or wearable biometric base user identification and authentication for secure distributed and interactive systems and services.
  • nonrepudiation involves associating actions or changes to a unique individual.
  • a key card access system it may be desirable to implement a key card access system.
  • Non-repudiation would be violated if it were not also a strictly enforced policy to prohibit sharing of the key cards and to immediately report lost or stolen cards. Otherwise determining who performed the action of opening the door cannot be trivially determined.
  • the individual owner of the account must not allow others to use that account, especially, for instance, by giving away their account's password, and a policy should be implemented to enforce this. This prevents the owner of the account from denying actions performed by the account.
  • the ecosystem is dynamic and rapidly changing, where wireless capability is growing exponentially.
  • Cloud based architectures are becoming more appealing and attainable at manageable costs.
  • the place to start re-thinking is with transitional and end architectures in mind and the placement of what is called a “data abstraction layer.”
  • This abstraction layer is distinguished by data movement defined as data on the move and data at rest; and includes considerations for data generation, data storage, data processing, and the role of the server and browser in the cloud.
  • a first transitional step on the way to the Internet of Things is the emergence of fog computing or fog networking.
  • This is an architecture that uses one smart device, a collaborative multitude of smart devices or near-user edge devices to carry out a substantial amount of processing and storage (rather than stored primarily in cloud data centers), communication (rather than routed over the internet backbone), and control, configuration, measurement, and management rather than controlled primarily by network gateways such as those in the Long Term Evolution (LTE) such as 4-G LTE.
  • LTE Long Term Evolution
  • Fog Networking consists of a control plane and a data plane.
  • fog computing enables computing services to reside at the edge of the network as opposed to servers in a data-center.
  • fog computing emphasizes proximity to end-users and client objectives, resulting in superior user-experience and redundancy in case of failure.
  • Fog Networking supports the IoT, in which most of the devices that are used on a daily basis will be connected to each other. Examples include phones, wearable health monitoring devices, connected vehicle, and augmented reality using devices such as the Google Glass.
  • the ultimate goal of the IoT is to realize connections between objects, objects and persons, all things, and networks for the secure identification, management, and control of data.
  • wearable display devices will challenge traditional computer human machine interaction.
  • Today, computer mice, joysticks, and other manual tracking devices are ubiquitous tools for specifying positional information during human-machine interactions (HMIs).
  • HMIs human-machine interactions
  • wearable computing such bulky and obtrusive devices that, for example, generally require stationary surfaces for proper operation are incompatible with the portable nature of apparatuses that are designed to be worn on the body.
  • Wearable display devices include virtual reality (“VR”) displays such as those manufactured by Sony, Samsung, Oculus, Carl Zeiss; head mounted displays (“HMDs”) such as those produced by Google (e.g., Glass®) and Vuzix; augmented reality (“AR”) displays such as those manufactured by Microsoft, Vuzix, and DigiLens; and similar devices. Eye tracking can be used to view such displays and to specify positional information. However, the eyes are also used extensively during normal human activities.
  • VR virtual reality
  • HMDs head mounted displays
  • AR augmented reality
  • Eye tracking can be used to view such displays and to specify positional information. However, the eyes are also used extensively during normal human activities.
  • data collected from the face, eye(s), or voice constitute unique biometric data of the user or user groups, if desired. These collected data can be used to generate a unique private key in a system of public key and private key cryptography.
  • Cryptographic systems have been widely used for information protection, authentication, and access control for many years and as such are well known in the art of information security.
  • An additional component for the continuous exchange of secure information with a biometrically identified individual is the encryption of all transmitted (i.e., sent or received) data.
  • Data encryption has a long history that pre-dates the electronic computer. A number of well-established methods have been developed to protect the confidentiality, integrity, and authenticity of data. Most encryption techniques make use of one or more secret keys or security codes that can be used to encrypt and/or decipher data streams. Keys used to encode or decipher data streams can originate from a number of sources including previously transmitted data sequences, identification codes embedded during the manufacture of a device, and usage counts.
  • Encryption and deciphering methods that make use of transposition, substitution, repositioning, masking, translation tables, and/or pre-defined numeric sequences are well-known in the art. More sophisticated techniques utilize multiple methods applied to larger blocks (i.e., more than a single character or byte) of information.
  • encryption and deciphering methods that include a processing step within a protected hardware component are generally more protected from attempts at decoding compared to those implemented using software stored on some form of memory device.
  • FPGAs Field-programmable gate arrays
  • ASICs application specific integrated circuits
  • Streicher et al U.S. Pat. No. 8,363,833 and others describe processes whereby even the bit stream used to program an FPGA that can be used for encryption, is itself encrypted. Concealing both security keys and methods to decipher secure information greatly reduces the risk of anyone other than the intended recipient gaining meaningful access to an encrypted data stream.
  • Bluetooth had its origins in 1998 with the release of the 1.0 specification, with a subsequent release in 2000 of what was called 1.0b. These early releases were designed to remove wires from the desktop of a user; these included considerations for serial, headset, cordless phone, and LAN connections. However, these early versions had many problems and manufacturers had difficulty making their products interoperable. Subsequent releases of Bluetooth 1.1, 1.2, and 2.0 included expanded bandwidth, profile capability, and finally, in release 2.1, new levels of security, including what is now called Secure Simple Pairing (SSP).
  • SSP Secure Simple Pairing
  • SSP allows two devices to establish a link key based on a Diffie-Hellman key agreement and supports four methods to authenticate the key agreement.
  • One of these methods called the Passkey Entry method, uses a PIN (i.e., personal identification number) entered on one or both devices.
  • PIN i.e., personal identification number
  • the Passkey Entry method has been shown to leak this PIN to any attacker eavesdropping on the first part of the pairing process. If the attacker can prevent the pairing process to successfully complete and the user uses the same PIN twice (or a fixed PIN is used), the attacker can mount a man-in-the-middle attack on a new run of the pairing process.
  • nonrepudiation generally means an assurance that someone cannot deny something.
  • denial of the ability to ensure the use of a device or communications from a device cannot deny the authenticity of their signature on any use, communications, or messages that a qualified user originates.
  • Eye signals voluntary eye movements that are intended to interact with a computing device are referred to as “eye signals.”
  • Eye signal controls are described in Systems and Methods for Biomechanically-based Eye Signals for Interacting with Real and Virtual Objects [Attorney Docket No. EYE-023], application Ser. No. 14/______, filed May 8, 2015, the entire disclosure of which is expressly incorporated by reference herein.
  • apparatus, systems, and methods are provided for a head-mounted device (HMD) that includes at least one processor connected to at least one imager, where at least one of the imagers is oriented toward the eye(s) of a user.
  • the processor is configured to at least one of substantially continuously, simultaneously, and/or periodically determine eye signal estimation, where the eye signal estimation is determined by the processor using the imager to detect at least one glint from the surface of the eye that has been generated from a light source attached to the HMD or where the imager detects one or more distinctive features of the eye; and determine biometric data of a user including facial features, voice, or iris data of a user, where the biometric data is used for the identification and authentication of the user for access and control of at least one of the HMD, a connected device, a wireless device, and a remote server.
  • apparatus, systems, and methods may substantially continuously, periodically, and/or on demand perform iris recognition utilizing a head-mounted device.
  • Biometric identification during the formation of eye-signal controls may be used within a wide range of applications in which user identification and/or authentication are required in real time.
  • systems and methods are disclosed in which eye-signal control sequences are used for authentication of a user for at least one of withdrawing money from an automated teller machine (ATM) and making online purchases.
  • ATM automated teller machine
  • Another embodiment discloses systems and methods to authenticate a user for online activities including at least one of private, group, or other testing, complying with performance requirements coupled with identity for various forms of employment such as professional driving, piloting, or other transportation, logging hours, confirming acknowledgement to informed consent provided orally or read by a user whereupon continuous confirmation of identity during saccadic and other eye-based movements during reading, and confirming acknowledgement of any legally binding agreement.
  • Another embodiment discloses systems and methods for combining identifying characteristics with other security tokens including at least one of information tokens (passwords), physical tokens (keys), produced tokens (speech, gestures, writing), and other biometric tokens such as fingerprint and voiceprint.
  • Another embodiment discloses systems and methods that describe a plurality of system configurations, including:
  • Another embodiment discloses systems and methods for capturing an image of the iris, or a locally generated irisCode (e.g., as described in Systems and Methods for Discerning Eye Signals and Continuous Biometric Identification, filed May 8, 2015) from the iris image, and transmit the iris information to the cloud for authentication of any HMD.
  • a locally generated irisCode e.g., as described in Systems and Methods for Discerning Eye Signals and Continuous Biometric Identification, filed May 8, 2015
  • Another embodiment discloses systems and methods that replace or augment common password-based access to computing devices.
  • Another embodiment discloses systems and methods to use a specific implementation of the continuous biometric identification (CBID) approach (e.g., as described in Systems and Methods for Discerning Eye Signals and Continuous Biometric Identification, filed May 8, 2015) to “buy at the aisle” by using eye-signal methods or processes referred to as “look to buy.”
  • CBID continuous biometric identification
  • Another embodiment discloses systems and methods for displaying (on an HMD or remote display device) information, including cost, about the item.
  • Another embodiment discloses systems and methods for object recognition used to identify items for purchase that are simply viewed within the environment of the user.
  • Another embodiment discloses systems and methods that establish a true identity of a user wearing the HMD.
  • Another embodiment discloses systems and methods that prevent user identity fraud and identity theft.
  • Another embodiment discloses systems and methods that use the HMD to authenticate users for at least one of educational or legal purposes.
  • Another embodiment discloses systems and methods that use the HMD for the purpose of authenticating a purchase, where the authenticated purchase is for online purchase security and offline purchase security, where offline includes at a retail establishment.
  • Another embodiment discloses systems and methods that use the HMD that includes a second imager connected to the processor oriented outward from the HMD, where the second imager detects a code that can be decoded by the processor, where the code is one of a bar code and a QR (i.e., quick response) code and where the processor decoded data represents information about a product.
  • a code that can be decoded by the processor
  • QR i.e., quick response
  • Another embodiment discloses systems and methods that use the information related to a product to allow an authenticated user to securely purchase the product.
  • Another embodiment discloses systems and methods that allow an entity to initiate a secure communication channel with another entity by mutual gaze where the security of the communication channel may be established prior to communication and may be revalidated continuously or at intervals during communication.
  • Another embodiment discloses systems and methods that enable a secure protocol for coordination among parties to cause an action to occur whereupon each party performs some action during which time their identities are substantially continuously verified with CBID.
  • Another embodiment discloses systems and methods that increase security when using a HMD device by limiting access to functional blocks in a silicon chip that supports eye-tracking for the HMD device.
  • Another embodiment discloses systems and methods that manage, coordinate, filter, and/or sequence the stimulus provided by one or more wearable devices associated with the identity of a user.
  • systems and methods include a dynamically evolving cognitive architecture for a system based on interpreting the gaze-based intent of a user. Natural eye movement is interpreted by the system, and used for real-time image services.
  • An illumination device comprising a processor and a camera is worn by the user, with the camera aimed toward an eye of the user.
  • the system includes memory with stored instructions. When the instructions are executed the system receives eye measurement data from the camera aimed at the user's eye. The data is used to determine a first state of the eye, and compare it to data captured from a second state of the eye. When the system determines that the first and second states of the eye are the same, further instructions are sent to at least one processor in the system.
  • Applicant(s) herein expressly incorporate(s) by reference all of the following materials identified in each numbered paragraph below.
  • the incorporated materials are not necessarily “prior art” and Applicant(s) expressly reserve(s) the right to swear behind any of the incorporated materials.
  • noun, term, or phrase is intended to be further characterized, specified, or narrowed in some way, then such noun, term, or phrase will expressly include additional adjectives, descriptive terms, or other modifiers in accordance with the normal precepts of English grammar. Absent the use of such adjectives, descriptive terms, or modifiers, it is the intent that such nouns, terms, or phrases be given their plain, and ordinary English meaning to those skilled in the applicable arts as set forth above.
  • FIG. 1 is a front view of a human eye.
  • FIG. 2 is a section view of a human eye from the side.
  • FIG. 3A depicts a top down view of an eye showing the regions of vision.
  • FIG. 3B shows an example approximation of the sizes of the regions of vision.
  • FIG. 4 depicts overall system architecture.
  • FIG. 5 depicts architecture of the eye signal object.
  • FIG. 6 depicts abstracted hardware.
  • FIG. 7 depicts typical Bluetooth architecture.
  • FIG. 8 depicts hardware interface and hardware components.
  • FIG. 9 depicts imaging architecture.
  • FIG. 10 depicts biometric data generation.
  • FIG. 11 depicts a breakdown of a cognitive load manager.
  • FIG. 12 depicts system components of the cognitive load manager.
  • FIG. 13 depicts a HMD (head mounted device) connecting to a mobile device.
  • FIG. 14 depicts a HMD connecting to the cloud.
  • FIG. 15 depicts a HMD connecting to home and vehicle controls.
  • FIG. 16 depicts communication between a HMD and a NESTTM thermostat system.
  • FIG. 17 shows system architecture on a HMD communicating with the cloud.
  • FIG. 18 depicts a breakdown of the data manager.
  • FIG. 19 shows the system architecture of a HMD with the processing capabilities moved to the cloud.
  • FIG. 20 shows further evolution of a HMD towards the Internet of Things.
  • FIG. 21 depicts the system architecture from a HMD moved to a remote server.
  • FIG. 22 depicts a HMD with all processing pulled off to the cloud.
  • FIG. 23 depicts a HMD and the remote server communicating.
  • FIG. 24 depicts a HMD communicating with home control systems.
  • FIG. 25 depicts a HMD communicating with social media.
  • FIG. 26 depicts a HMD communicating with home entertainment systems.
  • FIG. 27 depicts a HMD communicating with vehicle entertainment systems.
  • FIG. 28 depicts a HMD communicating with vehicle control systems.
  • FIG. 29 is a flow chart of steps taken to perform an online, secure purchase.
  • FIGS. 1 and 2 generally depict the anatomy of the human eye 100 .
  • FIG. 1 is a front view of the eye 100 showing the pupil 145 , iris 115 , sclera 150 , limbus 245 , pupil/iris boundary 250 , upper eyelid 105 , lower eyelid 110 , and eyelashes 235 .
  • FIG. 2 is section view of the eye 100 showing the pupil 145 , iris 115 , retina 52 , sclera 150 , fovea 160 , lens 165 , and cornea 170 .
  • the pupil 145 is the approximately round dark portion at the center of the eye that expands and contracts to regulate the light the retina 52 receives.
  • the iris 115 is the colored portion of the eye 100 that surrounds and controls the expansion and contraction of the pupil 145 .
  • the sclera 150 is the white region of the eye 100 that surrounds the iris 115 .
  • the sclera 150 contains blood vessels and other identifiable markers.
  • the limbus 245 is the outer edge of the iris 115 next to the sclera 150 .
  • the pupil/iris boundary 250 is where the pupil 145 and the iris 115 meet.
  • the eyelids 105 , 110 and the eyelashes 235 surround and occasionally partially cover or obscure portions of the eye 100 during blinks, eye closures, or different angles of viewing.
  • the retina 52 is the sensory membrane that lines the eye 100 that receives images from the lens 165 and converts them into signals for the brain.
  • the fovea 160 is an indentation in the retina 52 that contains only cones (no rods) and provides particularly acute vision.
  • the lens 165 is the nearly spherical body of the eye 100 behind the cornea 170 that focuses light onto the retina 52 .
  • the cornea 170 is the clear part of the eye covering the iris 115 , pupil 145 , and the lens 165 .
  • FIGS. 3A and 3B depict the foveal, parafoveal, and peripheral ranges of vision.
  • the foveal region 190 is about two degrees outward from a user's gaze point. An approximation of this region is a US penny held at an adult's arm length.
  • the parafoveal range 195 is the viewable area outside the foveal region 190 , generally from two to ten degrees from a user's gaze point. An approximation of the ten degree parafoveal visual field is a circle with a four-inch diameter held at an adult's arm length.
  • the peripheral region 197 is outside of the parafoveal region 195 and is generally from ten to thirty degrees out.
  • FIG. 4 depicts an overall system architecture, including a processor 1035 with non-volatile flash memory 1050 , D-RAM memory 1040 , a hardware abstraction layer (HAL) 1030 , and physical connections 1235 to external hardware, an operating system (OS) 1025 , and software and/or firmware 1000 that handles the middleware services for the HMD that operates as a Visual Disambiguation Service (VDS) interface termed IRIS (Interface for Real-time Image Services) for the HMD and is operable as a software control object.
  • VDS Visual Disambiguation Service
  • middleware services is a software layer 1015 containing software to facilitate the software integration of the IRIS object with a third party application; also above the middleware services is a set of software tools 1020 used for third party hardware integration and debug, including operations like single stepping and break-pointing through the Joint Test Action Group (JTAG)—supported by the IEEE 1149.1 Standard Test Access Port and Boundary-Scan Architecture.
  • software tools and integration layer is an application programming interface (API) 1010 , followed by applications 1005 .
  • API application programming interface
  • the system includes public 1635 and private key generators 1630 for added security.
  • FIG. 5 depicts the overall system architecture including software blocks identified as a power manager 1140 and device manager 1120 .
  • Power management schemes are derived from one or more open standards such as the Advanced Configuration and Power Interface (ACPI).
  • ACPI Advanced Configuration and Power Interface
  • the ACPI has three main components: the ACPI tables, the ACPI BIOS and the ACPI registers. Unlike its predecessors, like the APM or PnP BIOS, the ACPI implements little of its functionality in the ACPI BIOS code, whose main role is to load the ACPI tables in system memory. Instead, most of the firmware ACPI functionality is provided in ACPI Machine Language (AML) bytecode stored in the ACPI tables. To make use of these tables, the operating system must have an interpreter for the AML bytecode. A reference AML interpreter implementation is provided by the ACPI Component Architecture (ACPICA). At the BIOS development time, AML code is compiled from the ASL (ACPI Source Language) code. To date, the most recent release of the ACPI standard was in 2011 .
  • ACPICA ACPI Component Architecture
  • the systems of the future may implement without an operating system and robust support.
  • a power management scheme and ACPI elements discussed above will need to be pulled up to an application control level, giving the application and user dynamic control of the power scheme.
  • the ACPI might implement in a split or distributed fashion. This current standard does not fully anticipate the challenges of wearable computing devices like an HMD disclosed in this specification; therefore additional considerations for operating HMD systems in multiple modes is disclosed.
  • An HMD may include a low-power mode of operation that may be deployed during times when no eyes are detected. This typically occurs when the user removes the headwear or when the headwear has shifted out of place on a user's head. This functionality could be implemented in silicon as a system on a chip (SOC).
  • SOC system on a chip
  • the device can be re-mounted by the original user or worn by a new user.
  • the device For purposes of device calibration (e.g., to account for anatomical variations among individuals) and/or user authentication, it is desirable for the device to be capable of determining the identity of registered users when re-mounted or re-deployed. This can include loading a new set of configuration/calibration parameters and differentiating identities between the previous and new user; including halting, pausing and/or concealing the outputs of any ongoing programs launched by the previous user.
  • OSPM Operating System Power Management
  • hardware drivers 1197 which each in turn impacts the system, device, and processor states; and these are managed globally as Power States and these include Global States, Device States, Processor States, and Performance States.
  • Power consumption is an omnipresent concern, particularly if the device is not worn for an extended period.
  • a commonly deployed solution to this issue is an “off” switch that completely powers down an electronic device.
  • the time and inconvenience of “powering up” a headset device is restrictive particularly, for example, if the device has only been removed from the head momentarily.
  • Low-power HMD and eye-signal control anticipates these issues by using at least one technique comprising:
  • This specific dedicated hardware can utilize modern methods of “hybrid” chip manufacturing that can segment a portion of circuitry to operate in an extremely low power mode.
  • This hybrid circuitry effectively builds a “firewall,” preventing an unauthorized user from fully powering up or utilizing a device.
  • Low-power HMD modes are when a low-battery state is sensed. Instead of running a device until all global functions cease, a “graceful degradation” model is implemented as part of the new class of Power State for HMDs. “Graceful degradation” can include algorithmic approaches by limiting the use of more power-hungry (i.e., generally more sophisticated) image processing and other routines; as well as any number of the hybrid and hardware approaches to reduce power while maintaining at least partial functionality, discussed above. Low-power modes for the processor and critical operations continue until the battery finally runs out of power, the unit is plugged into a central power source, or the device is placed sufficiently close to an inductive charging station.
  • FPGAs field-programmable gate arrays
  • ASICs application-specific integrated circuits
  • CPLDs complex programmable logic devices
  • SoC system-on-chip
  • Embedded or distributed processing can facilitate existing, CPU-based approaches by off-loading computationally intensive routines.
  • Hardware dedicated to performing these routines can be faster (often requiring only one, or just a few, clock cycles) and utilize less power (often by greater than an order of magnitude).
  • Distributed processing can also facilitate new algorithmic approaches that are generally not feasible (within time and power-consumption constraints) using CPUs. Distributed processing is particularly valuable within algorithms that require repeated and/or simultaneous application of calculations to be performed on large data sets such as video images. These are further discussed below in the sub-section Distributed Processing.
  • Another embodiment utilizes low-power distributed processing to detect whether the device has been removed from the head.
  • the device In order to implement an “instant on” capability, the device must “sense” whether it is mounted on the wearer's head or has been removed.
  • a method to perform this function is to determine if an eye can be viewed within eye-tracking camera images.
  • power consumption can be reduced when the device is not in use (i.e. removed from the head) by a reduced frame rate, low resolution imaging, lower CPU clock rate, etc.
  • illumination can be eliminated or reduced by reducing the power of illuminating LEDs, reducing the number of LEDs turned on and/or only turning on illuminator(s) when actually sampling camera images (at reduced frame rates).
  • a substantial reduction in power can also be attained by embedding relatively simple eye geometry detection routines in distributed processing hardware.
  • An example of this is one form of convolution filter to determine if an image (i.e. of an eye) is present is a focus filter.
  • a filter would be classified as a high-pass spatial filter that detects the presence of high spatial contrast edges. The absence of such edges indicates that the device has been removed from the head when a defocused image is generally present (i.e.
  • Another approach is to detect a dark (i.e. pupil) region adjacent to a white (i.e. sclera) region.
  • the device When an in-focus eye is detected, the device “powers up” (recognizing that it was not completely powered off) for higher resolution eye tracking.
  • the device may include a micro electro-mechanical system (MEMS) such as an accelerometer or rate sensor for determining motion.
  • MEMS micro electro-mechanical system
  • the device When the device is not being worn it may operate at an ultra-low power mode in which it is not intermittently searching for the presence of an eye. In the ultra-low power mode, the device may only search for the presence of an eye when movement of the device is detected, for instance when a user picks up the device. When movement is detected, the device may initiate a scan in search of an eye or eyes at predetermined intervals (for instance every two seconds) or substantially continuously for a period of time (for instance one minute) as set by user preferences.
  • predetermined intervals for instance every two seconds
  • substantially continuously for a period of time (for instance one minute) as set by user preferences.
  • the device fails to detect an eye in the pre-set time interval it may resume ultra-low power mode or it may cycle through a low power mode prior to resuming ultra-low power mode. Should an eye or eyes be detected, the device will switch into full power mode or into a power settings scheme as set by the preferences of the detected user.
  • the primary device owner (administrator) may set the overall system power schemes that will govern the power mode settings for the device when it is not in use. Additionally, the device owner may lock down changes to the power schemes such that other users are unable to edit them.
  • FIG. 5 depicts a further breakdown of the IRIS Object 1000 , including eye tracking 1100 , a module for tracking the eye gaze of a user; eye data 1105 for user identification using biometric data of the user such as facial, speech and iris identification; eye control 1100 for relating the user's eye gaze to a display, iUiTM interface (an interface comprising eye-signal controls) 1116 . Eye signals 1115 gleaned from eye movements are used to interact with a user interface iUi 1116 and display screen(s) and images on the display.
  • eye tracking 1100 a module for tracking the eye gaze of a user
  • eye data 1105 for user identification using biometric data of the user such as facial, speech and iris identification
  • eye control 1100 for relating the user's eye gaze to a display, iUiTM interface (an interface comprising eye-signal controls) 1116 .
  • Eye signals 1115 gleaned from eye movements are used to interact with a user interface iUi 1116 and display screen(s
  • IRIS object 1000 includes a number of software modules operative as managers of certain functions. As an example, but not limiting to:
  • A/V control 1150 audio/video (A/V) control 1150 ; speech control 1155 ; or something more complex, e.g., cognitive load control 1160 ( FIGS. 11 and 12 ).
  • A/V control 1150 audio/video (A/V) control 1150
  • speech control 1155 speech control 1155
  • cognitive load control 1160 FIGS. 11 and 12
  • the HAL 1030 ( FIG. 6 ) includes the “hosted” aspects of external hardware systems; this generally includes software specific to the IRIS platform developed specifically for integration.
  • the Hardware IF 1180 which interfaces with external software and/or hardware drivers through physical links 1235 ; these physical links can be I 2 C, USB, serial, or proprietary.
  • the Bluetooth system has been selected in a non-limiting example of an embodiment because it is so pervasive in the rapidly growing market of mobile devices.
  • Infotainment systems these are a combination of entertainment such as music and videos as well as information, where the information could come from within the vehicle as data from a sensor, control of a system like a heater or lights, or information available through the internet.
  • Most of these systems use wired and wireless technologies to connect to the vehicle and/or the internet.
  • the wireless connections to the vehicle are generally Bluetooth established through a set of standard interfaces; these are referred to as Profiles 1300 ( FIG. 9 ) and are hosted in a processor above the Bluetooth radio, further shown in FIG. 5 as Hands Free Profile (HFP) 1187 ; Advanced Audio Distribution Profile (A2DP) 1193 , Audio Video Resource Control Profile (AVRCP) 1190 , etc.
  • HFP Hands Free Profile
  • A2DP Advanced Audio Distribution Profile
  • AVRCP Audio Video Resource Control Profile
  • FIG. 6 depicts a Bluetooth systems architecture, including connections to the profiles, network and transport 1230 , and the data link 1250 and modem 1255 .
  • FIG. 7 depicts a breakdown of the Bluetooth architecture 1205 broken down into their subcomponents. Underlying all of these protocols is a key piece of Bluetooth termed the Service Discovery Protocol (SDP) 1310 , which includes what is called Secure Simple Pairing (SSP). SSP today is required by all Bluetooth standards above v2.1. Secure Simple Pairing uses a form of public key cryptography, which can help protect against what is called “man in the middle,” or MITM attacks. Generally, the Bluetooth HID 1185 specification requires a security mode 4 for pairing and bonding two devices together citing that it should not be possible to perform pairing or bonding to any Bluetooth HID Host or Device without physical access to both the Bluetooth HID Host and Bluetooth HID device.
  • SDP Service Discovery Protocol
  • SSP Secure Simple Pairing
  • Bluetooth HID Hosts and Bluetooth HID devices that support bonding use some form of non-volatile memory to store the 128-bit link keys and the corresponding BD_ADDRs, as well as the type of each link-key (authenticated, unauthenticated, or combination).
  • complex access is limited as there is no mouse or keyboard in a conventional sense.
  • a Bluetooth HID Host that accepts sensitive information from Bluetooth HID devices may be implemented to only accept sensitive information from reports that are contained in a top-level application collection of “Generic Desktop Keyboard” or “Generic Desktop Keypad.” Furthermore, such a Bluetooth HID Host may require MITM protection when pairing with any Bluetooth HID device with a Bluetooth HID report descriptor that contains a top-level application collection of “Generic Desktop Keyboard” or “Generic Desktop Keypad,” which in turn contains any of the following sets of usage codes and their descriptions:
  • CBID can equivalently involve comparisons and/or the exchange of information involving images of irises, ICs, EICs or other derived parameters.
  • databases used for biometric comparisons could equivalently (for the purposes of identification) contain ICs, EICs, images of eyes, images of faces (including eyes), images of irises, so-called “unfolded” (i.e. expressed in polar coordinates) iris images, or other derived parameters. Therefore, references to exchanges or comparisons of EICs also refer to the exchange or comparison of any other derived data sets for the purpose of biometric identification.
  • programmable attributes include but are not limited to:
  • Spatial Phase Imaging generally relies on the polarization state of light as it emanates from surfaces to capture information about the shape of objects.
  • Triangulation employs the location of two or more displaced features, detectors, and/or illuminants to compute object geometry.
  • Two important triangulation subcategories are stereo correspondence (STC) and stereoscopy (STO).
  • Stereo correspondence cameras determine the location of features in a scene by identifying corresponding features in two or more offset intensity images using 3D geometry to compute feature locations.
  • Stereoscopic cameras rely on human biological systems (eyes, brain) to create a notion of a 3D scene from two images taken from different vantage points and projected into the eyes of a viewer.
  • coherent methods rely on a high degree of spatial and/or temporal coherence in the electromagnetic energy illuminating and/or emanating from the surfaces in order to determine 3D surface geometry.
  • FIGS. 8 and 9 depict imager object code 1415 for either a 2D or 3D implementation.
  • any system implemented must consider two key factors: Human-fidelic visualization (completely realistic display) and visual intelligence (automated vision).
  • Human-fidelic visualization can create a visual notion of a scene in the mind of a human that is as realistic or almost as realistic as viewing the scene directly; the visualization system is human-fidelic.
  • An imaging system has to be 3D to be human-fidelic, since human sight is 3D.
  • the second being visual intelligence which means sensing and analyzing light to understand the state of the physical world. Automatic recognition of human emotions, gestures, and activities represent examples of visual intelligence.
  • 2D video cameras struggle to provide a high level of visual intelligence because they throw away depth information when a video is captured. As a consequence of neglecting depth, 2D images of 3D scenes are inferior to 3D images. 3D images have better contrast (the ability to distinguish between different objects). Real video of real scenes typically contains dozens of instances where contrast and depth ambiguity make it difficult for automated systems to understand the state of the scene.
  • 3D video cameras do everything that 2D cameras do, but add the benefits just discussed. It is inevitable that single lens native 3D video will eventually replace 2D video offered today by offering two interesting benefits: human-fidelic visualization and improved visual intelligence. It is reasonable to assume that global production of most cameras will shift to 3D as they become cost effective, simple to operate, compact and produce visual fidelity. With this in mind, the technology emerging today as the most likely to reach mass markets in terms of cost, complexity, and fidelity is Spatial Phase Imaging within the broad 3D imaging categories discussed.
  • This technology relies on commercially available imagers implementing a micro-polarizing lens over four sub-pixels resulting in an ability to rapidly determine small changes in reflected light, computing a vector as a direction cosine for each pixel and generating a three dimensional value in terms of X, Y and Z-depth; truly a single lens native 3D video.
  • the accuracy of both CBID and eye-signal control processes can be improved via the use of more than a single camera to view an eye.
  • Images substantially simultaneously or sequentially acquired from multiple cameras can be used to 1) create on-axis (i.e. perpendicular to the surface) views of different regions of the eye, 2) view surfaces with specular reflections (particularly glints) located at different positions within images of the eye, 3) allow for viewing of fine structures while maintaining the ability to view over a wide spatial range, 4) increase eye tracking accuracy by making multiple measurements based on multiple views of glints and eye structures, and 5) view “around” obscuring objects such as eye lids and lashes.
  • Another area where distributed/embedded processing is particularly valuable is in the “off-loading” of operations that are computationally intensive for a CPU.
  • Examples of such a “hybrid” approach i.e. mixing CPU and embedded processing
  • eye tracking and iris identification algorithms include subroutine that perform Fast Fourier Transform (FFT), random sample consensus (RANSAC), so-called StarBurst feature extraction, and trigonometric functions.
  • FFT Fast Fourier Transform
  • RANSAC random sample consensus
  • StarBurst feature extraction so-called StarBurst feature extraction
  • trigonometric functions trigonometric functions
  • Cognitive load control 1160 In programs like cockpit workload management; cognitive load control 1160 generally deals with the human mind interacting with some external stimulus.
  • cognitive load is slightly different in different fields; for example, in an academic sense cognitive load refers to the total amount of mental activity imposed on working memory at any instance in time; while in the ergonomics literature it is described as the portion of operator information processing capacity, or resources that are required to meet cognitive task demands. Each field provides different methods to measure cognitive load.
  • Cognitive load is considered herein as the mental effort or demand required for a particular user to comprehend or learn some material or complete some task. Cognitive load is relative to both the user (i.e., their ability to process novel information) and the task being completed (i.e., complexity), at any single point in time. It is attributable to the limited capacity of a person's working memory and their ability to process novel information.
  • Conventional methods for measuring cognitive load include:
  • FIG. 12 depicts system components for a cognitive load manager 1160 that addresses many of these issues.
  • mobile, wearable, implanted, consumed, and other physiologically integrated computers employ increasingly sophisticated and varied sensors, data input methods, data access methods, and processing capabilities that capture, access, and interpret more and more data that can be used as sensory input to the brain and impact cognitive activity.
  • the data comprises physiological data 1815 and environmental data 1810 .
  • the data are used to better establish a user's preferences for the integration, management, and delivery of information to the head mounted unit.
  • FIGS. 13-15 depict three different system architectures for connecting the HMD to another device or to the Internet.
  • FIG. 13 depicts the HMD 600 connecting through a local link, such as Bluetooth, to a mobile device 710 carried by the user; the mobile device 710 is connected via link 155 to a packet switched network typically provided by a wireless carrier through 700 or what today is generally referred to as a packet network also known as the world wide web; with subsequent connection to either a web-based service, a database, or external application 160 .
  • a local link such as Bluetooth
  • FIG. 14 depicts the HMD 600 including a wireless transmitter 750 that is either embedded or attached to the HMD for connection directly to the internet 700 and a service provider 160 .
  • FIG. 15 depicts the HMD 600 including a wireless transceiver 750 connected via a link 725 directly to the Internet, where the local link is generally a packet link, but could be other proprietary wireless protocols.
  • the HMD is independent from other smart devices; essentially the HMD is connected directly to the Internet all of the time.
  • the user would simply implement a local connection through a Bluetooth profile.
  • the user would need to use Audio Video Transport Profile, Audio Video Resource Control profile, or Advanced Audio Distribution Profile.
  • a user wanted to connect to a vehicle he or she would need to implement the Hands Free Profile. Simpler and less complex systems are needed along with methods to connect to these systems, especially if the user is beyond the range of a local connection to the system they want to control.
  • FIG. 16 depicts another embodiment where an HMD is implemented in an “abstracted” real-time server-browser cloud based architecture; known today as the “Internet of Things” or IoT.
  • the key to any abstracted layer is the ability to abstract away from some device or software operational or strategic complexity; these could include proprietary aspects, including trade secrets and intellectual property.
  • the abstraction can support extended or new business models to a technology supplier.
  • a good example of this architecture is the NESTTM Labs business model. This model could be loosely referred to as a “razor/razor blade” model; in this case the NESTTM thermostat is the razor, the NESTTM Services are the razor blades or simply stated the business model includes the sale of the thermostat and a monthly recurring service. In addition to the sale of hardware and services, this business model supports data harvesting of a user in his home. In this system, the thermostat serves data off to a centralized server for the purposes of “learning.”
  • FIG. 16 depicts an HMD 600 connected via a packet network 155 to the Internet 700 .
  • the user needs to access their page on the NESTTM Services server 965 .
  • the traditional role of web server and browser has been expanded under the new HTML 5 standard. There has been what looks like a role reversal of the server and browser, one where the web server is now the smart thermostat; this server is simply serving small amounts of data to a fixed URL in the cloud running a browser. This browser in the cloud can be accessed by a user using a smart device or computer from virtually anywhere to read or interact with their thermostat.
  • Using the web server in this role is now a key and underlying concept of the IoT, one where complexity and cost are greatly reduced.
  • the head-mounted device 600 could be connected to any consumer, industrial, or commercial device located anywhere in the world on the cloud, a user could control that device via eye interaction with the included display via eye signals defined as a standardized command set mapping the eye signals to communication, diagnostics, control, and interaction with the device(s).
  • FIGS. 17-23 depict an abstraction transition model from a smart head mounted system, to a much simpler model as depicted in FIG. 23 .
  • FIG. 23 depicts a cloud based implementation within an IoT architecture of an HMD 600 connected by a very high speed packet based link, a wireless link that would rival or potentially outperform the typical communication bus in a local processor.
  • processor busses operate as subsystems of the processor to facilitate transfer of data between computer components or between computers.
  • Typical bus types include front-side bus (FSB), which carries data between the CPU and memory controller hub; direct media interface (DMI), which is a point-to-point interconnection between an integrated memory controller and an I/O controller hub in the processor; and Quick Path Interconnect (QPI), which is a point-to-point interconnect between the CPU and the integrated memory controller.
  • FSB front-side bus
  • DMI direct media interface
  • QPI Quick Path Interconnect
  • the HMD is connected to a centralized server-browser 800 that operates the Visual Disambiguation Service (VDS) interface termed IRIS (Interface for Real-time Image Services); think of this operating much like SIRI (Speech Interpretation and Recognition Interface) does for audio.
  • VDS Visual Disambiguation Service
  • SIRI Speech Interpretation and Recognition Interface
  • the IRIS service is for the complex disambiguation of eye movement for the real-time interpretation, determination, and prediction of a user's intent.
  • IRIS like SIRI, operates in the cloud. 1126 and 1127 represent the IRIS abstraction layer discussed above.
  • the HMD now operates with a minimum amount of software, a processor richer in features and configured with a limited or possibly no operating system using a publish/subscribe messaging scheme.
  • the embedded IRIS (e-IRIS) 1111 includes a number of tools or utilities operating in the FOG as a combined real-time service. These include a data manager 1125 , device manager 1120 , communication manager 1130 , power manager 1140 , and security Manager 1135 a . In the e-IRIS abstraction 1127 , there are counterpart managers, with a slight exception in the security manager 1135 b ; this will be discussed below in more detail.
  • FIG. 23 also depicts the eye management tools centralized in a cloud-based version in support of a user. These include an eye tracker 1100 , eye data 1105 in support of security, eye control 1110 , eye signals 1115 , and iUi 1116 for an eye user interface.
  • eye management tools centralized in a cloud-based version in support of a user. These include an eye tracker 1100 , eye data 1105 in support of security, eye control 1110 , eye signals 1115 , and iUi 1116 for an eye user interface.
  • other real-time services are available and associated to IRIS including an Audio-Video manager 1150 , speech manager 1155 , cognitive load manager 1160 and a context manager 1165 . The combination of these services and architecture constitutes IRIS.
  • the HMD 600 is wirelessly connected to a smart device (such as a smart phone, a tablet, home or office PC) or simply to the Internet through an 802.11 link. All of the services operate in the HMD 600 processor or are stored in a memory associated with the HMD 600 .
  • This embodiment would operate as a stand-alone computer, with an operating system, and micro-processor(s) and/or other logic elements.
  • some of the non-real-time applications are off loaded to applications run on the local smart phone 710 , local PC, or other smart devices.
  • this first transition embodiment would still be highly dependent on the locally available resources in the HMD 600 to operate as intended.
  • FIG. 18 depicts a second transition step wherein the data manager 1125 takes on a new role.
  • the data manager is configured to manage some of the data either on or off board the HMD 600 using a markup language, such as or JSON (Java Script Object Notation), HTML 4.01, or 5.0.
  • JSON Java Script Object Notation
  • HTML 4.01 HyperText Markup Language
  • the object of this transition step is to implement a web server-browser relationship in the HMD 600 .
  • some of the data acquired by the imagers, audio input, or any other sensors available to the HMD 600 are served to the cloud and directed by a fixed URL to a cloud based IRIS, where a user's browser page resides and his/her data are aggregated.
  • This second transition supports non real-time data applications, as an example the HMD 600 is used for the transmission of data that have been collected and stored by a user.
  • the user may capture a photograph, an audio clip, a video clip, or other user physiological data related to the eye or a user's health; these data are then transferred to IRIS for storage, aggregation, or possible subsequent dissemination (discussed in more detail below).
  • FIGS. 19 , 20 , and 21 depict a third step in the transition, where the wireless bandwidth is now near real-time.
  • a web server and browser relationship exists operationally in parallel with a now more mature e-IRIS 1111 in the HMD 600 and IRIS 800 in the cloud. They operate and interact with each other in near real-time across the abstraction layer 1126 and 1127 .
  • This new configuration now allows an evolution of the security manager with respect to security and implementation of the private key-public key.
  • the security manager 1135 resident in the HMD 600 takes on the role of generating a private key and public key based on certain bio-metrics as disclosed in described in Systems and Methods for Discerning Eye Signals and Continuous Biometric Identification, filed May 8, 2015. Data collected from the face, eye, or voice constitute unique biometric data of the user or user groups if desired. These data collected can be used to generate a unique private key in a system of public key and private key cryptography.
  • cryptographic systems have been widely used for information protection, authentication, and access control for many years. These cryptosystems are generally categorized as symmetric key cryptosystems and public key cryptosystems. Symmetric key cryptosystems use the same key for encrypting and decrypting secret information; however using the same key can be problematic: 1) if the key is compromised, security cannot be assured; and 2) if there are multiple users, multiple keys are needed, which may increase system costs and data security.
  • Public key cryptosystems can overcome these limitations by using a pair of cryptographic keys (i.e., a private key and a public key). The private key used for decryption is kept secret, whereas the public key used for encryption may be distributed to multiple users. Therefore, secrecy of the private key is a major challenge when it comes to achieving high levels of security in practical crypto systems.
  • the irisCode of the user possibly combined with other biometric data are used to establish a unique key that subsequently generates the private key-public key.
  • the public key generated from the user's unique biometric aspects is sent to IRIS 800 for storage in the security manager portion of the user's browser, FIG. 22 1135 b .
  • the private key is never stored, but is generated in the HMD 600 every time a user instantiates a session.
  • the private key is generated, FIG. 21 1129 , and authenticated in IRIS 800 . This ensures levels of non-repudiation and security currently not available in web applications, especially in e-commerce.
  • FIG. 23 depicts the final step in the transition to a real-time HMD 600 .
  • the Internet is now prolific and operates at speeds in excess of processor buses.
  • IRIS 800 is cloud-based and real-time for all intents and purposes. Data are collected and aggregated in IRIS 800 .
  • IRIS 800 is now implementing advanced algorithms based on learning about the physiology of the human eye, as well as the user generally; disambiguation in IRIS 800 is enhanced to the point. IRIS 800 can now predict what and where a user wants to see or do.
  • the user's HMD 600 is commodity, low cost, low power and immediately replaceable.
  • the final step abstracts all of the intelligence for the device to the cloud 700 .
  • CBID, now cloud 700 based is substantially continuous and real-time. Since the generation of the private key is unique to a user, this allows any user to pick up any HMD 600 and use it at any time; simply slip it on and they are looking at their browser page where all of their personal information now resides. If their HMD 600 is stolen, the information is secure. If a user loses their HMD 600 , no worry, simply borrow one, or buy a new one.
  • the CBID and cloud 700 aspects of IRIS 800 abstract the device at a new level, it abstracts the user like HMI and displays do today.
  • the thermostat is only accessible through the NESTTM Services portal and page.
  • the HMD 600 is securely connected to IRIS 800 and a user's page. If the user wants to access their thermostat, IRIS connects them directly and securely to the NESTTM Services portal 965 .
  • This model will extend to XFINITY, if a user wanted access to his/her account to set a recording, or have access to an XFINITY service, IRIS will connect them directly the XFINITY portal 970 . Further, if the user wants access to their COZYHOME application, again, the link is securely made to the appropriate server in this case 975 .
  • IRIS 800 may be linked to a user's social media account, giving the user a real-time access.
  • FIG. 25 depicts how IRIS 800 would securely connect a user securely to their Google+ account to see postings or to post in near real-time information they want to share.
  • Social Media 920 comprises social media services available to a user.
  • IRIS 800 includes a context manager 1165 in both e-IRIS 1111 in FIG. 17 , as well as IRIS 800 FIG. 23 and its role to generated Contextualized Eye Data (CED).
  • CED begins with eye data extracted from episodic and/or substantially continuous monitoring of one or both eyes. These eye data include eye movements such as: saccades, fixations, dwells, pursuits, drift, tremors, and micro-saccades.
  • Eye data also include blinks and winks, squints, pupil dilation, blood vessel patterns, iris and pupil size, feature locations, internal eye-structure size, shape, and location.
  • a key aspect for CED is to use this data to detect behavior changes over time.
  • CED is the correlation of eye-data with other classes of data over time to extract relationships for meaningful prediction, measurement, analysis, interpretation, and impact on the user.
  • three classes of data IRIS 800 will have aggregated are raw data, semantic data, and evoked data.
  • Raw data comprises data captured by any sensors, whether in the HMD 600 or present on or in a person.
  • IRIS 800 can take this raw data from an individual and correlate it with eye data.
  • Examples include, but are not limited to, sensors that capture: movement, GSR (galvanic skin response), temperature, heart rate and heart rate variability (HRV), EOG (Electro-oculogram), EEG (Electro-encephelogram, EKG (electro-cardiogram), temperature, facial muscle movement and skin movement, internal organ or biological systems status and performance, scent, audio, scene and images for a range of electromagnetic radiation (visible light, IR, UV, and other electromagnetic frequencies), location (GPS and other beacon sensors), time monitoring/tracking, and more.
  • GSR galvanic skin response
  • HRV heart rate and heart rate variability
  • EOG Electro-oculogram
  • EEG Electro-encephelogram
  • EKG electro-cardiogram
  • temperature facial muscle movement and skin movement
  • scent audio, scene and images for a range of electromagnetic radiation (visible light, IR, UV, and other electromagnetic frequencies), location (GPS and other beacon sensors), time monitoring/tracking, and more.
  • Semantic data comprises the interpretation or meaning of “what, when, where, and how” a user is “doing” something, as well as with whom the user is doing something. “Doing” can be working, playing, eating, exercising, reading, and myriad other activities. These data are constructed by interpreting sensor data in the context of a user's activities.
  • Evoked data are extracted from conscious or subconscious individual response to visual, tactile, olfactory, taste, audio, brain, or other sensory, organ, or biological responses to intentional stimuli.
  • Eye-tracking data have primarily been captured indoors due to the technology's inability to function well in high-infrared (outdoor) environments without substantial filtering or shielding of ambient IR light, further reducing the practicality, breadth, and quantity of eye-data capture.
  • high quality, environmentally diverse, high-volume data across diverse “natural” use cases have been limited due to the expense, limited portability, constrained form-factor, high-power requirements, high-computing requirements, limited environmental robustness, and dedicated “data capture” utility of eye-tracking technology and devices. While early research on the data captured has shown promise for extraordinary insights into human health, cognition, and behavior, the general capture of such data has been highly constrained to specific tests and environments for short durations.
  • the first generation of IRIS integrated HMDs may be worn by millions of people in a broad range of life activities.
  • these data may be collected by IRIS first as historical data, then in both near real-time, and ultimately in real-time. Should this transition occur, it could increase by orders of magnitude the quantity, quality, and contextualization of eye data that is captured.
  • IRIS could then have the ability to correlate data with a broad range of other personal and aggregated data such as individual and group health cognition and behavior.
  • IRIS may then use the aggregated data to provide insights into eye data correlated with personal health, cognition, and behavior as a starting point regarding self-quantification, self-improvement, and self-actualization.
  • IRIS will support applications for extracting patterns from large datasets that will expose and predict future behavior such as that of our likelihood to adopt a new habit, our interest in acquiring a product, or our likelihood in voting for a new politician.
  • future behavior such as that of our likelihood to adopt a new habit, our interest in acquiring a product, or our likelihood in voting for a new politician.
  • IRIS' contextualized eye-data these include but are not limited to:
  • IRIS application and tools positively impact the user of the HMD by contextualizing the eye data that are aggregated.
  • IRIS technology will advance the user's performance in many dimensions and will enhance their human-to-human interactions as well as their human-machine interactions.
  • FIGS. 26-28 depict other portals for secure access to a user's information where again, the common element is IRIS 800 .
  • the private key stored in IRIS can be related to a password for the user that greatly simplifies the user's interaction on the web, to include secure transactions.
  • FIG. 29 depicts a user operating a setup process that needs to occur only once where the user needs to link their public key with account information.
  • a bank or other financial institution that is responsible for the account might verify other forms of target (i.e., intended) user identity and offer the linkage process as a service.
  • target i.e., intended
  • real time knowledge of a device-wearer's identity allows financial particulars to be exchanged electronically with each item as selected and purchased. This eliminates the need to repeatedly enter passwords, security questions or account information for each transaction or group of transactions. As a consequence, such an instantaneous purchasing system eliminates processes involved with a so-called online shopping “carts” since there is no longer a need to cluster items for the purpose of entering account information. Solely for customer convenience, groups of items purchased during an online shopping session can be treated as a cluster or summarized for the purchaser.
  • systems and methods are provided to enhance security and streamline shopping at so-called “bricks and mortar” retail outlets.
  • a camera mounted on the headwear device that views the environment of the device wearer can be used to identify objects that may be of interest for purchase. Identification can be based on bar codes or quick-response (i.e. Q-R) codes that are commonly attached to purchasable items.
  • Q-R quick-response
  • Such object identification uses image processing methods that are well known in the art.
  • Information about the item including a proposed purchase price can be generated by a processing unit associated with the retail outlet. This information can then be displayed on nearby monitors or on a head-mounted display associated with the device wearer. If the customer wishes to purchase a given item, a CBID-based transaction can be initiated by the customer. Such transactions can occur repeatedly throughout a store. A match between transported items and the transaction record would then allow items to be verifiably removed from the store by the customer. CBID-based retail purchases eliminate the need for check stands or tills. In many situations, the automated, real time display of information during the purchasing process also reduces the need for store clerks to assist potential customers.
  • These devices are also integrating increasingly sophisticated and varied data output methods that stimulate visual, auditory, tactile, olfactory, gustatory (sense of taste), equilibrioception (sense of balance), direct neurological, indirect (wireless) neurological (neural and synaptic brainwave stimulation), chemical, biological activity, and multi-modal input sensation.
  • the increased stimulation of the body and associated enhanced delivery of information to the brain can affect brain activity in subtle and profound ways.
  • Cognitive stimulation resulting from more, varied, and faster delivery of multiple forms of input to the brain can positively impact human performance.
  • cognitive overload or inappropriate stimulation can negatively impact performance, damage health, create safety hazards, and even kill.
  • a recent form of cognitive load management associated with electronic stimulation includes applications that temporarily disable email, text, and other online forms of interruption. These applications are very simple in form, however.
  • This approach allows user's customization and prioritization to improve over time as historical context, performance, biometric, and other data are accumulated and analyzed forming generally a user profile of activities and preferences.
  • These also provide a variety of methods and techniques for dynamically managing stimuli (deferral, termination, sequencing, reprioritization, pacing, and more), support stimuli aggregation and management across multiple individuals for risk-controlled or performance-enhanced group activity.
  • Another embodiment is context-aware computing as 1165 .
  • a mobile computing paradigm it will be advantageous for applications to discover and take advantage of contextual information such as user location, time of day, neighboring users and devices, user activity to specifically support collecting and disseminating context and applications that adapt to changing context.

Landscapes

  • Engineering & Computer Science (AREA)
  • Theoretical Computer Science (AREA)
  • General Engineering & Computer Science (AREA)
  • Physics & Mathematics (AREA)
  • General Physics & Mathematics (AREA)
  • Computer Security & Cryptography (AREA)
  • Human Computer Interaction (AREA)
  • Computer Hardware Design (AREA)
  • Signal Processing (AREA)
  • General Health & Medical Sciences (AREA)
  • Health & Medical Sciences (AREA)
  • Software Systems (AREA)
  • Multimedia (AREA)
  • Computer Networks & Wireless Communication (AREA)
  • Optics & Photonics (AREA)
  • Biomedical Technology (AREA)
  • Computing Systems (AREA)
  • Ophthalmology & Optometry (AREA)
  • Computer Graphics (AREA)
  • Bioethics (AREA)
  • Social Psychology (AREA)
  • Computer Vision & Pattern Recognition (AREA)
  • User Interface Of Digital Computer (AREA)
  • Collating Specific Patterns (AREA)
  • Measurement Of The Respiration, Hearing Ability, Form, And Blood Characteristics Of Living Organisms (AREA)
  • Image Input (AREA)
  • Eye Examination Apparatus (AREA)
  • Image Analysis (AREA)
  • Processing Or Creating Images (AREA)
  • Position Input By Displaying (AREA)
  • Image Processing (AREA)
US14/708,229 2014-05-09 2015-05-09 Systems and methods for using eye signals with secure mobile communications Abandoned US20150324568A1 (en)

Priority Applications (2)

Application Number Priority Date Filing Date Title
US14/708,229 US20150324568A1 (en) 2014-05-09 2015-05-09 Systems and methods for using eye signals with secure mobile communications
US15/237,581 US10564714B2 (en) 2014-05-09 2016-08-15 Systems and methods for biomechanically-based eye signals for interacting with real and virtual objects

Applications Claiming Priority (10)

Application Number Priority Date Filing Date Title
US201461991435P 2014-05-09 2014-05-09
US201462023940P 2014-07-13 2014-07-13
US201462027777P 2014-07-22 2014-07-22
US201462027774P 2014-07-22 2014-07-22
US201462038984P 2014-08-19 2014-08-19
US201462039001P 2014-08-19 2014-08-19
US201462046072P 2014-09-04 2014-09-04
US201462074927P 2014-11-04 2014-11-04
US201462074920P 2014-11-04 2014-11-04
US14/708,229 US20150324568A1 (en) 2014-05-09 2015-05-09 Systems and methods for using eye signals with secure mobile communications

Related Child Applications (1)

Application Number Title Priority Date Filing Date
US14/708,241 Continuation-In-Part US9600069B2 (en) 2014-05-09 2015-05-09 Systems and methods for discerning eye signals and continuous biometric identification

Publications (1)

Publication Number Publication Date
US20150324568A1 true US20150324568A1 (en) 2015-11-12

Family

ID=54368077

Family Applications (7)

Application Number Title Priority Date Filing Date
US14/708,229 Abandoned US20150324568A1 (en) 2014-05-09 2015-05-09 Systems and methods for using eye signals with secure mobile communications
US14/708,241 Active 2035-06-17 US9600069B2 (en) 2014-05-09 2015-05-09 Systems and methods for discerning eye signals and continuous biometric identification
US14/708,234 Active 2035-06-09 US10620700B2 (en) 2014-05-09 2015-05-09 Systems and methods for biomechanically-based eye signals for interacting with real and virtual objects
US14/930,617 Active US9823744B2 (en) 2014-05-09 2015-11-02 Systems and methods for biomechanically-based eye signals for interacting with real and virtual objects
US14/937,782 Abandoned US20160062459A1 (en) 2014-05-09 2015-11-10 Systems and methods for biomechanically-based eye signals for interacting with real and virtual objects
US15/131,273 Abandoned US20160274660A1 (en) 2014-05-09 2016-04-18 Systems and methods for biomechanically-based eye signals for interacting with real and virtual objects
US15/418,034 Active US10156900B2 (en) 2014-05-09 2017-01-27 Systems and methods for discerning eye signals and continuous biometric identification

Family Applications After (6)

Application Number Title Priority Date Filing Date
US14/708,241 Active 2035-06-17 US9600069B2 (en) 2014-05-09 2015-05-09 Systems and methods for discerning eye signals and continuous biometric identification
US14/708,234 Active 2035-06-09 US10620700B2 (en) 2014-05-09 2015-05-09 Systems and methods for biomechanically-based eye signals for interacting with real and virtual objects
US14/930,617 Active US9823744B2 (en) 2014-05-09 2015-11-02 Systems and methods for biomechanically-based eye signals for interacting with real and virtual objects
US14/937,782 Abandoned US20160062459A1 (en) 2014-05-09 2015-11-10 Systems and methods for biomechanically-based eye signals for interacting with real and virtual objects
US15/131,273 Abandoned US20160274660A1 (en) 2014-05-09 2016-04-18 Systems and methods for biomechanically-based eye signals for interacting with real and virtual objects
US15/418,034 Active US10156900B2 (en) 2014-05-09 2017-01-27 Systems and methods for discerning eye signals and continuous biometric identification

Country Status (7)

Country Link
US (7) US20150324568A1 (https=)
EP (3) EP3140780B1 (https=)
JP (3) JP2017527036A (https=)
KR (4) KR20200127267A (https=)
CN (3) CN106462743A (https=)
AU (3) AU2015255652B2 (https=)
WO (3) WO2015172124A1 (https=)

Cited By (69)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US20160246365A1 (en) * 2015-02-23 2016-08-25 International Business Machines Corporation Interfacing via heads-up display using eye contact
US20160308859A1 (en) * 2015-04-14 2016-10-20 Blub0X Technology Holdings, Inc. Multi-factor and multi-mode biometric physical access control device
US20170069159A1 (en) * 2015-09-04 2017-03-09 Musigma Business Solutions Pvt. Ltd. Analytics system and method
US20170090588A1 (en) * 2015-09-29 2017-03-30 Kabushiki Kaisha Toshiba Electronic device and method
US20170123489A1 (en) * 2015-10-28 2017-05-04 Microsoft Technology Licensing, Llc Adjusting image frames based on tracking motion of eyes
US9823744B2 (en) 2014-05-09 2017-11-21 Google Inc. Systems and methods for biomechanically-based eye signals for interacting with real and virtual objects
WO2018046347A1 (de) * 2016-09-07 2018-03-15 Bundesdruckerei Gmbh Datenbrille zum kryptographischen signieren von bilddaten
EP3376367A1 (de) * 2017-03-13 2018-09-19 Siemens Aktiengesellschaft Quittieren eines überführens eines gutes
KR20190022376A (ko) * 2017-08-23 2019-03-06 한국전자통신연구원 자기 수치화 서비스 장치
US20190125264A1 (en) * 2017-10-29 2019-05-02 Orlando Efrain Abreu Oramas Method and system of facilitating monitoring of an individual based on at least one wearable device
US20190155896A1 (en) * 2015-08-31 2019-05-23 Ayla Networks, Inc. Compact schedules for resource-constrained devices
US10325083B2 (en) * 2014-06-27 2019-06-18 Intel Corporation Wearable electronic devices
US10353465B2 (en) * 2016-06-08 2019-07-16 South China University Of Technology Iris and pupil-based gaze estimation method for head-mounted device
US10397594B2 (en) 2017-04-28 2019-08-27 Hewlett Packard Enterprise Development Lp Real-time processing of IoT data
US20190266427A1 (en) * 2018-02-23 2019-08-29 Samsung Electronics Co., Ltd Method of biometric authenticating using plurality of camera with different field of view and electronic apparatus thereof
US10466778B2 (en) 2016-01-19 2019-11-05 Magic Leap, Inc. Eye image selection
US10554758B2 (en) 2015-06-15 2020-02-04 Blub0X Security, Inc. Web-cloud hosted unified physical security system
US10564714B2 (en) 2014-05-09 2020-02-18 Google Llc Systems and methods for biomechanically-based eye signals for interacting with real and virtual objects
WO2020048778A1 (de) * 2018-09-04 2020-03-12 Robert Bosch Gmbh Verfahren zur steuerung einer multimedia-einrichtung sowie computerprogramm und einrichtung dazu
CN111091595A (zh) * 2019-12-23 2020-05-01 吉林省广播电视研究所(吉林省广播电视局科技信息中心) 斜视三维测绘方法及测绘系统
EP3648069A1 (en) * 2018-10-29 2020-05-06 Baidu Online Network Technology (Beijing) Co., Ltd. Method and apparatus for selling commodity, vending machine and storage medium
US10650621B1 (en) 2016-09-13 2020-05-12 Iocurrents, Inc. Interfacing with a vehicular controller area network
US10733275B1 (en) * 2016-04-01 2020-08-04 Massachusetts Mutual Life Insurance Company Access control through head imaging and biometric authentication
US10750560B2 (en) 2016-09-27 2020-08-18 Extreme Networks, Inc. IoT device management using multi-protocol infrastructure network devices
US10748340B1 (en) * 2017-07-31 2020-08-18 Apple Inc. Electronic device with coordinated camera and display operation
US20200293744A1 (en) * 2015-08-21 2020-09-17 Magic Leap, Inc. Eyelid shape estimation using eye pose measurement
EP3433707B1 (en) 2016-03-22 2020-10-28 Magic Leap, Inc. Head mounted display system configured to exchange biometric information
US10866633B2 (en) 2017-02-28 2020-12-15 Microsoft Technology Licensing, Llc Signing with your eyes
CN112262373A (zh) * 2018-06-26 2021-01-22 苹果公司 基于视图的断点
US10996477B2 (en) 2017-02-27 2021-05-04 Advanced New Technologies Co., Ltd. Virtual reality head-mounted apparatus
EP3824379A1 (en) * 2018-07-17 2021-05-26 Methodical Mind, LLC Graphical user interface system
US11099645B2 (en) 2015-09-04 2021-08-24 Sony Interactive Entertainment Inc. Apparatus and method for dynamic graphics rendering based on saccade detection
US11170087B2 (en) 2017-02-23 2021-11-09 Advanced New Technologies Co., Ltd. Virtual reality scene-based business verification method and device
WO2022015812A1 (en) * 2020-07-14 2022-01-20 Surgical Theater, Inc. System and method for four-dimensional angiography
US11271745B2 (en) 2019-03-19 2022-03-08 Advanced New Technologies Co., Ltd. Method and system for operating internet of things device
CN114223194A (zh) * 2019-08-06 2022-03-22 爱尔康公司 用于玻璃体视网膜手术的场景相机系统和方法
US20220230749A1 (en) * 2021-01-19 2022-07-21 Interstat LLC Systems and methods for ophthalmic digital diagnostics via telemedicine
CN114927184A (zh) * 2015-11-18 2022-08-19 全球样本解决方案股份有限公司 用于人类标本研究的知情同意数据的编纂、跟踪和使用的方法和系统
WO2022182916A1 (en) * 2021-02-24 2022-09-01 Lifebrand, Llc System and method for determining the impact of a social media post across multiple social media platforms
US11461444B2 (en) 2017-03-31 2022-10-04 Advanced New Technologies Co., Ltd. Information processing method and device based on internet of things
US11533272B1 (en) * 2018-02-06 2022-12-20 Amesite Inc. Computer based education methods and apparatus
CN115885237A (zh) * 2020-07-17 2023-03-31 惠普发展公司，有限责任合伙企业 头戴式显示器图像和中心凹区亮度计算
CN116324682A (zh) * 2020-10-21 2023-06-23 高通股份有限公司 至少部分地基于用户眼睛移动的功率控制
US11698535B2 (en) 2020-08-14 2023-07-11 Hes Ip Holdings, Llc Systems and methods for superimposing virtual image on real-time image
US11706656B2 (en) 2020-06-29 2023-07-18 Qualcomm Incorporated Downlink data prioritization for time-sensitive applications
US11749025B2 (en) 2015-10-16 2023-09-05 Magic Leap, Inc. Eye pose identification using eye features
US11774759B2 (en) 2020-09-03 2023-10-03 Hes Ip Holdings, Llc Systems and methods for improving binocular vision
US11786694B2 (en) 2019-05-24 2023-10-17 NeuroLight, Inc. Device, method, and app for facilitating sleep
US11811513B2 (en) * 2020-12-04 2023-11-07 Capital One Services, Llc Methods and systems for managing multiple content delivery networks
US20230370475A1 (en) * 2020-09-30 2023-11-16 Sartorius Stedim Biotech Gmbh Method for conducting a bioprocess
US11838419B2 (en) 2021-01-15 2023-12-05 Delta Electronics, Inc. Method and system for monitoring industrial devices
US11953689B2 (en) 2020-09-30 2024-04-09 Hes Ip Holdings, Llc Virtual image display system for virtual reality and augmented reality devices
US20240303018A1 (en) * 2019-04-09 2024-09-12 Maxell, Ltd. Head mounted processing apparatus
US12164687B2 (en) 2018-09-28 2024-12-10 Apple Inc. Pupil modulation as a cognitive control signal
US12210731B2 (en) 2019-12-27 2025-01-28 Methodical Mind, Llc Graphical user interface system
US12231613B2 (en) 2019-11-06 2025-02-18 Hes Ip Holdings, Llc System and method for displaying an object with depths
US12248656B2 (en) 2020-01-22 2025-03-11 Methodical Mind, Llc Graphical user interface system
US12257025B2 (en) 2022-03-14 2025-03-25 O/D Vision Inc. AI enabled multisensor connected telehealth system
US12260580B2 (en) 2021-02-08 2025-03-25 Oomii Inc. System and method for enhancing visual acuity of head wearable displays
US12285243B2 (en) 2022-03-14 2025-04-29 O/D Vision Inc. Multi sensor handheld medical diagnostic device
US12293837B2 (en) 2022-03-14 2025-05-06 O/D Vision Inc. Systems and methods for artificial intelligence based warning of potential health concerns
US12298512B2 (en) 2020-06-19 2025-05-13 Oomii Inc. Image display systems for eyebox expansion and methods of making the same
US12380735B2 (en) * 2022-03-14 2025-08-05 O/D Vision Inc. Systems and methods for biometric identification using patterns and blood flow characteristics of the outer eye
US12381009B2 (en) 2022-03-14 2025-08-05 O/D Vision Inc. Systems and methods for artificial intelligence based standard of care support
US12411598B2 (en) 2021-09-24 2025-09-09 Apple Inc. Interaction events based on physiological response to illumination
US12455447B2 (en) 2021-05-20 2025-10-28 Ams International Ag Eye tracking
US12501225B2 (en) 2022-01-02 2025-12-16 Poltorak Technologies Llc Bluetooth enabled intercom with hearing aid functionality
US12536265B2 (en) 2022-07-18 2026-01-27 Bank Of America Corporation Systems and methods for performing non-contact authorization verification for access to a network
US12585372B2 (en) 2021-07-21 2026-03-24 Methodical Mind, Llc Graphical user interface system guide module

Families Citing this family (982)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US9318108B2 (en) 2010-01-18 2016-04-19 Apple Inc. Intelligent automated assistant
US9823737B2 (en) * 2008-04-07 2017-11-21 Mohammad A Mazed Augmented reality personal assistant apparatus
US8977255B2 (en) 2007-04-03 2015-03-10 Apple Inc. Method and system for operating a multi-function portable electronic device using voice-activation
US8676904B2 (en) 2008-10-02 2014-03-18 Apple Inc. Electronic devices with voice command and contextual data processing capabilities
US9229233B2 (en) 2014-02-11 2016-01-05 Osterhout Group, Inc. Micro Doppler presentations in head worn computing
TWI439960B (zh) 2010-04-07 2014-06-01 蘋果公司 虛擬使用者編輯環境
US10463248B2 (en) * 2011-03-02 2019-11-05 Brien Holden Vision Institute Limited Systems, methods, and devices for measuring eye movement and pupil response
US10895917B2 (en) 2011-03-12 2021-01-19 Uday Parshionikar Multipurpose controllers and methods
US10057736B2 (en) 2011-06-03 2018-08-21 Apple Inc. Active transport based notifications
CN104780828B (zh) 2012-03-26 2017-10-27 纽约大学 用于评估中枢神经系统完整性的方法和试剂盒
US11504051B2 (en) 2013-01-25 2022-11-22 Wesley W. O. Krueger Systems and methods for observing eye and head information to measure ocular parameters and determine human health status
US10716469B2 (en) 2013-01-25 2020-07-21 Wesley W. O. Krueger Ocular-performance-based head impact measurement applied to rotationally-centered impact mitigation systems and methods
US9788714B2 (en) 2014-07-08 2017-10-17 Iarmourholdings, Inc. Systems and methods using virtual reality or augmented reality environments for the measurement and/or improvement of human vestibulo-ocular performance
US10231614B2 (en) 2014-07-08 2019-03-19 Wesley W. O. Krueger Systems and methods for using virtual reality, augmented reality, and/or a synthetic 3-dimensional information for the measurement of human ocular performance
US12133567B2 (en) 2013-01-25 2024-11-05 Wesley W. O. Krueger Systems and methods for using eye imaging on face protection equipment to assess human health
US11490809B2 (en) 2013-01-25 2022-11-08 Wesley W. O. Krueger Ocular parameter-based head impact measurement using a face shield
US12383178B2 (en) 2013-01-25 2025-08-12 Wesley W. O. Krueger Systems and methods for using eye imaging on a wearable device to assess human health
US11389059B2 (en) 2013-01-25 2022-07-19 Wesley W. O. Krueger Ocular-performance-based head impact measurement using a faceguard
US12042294B2 (en) 2013-01-25 2024-07-23 Wesley W. O. Krueger Systems and methods to measure ocular parameters and determine neurologic health status
US10602927B2 (en) 2013-01-25 2020-03-31 Wesley W. O. Krueger Ocular-performance-based head impact measurement using a faceguard
EP2954514B1 (en) 2013-02-07 2021-03-31 Apple Inc. Voice trigger for a digital assistant
US10082870B2 (en) * 2013-03-04 2018-09-25 Tobii Ab Gaze and saccade based graphical manipulation
US9898081B2 (en) 2013-03-04 2018-02-20 Tobii Ab Gaze and saccade based graphical manipulation
US9665171B1 (en) 2013-03-04 2017-05-30 Tobii Ab Gaze and saccade based graphical manipulation
US10895908B2 (en) 2013-03-04 2021-01-19 Tobii Ab Targeting saccade landing prediction using visual history
US11714487B2 (en) 2013-03-04 2023-08-01 Tobii Ab Gaze and smooth pursuit based continuous foveal adjustment
JP6676522B2 (ja) 2013-06-17 2020-04-08 ニューヨーク ユニバーシティ 対象における眼球運動を追跡するためのデバイスの作動方法、および当該デバイスによって追跡された眼球運動のデータの中枢神経系病変を位置特定するための使用方法
US10884493B2 (en) 2013-06-20 2021-01-05 Uday Parshionikar Gesture based user interfaces, apparatuses and systems using eye tracking, head tracking, hand tracking, facial expressions and other user actions
US20150051508A1 (en) 2013-08-13 2015-02-19 Sync-Think, Inc. System and Method for Cognition and Oculomotor Impairment Diagnosis Using Binocular Coordination Analysis
US10686972B2 (en) 2013-09-03 2020-06-16 Tobii Ab Gaze assisted field of view control
US10310597B2 (en) * 2013-09-03 2019-06-04 Tobii Ab Portable eye tracking device
CN105682539B (zh) 2013-09-03 2018-03-16 托比股份公司 便携式眼睛追踪设备
US9958939B2 (en) * 2013-10-31 2018-05-01 Sync-Think, Inc. System and method for dynamic content delivery based on gaze analytics
JP2015114865A (ja) * 2013-12-12 2015-06-22 ソニー株式会社 情報処理装置、中継コンピュータ、情報処理システム、および情報処理プログラム
JP6929644B2 (ja) * 2013-12-31 2021-09-01 グーグル エルエルシーＧｏｏｇｌｅ ＬＬＣ 注視によるメディア選択及び編集のためのシステム並びに方法
US20160019715A1 (en) * 2014-07-15 2016-01-21 Osterhout Group, Inc. Content presentation in head worn computing
US20150228119A1 (en) 2014-02-11 2015-08-13 Osterhout Group, Inc. Spatial location presentation in head worn computing
US9753288B2 (en) 2014-01-21 2017-09-05 Osterhout Group, Inc. See-through computer display systems
US9766463B2 (en) 2014-01-21 2017-09-19 Osterhout Group, Inc. See-through computer display systems
US9852545B2 (en) 2014-02-11 2017-12-26 Osterhout Group, Inc. Spatial location presentation in head worn computing
US12112089B2 (en) 2014-02-11 2024-10-08 Mentor Acquisition One, Llc Spatial location presentation in head worn computing
US11138793B2 (en) 2014-03-14 2021-10-05 Magic Leap, Inc. Multi-depth plane display system with reduced switching between depth planes
US10430985B2 (en) 2014-03-14 2019-10-01 Magic Leap, Inc. Augmented reality systems and methods utilizing reflections
US20160187651A1 (en) 2014-03-28 2016-06-30 Osterhout Group, Inc. Safety for a vehicle operator with an hmd
EP3129935A4 (en) * 2014-04-08 2017-11-08 Capital One Financial Corporation Systems and methods for transacting at an atm using a mobile device
US10424103B2 (en) * 2014-04-29 2019-09-24 Microsoft Technology Licensing, Llc Display device viewer gaze attraction
US9706910B1 (en) * 2014-05-29 2017-07-18 Vivid Vision, Inc. Interactive system for vision assessment and correction
US9715875B2 (en) 2014-05-30 2017-07-25 Apple Inc. Reducing the need for manual start/end-pointing and trigger phrases
US10170123B2 (en) 2014-05-30 2019-01-01 Apple Inc. Intelligent assistant for home automation
US9880401B2 (en) * 2014-06-13 2018-01-30 Verily Life Sciences Llc Method, device and system for accessing an eye-mountable device with a user interface
US11429700B2 (en) * 2014-06-19 2022-08-30 Nec Corporation Authentication device, authentication system, and authentication method
DE102014211823A1 (de) * 2014-06-20 2015-12-24 Robert Bosch Gmbh Verfahren zur Personenidentifizierung
KR102266195B1 (ko) * 2014-06-20 2021-06-17 삼성전자주식회사 객체와 관련된 정보를 제공하는 방법 및 장치
US9269328B2 (en) * 2014-06-24 2016-02-23 Google Inc. Efficient frame rendering
US9338493B2 (en) 2014-06-30 2016-05-10 Apple Inc. Intelligent automated assistant for TV user interactions
US9961307B1 (en) * 2014-06-30 2018-05-01 Lee S. Weinblatt Eyeglass recorder with multiple scene cameras and saccadic motion detection
ES2964604T3 (es) * 2014-07-07 2024-04-08 Attenti Electronic Monitoring Ltd Detección autoadministrada de drogas a prueba de manipulaciones
KR101645087B1 (ko) * 2014-07-10 2016-08-02 아이리텍 잉크 홍채인식용 착용 감지 기능을 가진 손 부착형 웨어러블 장치를 이용한 보안강화세트 및 그 제어방법
US10540907B2 (en) * 2014-07-31 2020-01-21 Intelligent Technologies International, Inc. Biometric identification headpiece system for test taking
EP3177200A4 (en) 2014-08-04 2018-06-13 New York University Methods and kits for diagnosing, assessing or quantitating drug use, drug abuse and narcosis, internuclear ophthalmoplegia, attention deficit hyperactivity disorder (adhd), chronic traumatic encephalopathy, schizophrenia spectrum disorders and alcohol consumption
US9829708B1 (en) * 2014-08-19 2017-11-28 Boston Incubator Center, LLC Method and apparatus of wearable eye pointing system
HK1203120A2 (en) * 2014-08-26 2015-10-16 Well Being Digital Limited A gait monitor and a method of monitoring the gait of a person
CN118567766A (zh) 2014-09-02 2024-08-30 苹果公司 用于可变触觉输出的语义框架
KR102412290B1 (ko) 2014-09-24 2022-06-22 프린스톤 아이덴티티, 인크. 생체측정 키를 이용한 모바일 장치에서의 무선 통신 장치 기능의 제어
CA3168318A1 (en) 2014-09-29 2016-04-07 Magic Leap, Inc. Architectures and methods for outputting different wavelength light out of waveguides
US9898868B2 (en) * 2014-11-06 2018-02-20 Seiko Epson Corporation Display device, method of controlling the same, and program
GB2532438B (en) * 2014-11-18 2019-05-08 Eshare Ltd Apparatus, method and system for determining a viewed status of a document
JP2018506872A (ja) 2014-12-03 2018-03-08 プリンストン・アイデンティティー・インコーポレーテッド モバイルデバイス生体アドオンのためのシステムおよび方法
EP3229205B1 (en) * 2014-12-05 2021-10-13 Sony Group Corporation Information processing device, information processing method, and program
KR102139795B1 (ko) * 2014-12-15 2020-07-31 삼성전자주식회사 생채 특징 패턴을 업데이트하는 방법 및 이를 위한 전자 장치
US10147007B1 (en) * 2015-01-13 2018-12-04 State Farm Mutual Automobile Insurance Company Apparatuses, systems and methods for determining whether a vehicle is being operated in autonomous mode or manual mode
US20160239985A1 (en) 2015-02-17 2016-08-18 Osterhout Group, Inc. See-through computer display systems
US10878775B2 (en) 2015-02-17 2020-12-29 Mentor Acquisition One, Llc See-through computer display systems
EP3062142B1 (en) 2015-02-26 2018-10-03 Nokia Technologies OY Apparatus for a near-eye display
USD779556S1 (en) * 2015-02-27 2017-02-21 Samsung Electronics Co., Ltd. Display screen or portion thereof with an icon
US9836663B2 (en) * 2015-03-05 2017-12-05 Samsung Electronics Co., Ltd. User authenticating method and head mounted device supporting the same
US9886953B2 (en) 2015-03-08 2018-02-06 Apple Inc. Virtual assistant activation
NZ773818A (en) 2015-03-16 2022-07-29 Magic Leap Inc Methods and systems for diagnosing and treating health ailments
US10921896B2 (en) * 2015-03-16 2021-02-16 Facebook Technologies, Llc Device interaction in augmented reality
IN2015CH01313A (https=) * 2015-03-17 2015-04-10 Wipro Ltd
KR101648017B1 (ko) * 2015-03-23 2016-08-12 현대자동차주식회사 디스플레이 장치, 차량 및 디스플레이 방법
CN106155288B (zh) * 2015-04-10 2019-02-12 北京智谷睿拓技术服务有限公司 信息获取方法、信息获取装置及用户设备
WO2016183020A1 (en) 2015-05-11 2016-11-17 Magic Leap, Inc. Devices, methods and systems for biometric user recognition utilizing neural networks
US9860452B2 (en) * 2015-05-13 2018-01-02 Lenovo (Singapore) Pte. Ltd. Usage of first camera to determine parameter for action associated with second camera
US10254544B1 (en) * 2015-05-13 2019-04-09 Rockwell Collins, Inc. Head tracking accuracy and reducing latency in dynamic environments
US20160358181A1 (en) * 2015-05-14 2016-12-08 Magic Leap, Inc. Augmented reality systems and methods for tracking biometric data
US10460227B2 (en) 2015-05-15 2019-10-29 Apple Inc. Virtual assistant in a communication session
US20200321107A1 (en) * 2015-05-19 2020-10-08 Iryou Jyouhou Gijyutu Kenkyusyo Corporation Integrated multi-facility electronic medical record system
US9716834B2 (en) * 2015-05-20 2017-07-25 Panasonic Intellectual Property Management Co., Ltd. Image display device and image processing device
AU2016264503B2 (en) * 2015-05-20 2021-10-28 Magic Leap, Inc. Tilt shift iris imaging
WO2016200150A1 (en) * 2015-06-08 2016-12-15 Samsung Electronics Co., Ltd. Method and apparatus for providing content
IN2015CH02866A (https=) * 2015-06-09 2015-07-17 Wipro Ltd
RU2601169C1 (ru) * 2015-06-11 2016-10-27 Виталий Витальевич Аверьянов Способ и устройство для взаимодействия с виртуальными объектами
JP6553418B2 (ja) * 2015-06-12 2019-07-31 パナソニック インテレクチュアル プロパティ コーポレーション オブ アメリカＰａｎａｓｏｎｉｃ Ｉｎｔｅｌｌｅｃｔｕａｌ Ｐｒｏｐｅｒｔｙ Ｃｏｒｐｏｒａｔｉｏｎ ｏｆ Ａｍｅｒｉｃａ 表示制御方法、表示制御装置及び制御プログラム
US20160366317A1 (en) * 2015-06-12 2016-12-15 Delta ID Inc. Apparatuses and methods for image based biometric recognition
US10136852B2 (en) 2015-06-14 2018-11-27 Facense Ltd. Detecting an allergic reaction from nasal temperatures
US10299717B2 (en) 2015-06-14 2019-05-28 Facense Ltd. Detecting stress based on thermal measurements of the face
US10154810B2 (en) 2015-06-14 2018-12-18 Facense Ltd. Security system that detects atypical behavior
US10045726B2 (en) 2015-06-14 2018-08-14 Facense Ltd. Selecting a stressor based on thermal measurements of the face
US10085685B2 (en) 2015-06-14 2018-10-02 Facense Ltd. Selecting triggers of an allergic reaction based on nasal temperatures
US9968264B2 (en) 2015-06-14 2018-05-15 Facense Ltd. Detecting physiological responses based on thermal asymmetry of the face
US10113913B2 (en) 2015-10-03 2018-10-30 Facense Ltd. Systems for collecting thermal measurements of the face
US10130261B2 (en) 2015-06-14 2018-11-20 Facense Ltd. Detecting physiological responses while taking into account consumption of confounding substances
US10064559B2 (en) 2015-06-14 2018-09-04 Facense Ltd. Identification of the dominant nostril using thermal measurements
US10523852B2 (en) 2015-06-14 2019-12-31 Facense Ltd. Wearable inward-facing camera utilizing the Scheimpflug principle
US10080861B2 (en) 2015-06-14 2018-09-25 Facense Ltd. Breathing biofeedback eyeglasses
US10076250B2 (en) 2015-06-14 2018-09-18 Facense Ltd. Detecting physiological responses based on multispectral data from head-mounted cameras
US10076270B2 (en) 2015-06-14 2018-09-18 Facense Ltd. Detecting physiological responses while accounting for touching the face
DE102016110903A1 (de) * 2015-06-14 2016-12-15 Facense Ltd. Head-Mounted-Devices zur Messung physiologischer Reaktionen
US10045699B2 (en) 2015-06-14 2018-08-14 Facense Ltd. Determining a state of a user based on thermal measurements of the forehead
US10130299B2 (en) 2015-06-14 2018-11-20 Facense Ltd. Neurofeedback eyeglasses
US10130308B2 (en) 2015-06-14 2018-11-20 Facense Ltd. Calculating respiratory parameters from thermal measurements
US10159411B2 (en) 2015-06-14 2018-12-25 Facense Ltd. Detecting irregular physiological responses during exposure to sensitive data
US10216981B2 (en) 2015-06-14 2019-02-26 Facense Ltd. Eyeglasses that measure facial skin color changes
US10151636B2 (en) 2015-06-14 2018-12-11 Facense Ltd. Eyeglasses having inward-facing and outward-facing thermal cameras
US10045737B2 (en) 2015-06-14 2018-08-14 Facense Ltd. Clip-on device with inward-facing cameras
US10136856B2 (en) 2016-06-27 2018-11-27 Facense Ltd. Wearable respiration measurements system
US10092232B2 (en) 2015-06-14 2018-10-09 Facense Ltd. User state selection based on the shape of the exhale stream
CN107924085B (zh) 2015-06-15 2022-09-02 奇跃公司 虚拟和增强现实系统以及方法
US10043487B2 (en) * 2015-06-24 2018-08-07 Samsung Electronics Co., Ltd. Apparatus and method for split screen display on mobile device
US10685488B1 (en) * 2015-07-17 2020-06-16 Naveen Kumar Systems and methods for computer assisted operation
CN104966359B (zh) * 2015-07-20 2018-01-30 京东方科技集团股份有限公司 防盗报警系统和方法
TWI570638B (zh) * 2015-07-29 2017-02-11 財團法人資訊工業策進會 凝視分析方法與裝置
EP3332311B1 (en) * 2015-08-04 2019-12-04 Google LLC Hover behavior for gaze interactions in virtual reality
US10178150B2 (en) * 2015-08-07 2019-01-08 International Business Machines Corporation Eye contact-based information transfer
CN114998557A (zh) 2015-08-18 2022-09-02 奇跃公司 虚拟和增强现实系统和方法
CN105184246B (zh) * 2015-08-28 2020-05-19 北京旷视科技有限公司 活体检测方法和活体检测系统
US10331312B2 (en) 2015-09-08 2019-06-25 Apple Inc. Intelligent automated assistant in a media environment
US10671428B2 (en) 2015-09-08 2020-06-02 Apple Inc. Distributed personal assistant
US10747498B2 (en) 2015-09-08 2020-08-18 Apple Inc. Zero latency digital assistant
US20170200316A1 (en) * 2015-09-10 2017-07-13 Sphere Optics Company, Llc Advertising system for virtual reality environments
IN2015DE02924A (https=) * 2015-09-16 2015-10-23 Hcl Technologies Ltd
CN108351700B (zh) 2015-09-16 2022-08-12 奇跃公司 音频文件的头部姿势混合
JP6684559B2 (ja) * 2015-09-16 2020-04-22 株式会社バンダイナムコエンターテインメント プログラムおよび画像生成装置
US9858706B2 (en) * 2015-09-22 2018-01-02 Facebook, Inc. Systems and methods for content streaming
US10096130B2 (en) 2015-09-22 2018-10-09 Facebook, Inc. Systems and methods for content streaming
HK1256792A1 (zh) 2015-09-23 2019-10-04 Magic Leap, Inc. 采用离轴成像器的眼睛成像
CN108762496B (zh) * 2015-09-24 2020-12-18 联想(北京)有限公司 一种信息处理方法及电子设备
WO2017058826A1 (en) 2015-09-28 2017-04-06 Google Inc. Sharing images and image albums over a communication network
USD791787S1 (en) * 2015-09-28 2017-07-11 Google Inc. Display screen with a transitional graphical user interface for a photo album
US9635167B2 (en) 2015-09-29 2017-04-25 Paypal, Inc. Conversation assistance system
US11587559B2 (en) 2015-09-30 2023-02-21 Apple Inc. Intelligent device identification
US10715997B2 (en) * 2015-10-08 2020-07-14 Huawei Technologies Co., Ltd. Method for protecting private information and terminal device
US20220313083A1 (en) * 2015-10-09 2022-10-06 Senseye, Inc. Cognitive, emotional, mental and psychological diagnostic engine via the eye
EP3156880A1 (en) * 2015-10-14 2017-04-19 Ecole Nationale de l'Aviation Civile Zoom effect in gaze tracking interface
KR102701209B1 (ko) 2015-10-20 2024-08-29 매직 립, 인코포레이티드 3차원 공간에서 가상 객체들 선택
US10466780B1 (en) * 2015-10-26 2019-11-05 Pillantas Systems and methods for eye tracking calibration, eye vergence gestures for interface control, and visual aids therefor
US10831922B1 (en) 2015-10-30 2020-11-10 United Services Automobile Association (Usaa) System and method for access control
US11340698B2 (en) * 2015-10-30 2022-05-24 University Of Massachusetts System and methods for evaluating images and other subjects
JP6983773B2 (ja) 2015-11-04 2021-12-17 マジック リープ, インコーポレイテッドMagic Leap, Inc. 眼追跡に基づく動的ディスプレイ較正
US11231544B2 (en) 2015-11-06 2022-01-25 Magic Leap, Inc. Metasurfaces for redirecting light and methods for fabricating
US10691473B2 (en) 2015-11-06 2020-06-23 Apple Inc. Intelligent automated assistant in a messaging environment
MY195915A (en) * 2015-11-19 2023-02-27 Angel Playing Cards Co Ltd Management System for Table Games and Substitute Currency for Gaming
US10061552B2 (en) * 2015-11-25 2018-08-28 International Business Machines Corporation Identifying the positioning in a multiple display grid
CN105528577B (zh) * 2015-12-04 2019-02-12 深圳大学 基于智能眼镜的识别方法
US9703374B1 (en) * 2015-12-16 2017-07-11 Google, Inc. In-cell gaze tracking for near-eye display
US10097443B2 (en) * 2015-12-16 2018-10-09 Fluke Corporation System and method for secure communications between a computer test tool and a cloud-based server
EP3392740A4 (en) * 2015-12-18 2018-12-19 Sony Corporation Information processing device, information processing method, and program
US20200301150A1 (en) * 2015-12-28 2020-09-24 Intelligent Technologies International, Inc. Secure testing device with liquid crystal shutter
US10102358B2 (en) * 2015-12-29 2018-10-16 Sensory, Incorporated Face-controlled liveness verification
WO2017113757A1 (zh) * 2015-12-31 2017-07-06 北京小鸟看看科技有限公司 一种环绕式界面布局方法、三维沉浸式环境下内容切换方法和列表切换方法
CN105892642A (zh) * 2015-12-31 2016-08-24 乐视移动智能信息技术（北京）有限公司 一种根据眼部动作对终端进行控制的方法及装置
CN106940766A (zh) * 2016-01-04 2017-07-11 由田新技股份有限公司 视线轨迹认证系统及方法
JP6231585B2 (ja) * 2016-01-05 2017-11-15 株式会社Ｑｄレーザ 画像投影装置
KR102466996B1 (ko) * 2016-01-06 2022-11-14 삼성전자주식회사 눈 위치 예측 방법 및 장치
US10466480B2 (en) 2016-01-07 2019-11-05 Magic Leap, Inc. Virtual and augmented reality systems and methods having unequal numbers of component color images distributed across depth planes
JP2017123050A (ja) * 2016-01-07 2017-07-13 ソニー株式会社 情報処理装置、情報処理方法、プログラム、及びサーバ
WO2017123702A1 (en) 2016-01-12 2017-07-20 Princeton Identity, Inc. Systems and methods biometric analysis
JP6952713B2 (ja) 2016-01-19 2021-10-20 マジック リープ， インコーポレイテッドＭａｇｉｃ Ｌｅａｐ，Ｉｎｃ． 反射を利用する拡張現実システムおよび方法
WO2017132050A1 (en) 2016-01-29 2017-08-03 Magic Leap, Inc. Display for three-dimensional image
US10169560B2 (en) * 2016-02-04 2019-01-01 Lenovo Enterprise Solutions (Singapore) Pte. Ltd. Stimuli-based authentication
IL302656B2 (en) 2016-02-11 2024-10-01 Magic Leap Inc Multi-depth plane display system with reduced switching between depth planes
KR101729434B1 (ko) * 2016-02-16 2017-04-24 주식회사 시큐브 공간분할 세그먼트에 대한 동적이동 추적 기반 수기서명 인증 시스템 및 방법
US10591728B2 (en) 2016-03-02 2020-03-17 Mentor Acquisition One, Llc Optical systems for head-worn computers
US10129510B2 (en) 2016-02-18 2018-11-13 Samsung Electronics Co., Ltd. Initiating human-machine interaction based on visual attention
CA3014496A1 (en) 2016-02-24 2017-08-31 Magic Leap, Inc. Polarizing beam splitter with low light leakage
JP6991981B2 (ja) 2016-02-24 2022-01-13 マジック リープ， インコーポレイテッド 光エミッタのための薄型相互接続子
IL261148B2 (en) 2016-02-26 2023-12-01 Magic Leap Inc Light output system with reflector and lens for highly spatially uniform light output
IL295839A (en) 2016-02-26 2022-10-01 Magic Leap Inc Display system having a plurality of light pipes for a plurality of light emitters
US10667981B2 (en) 2016-02-29 2020-06-02 Mentor Acquisition One, Llc Reading assistance system for visually impaired
US10571693B2 (en) 2016-03-01 2020-02-25 Magic Leap, Inc. Reflective switching device for inputting different wavelengths of light into waveguides
CN114690881A (zh) * 2016-03-04 2022-07-01 奇跃公司 减少用电的显示系统以及用于减少显示系统的用电的方法
US10127369B2 (en) 2016-03-07 2018-11-13 Magic Leap, Inc. Blue light adjustment for biometric security
US10115205B2 (en) 2016-03-11 2018-10-30 Facebook Technologies, Llc Eye tracking system with single point calibration
CN108780223B (zh) * 2016-03-11 2019-12-20 脸谱科技有限责任公司 用于生成眼睛模型的角膜球跟踪
JP6889728B2 (ja) 2016-03-11 2021-06-18 マジック リープ， インコーポレイテッドＭａｇｉｃ Ｌｅａｐ，Ｉｎｃ． 畳み込みニューラルネットワークにおける構造学習
US10579708B1 (en) * 2016-03-22 2020-03-03 Massachusetts Mutual Life Insurance Company Systems and methods for improving workflow efficiency and for electronic record population utilizing intelligent input systems
US10360254B1 (en) 2016-03-24 2019-07-23 Massachusetts Mutual Life Insurance Company Intelligent and context aware reading systems
US10306311B1 (en) 2016-03-24 2019-05-28 Massachusetts Mutual Life Insurance Company Intelligent and context aware reading systems
KR20180122726A (ko) 2016-03-25 2018-11-13 매직 립, 인코포레이티드 가상 및 증강 현실 시스템들 및 방법들
JP6728863B2 (ja) * 2016-03-25 2020-07-22 富士ゼロックス株式会社 情報処理システム
US10372205B2 (en) 2016-03-31 2019-08-06 Sony Interactive Entertainment Inc. Reducing rendering computation and power consumption by detecting saccades and blinks
US10088898B2 (en) 2016-03-31 2018-10-02 Verizon Patent And Licensing Inc. Methods and systems for determining an effectiveness of content in an immersive virtual reality world
US10373008B2 (en) 2016-03-31 2019-08-06 Princeton Identity, Inc. Systems and methods of biometric analysis with adaptive trigger
US10401952B2 (en) 2016-03-31 2019-09-03 Sony Interactive Entertainment Inc. Reducing rendering computation and power consumption by detecting saccades and blinks
US10366296B2 (en) 2016-03-31 2019-07-30 Princeton Identity, Inc. Biometric enrollment systems and methods
US10192528B2 (en) 2016-03-31 2019-01-29 Sony Interactive Entertainment Inc. Real-time user adaptive foveated rendering
US10169846B2 (en) 2016-03-31 2019-01-01 Sony Interactive Entertainment Inc. Selective peripheral vision filtering in a foveated rendering system
WO2017172982A1 (en) 2016-03-31 2017-10-05 Magic Leap, Inc. Interactions with 3d virtual objects using poses and multiple-dof controllers
DE102016106390A1 (de) * 2016-04-07 2017-10-12 Bundesdruckerei Gmbh Brillen-authentifikationsvorrichtung zum authentifizieren einer person
KR20220040511A (ko) 2016-04-08 2022-03-30 매직 립, 인코포레이티드 가변 포커스 렌즈 엘리먼트들을 가진 증강 현실 시스템들 및 방법들
US20170291723A1 (en) * 2016-04-11 2017-10-12 Honeywell International Inc. System and method for validating flight checklist items for maintenance and inspection applications
KR101904889B1 (ko) * 2016-04-21 2018-10-05 주식회사 비주얼캠프 표시 장치와 이를 이용한 입력 처리 방법 및 시스템
IL262279B2 (en) 2016-04-21 2023-04-01 Magic Leap Inc A visual aura around the field of vision
NZ747815A (en) 2016-04-26 2023-05-26 Magic Leap Inc Electromagnetic tracking with augmented reality systems
CN105897428B (zh) * 2016-04-28 2019-06-25 武汉大学 一种基于虹膜识别的实时视频安全通讯系统及方法
CN113484944A (zh) 2016-05-06 2021-10-08 奇跃公司 具有用于重定向光的非对称光栅的超表面及其制造方法
IL289757B2 (en) 2016-05-09 2024-12-01 Magic Leap Inc Augmented reality systems and methods for user health analysis
WO2017193165A1 (en) 2016-05-10 2017-11-16 National Ict Australia Limited Authenticating a user
KR102450431B1 (ko) 2016-05-12 2022-10-04 매직 립, 인코포레이티드 이미징 도파관을 통해 분배된 광 조작
WO2017201329A1 (en) 2016-05-20 2017-11-23 Magic Leap, Inc. Contextual awareness of user interface menus
US10065658B2 (en) * 2016-05-23 2018-09-04 International Business Machines Corporation Bias of physical controllers in a system
US20180249941A1 (en) * 2016-05-24 2018-09-06 neuroFit, Inc. Oculometric Neurological Examination (ONE) Appliance
US10901496B2 (en) * 2016-05-25 2021-01-26 Sony Interactive Entertainment Inc. Image processing apparatus, image processing method, and program
US10037080B2 (en) * 2016-05-31 2018-07-31 Paypal, Inc. User physical attribute based device and content management system
USD796551S1 (en) * 2016-06-03 2017-09-05 Samsung Electronics Co., Ltd. Display screen or portion thereof with icon
IL297603A (en) 2016-06-03 2022-12-01 Magic Leap Inc Augmented reality identity verification
US11108708B2 (en) 2016-06-06 2021-08-31 Global Tel*Link Corporation Personalized chatbots for inmates
EP3469251B1 (en) 2016-06-10 2021-07-07 Magic Leap, Inc. Integrating point source for texture projecting bulb
US10586535B2 (en) 2016-06-10 2020-03-10 Apple Inc. Intelligent digital assistant in a multi-tasking environment
DK201670540A1 (en) 2016-06-11 2018-01-08 Apple Inc Application integration with a digital assistant
US12197817B2 (en) 2016-06-11 2025-01-14 Apple Inc. Intelligent device arbitration and control
US10009536B2 (en) 2016-06-12 2018-06-26 Apple Inc. Applying a simulated optical effect based on data received from multiple camera sensors
DK201670737A1 (en) * 2016-06-12 2018-01-22 Apple Inc Devices, Methods, and Graphical User Interfaces for Providing Haptic Feedback
US10339659B2 (en) * 2016-06-13 2019-07-02 International Business Machines Corporation System, method, and recording medium for workforce performance management
KR102362001B1 (ko) * 2016-06-16 2022-02-14 애플 인크. 사용자 거동에 관한 눈 추적 기반 정보를 제공하기 위한 방법 및 시스템, 클라이언트 디바이스, 서버 및 컴퓨터 프로그램 제품
US10565287B2 (en) * 2016-06-17 2020-02-18 International Business Machines Corporation Web content layout engine instance sharing across mobile devices
KR102491130B1 (ko) 2016-06-20 2023-01-19 매직 립, 인코포레이티드 시각적 프로세싱 및 지각 상태들을 포함하는 신경학적 상태들의 평가 및 수정을 위한 증강 현실 디스플레이 시스템
CN106200905B (zh) * 2016-06-27 2019-03-29 联想(北京)有限公司 信息处理方法及电子设备
US11354863B2 (en) * 2016-06-30 2022-06-07 Honeywell International Inc. Systems and methods for immersive and collaborative video surveillance
EP3479160B1 (en) 2016-06-30 2024-07-24 Magic Leap, Inc. Estimating pose in 3d space
US10200262B1 (en) * 2016-07-08 2019-02-05 Splunk Inc. Continuous anomaly detection service
US10146609B1 (en) 2016-07-08 2018-12-04 Splunk Inc. Configuration of continuous anomaly detection service
US10650593B2 (en) 2016-07-12 2020-05-12 Tyco Fire & Security Gmbh Holographic technology implemented security solution
US10296792B2 (en) 2016-07-14 2019-05-21 Magic Leap, Inc. Iris boundary estimation using cornea curvature
KR102648770B1 (ko) * 2016-07-14 2024-03-15 매직 립, 인코포레이티드 홍채 식별을 위한 딥 뉴럴 네트워크
WO2018016189A1 (ja) 2016-07-22 2018-01-25 ソニー株式会社 イメージセンサおよび画像処理システム
KR102723374B1 (ko) 2016-07-25 2024-10-29 매직 립, 인코포레이티드 광 필드 프로세서 시스템
EP3488283B1 (en) 2016-07-25 2024-02-14 Magic Leap, Inc. Head-mounted display system
US10491402B2 (en) 2016-07-29 2019-11-26 Magic Leap, Inc. Secure exchange of cryptographically signed records
WO2018026858A1 (en) 2016-08-02 2018-02-08 New York University Methods and kits for assessing neurological function and localizing neurological lesions
US9844321B1 (en) * 2016-08-04 2017-12-19 Novartis Ag Enhanced ophthalmic surgical experience using a virtual reality head-mounted display
US10417495B1 (en) * 2016-08-08 2019-09-17 Google Llc Systems and methods for determining biometric information
EP4398566A3 (en) 2016-08-11 2024-10-09 Magic Leap, Inc. Automatic placement of a virtual object in a three-dimensional space
IL292025B2 (en) 2016-08-12 2023-12-01 Magic Leap Inc Word flow annotation
WO2018039277A1 (en) 2016-08-22 2018-03-01 Magic Leap, Inc. Diffractive eyepiece
CN114253400A (zh) 2016-08-22 2022-03-29 奇跃公司 具有深度学习传感器的增强现实显示装置
US10835120B2 (en) * 2016-08-23 2020-11-17 Welch Allyn, Inc. Extended medical test system
CN106899567B (zh) 2016-08-24 2019-12-13 阿里巴巴集团控股有限公司 用户核身方法、装置及系统
JP6559359B2 (ja) * 2016-09-01 2019-08-14 三菱電機株式会社 ジェスチャー判定装置、ジェスチャー操作装置、及びジェスチャー判定方法
KR102257181B1 (ko) 2016-09-13 2021-05-27 매직 립, 인코포레이티드 감각 안경류
US10230719B2 (en) * 2016-09-19 2019-03-12 Intel Corporation Head mounted secure display system
CA3037044A1 (en) 2016-09-21 2018-03-29 Magic Leap, Inc. Systems and methods for optical systems with exit pupil expander
US10210320B2 (en) * 2016-09-21 2019-02-19 Lextron Systems, Inc. System and method for secure 5-D user identification
KR102786412B1 (ko) 2016-09-22 2025-03-25 매직 립, 인코포레이티드 증강 현실 분광기
WO2018057910A1 (en) 2016-09-22 2018-03-29 Apple, Inc. Postponing the state change of an information affecting the graphical user interface until during the conditon of inattentiveness
CN109791702B (zh) 2016-09-23 2023-09-29 苹果公司 头像创建和编辑
KR102626257B1 (ko) 2016-09-26 2024-01-16 매직 립, 인코포레이티드 가상 현실 또는 증강 현실 디스플레이 시스템에서 자기 및 광학 센서들의 교정
EP3519878B1 (en) 2016-09-28 2023-04-19 Magic Leap, Inc. Face model capture by a wearable device
RU2016138608A (ru) 2016-09-29 2018-03-30 Мэджик Лип, Инк. Нейронная сеть для сегментации изображения глаза и оценки качества изображения
US10430042B2 (en) * 2016-09-30 2019-10-01 Sony Interactive Entertainment Inc. Interaction context-based virtual reality
US10863902B2 (en) 2016-10-03 2020-12-15 Oculogica Inc. Method for detecting glaucoma
IL293688B2 (en) 2016-10-04 2024-02-01 Magic Leap Inc Efficient data layouts for convolutional neural networks
KR102269065B1 (ko) 2016-10-05 2021-06-24 매직 립, 인코포레이티드 혼합 현실 교정을 위한 안구주위 테스트
CN107018121B (zh) 2016-10-13 2021-07-20 创新先进技术有限公司 用户身份验证的方法及装置
US10925479B2 (en) * 2016-10-13 2021-02-23 Ronald Michael Kurtz Networked system of mobile communication platforms for nonpharmacologic constriction of a pupil
CN106997239A (zh) 2016-10-13 2017-08-01 阿里巴巴集团控股有限公司 基于虚拟现实场景的业务实现方法及装置
US9769166B1 (en) * 2016-10-19 2017-09-19 International Business Machines Corporation Wearable sensor based system for person identification
US10201274B2 (en) * 2016-10-20 2019-02-12 Oculogica Inc Eye tracking system with biometric identification
EP3529653B1 (en) 2016-10-21 2024-01-24 Magic Leap, Inc. System and method for presenting image content on multiple depth planes by providing multiple intra-pupil parallax views
US20180125405A1 (en) * 2016-11-08 2018-05-10 International Business Machines Corporation Mental state estimation using feature of eye movement
US10660517B2 (en) 2016-11-08 2020-05-26 International Business Machines Corporation Age estimation using feature of eye movement
US11074325B1 (en) * 2016-11-09 2021-07-27 Wells Fargo Bank, N.A. Systems and methods for dynamic bio-behavioral authentication
KR102217797B1 (ko) 2016-11-11 2021-02-18 매직 립, 인코포레이티드 전체 얼굴 이미지의 안구주위 및 오디오 합성
EP4120107A1 (en) * 2016-11-14 2023-01-18 MasterCard International Incorporated Method for biometric based signing of document
WO2018086399A1 (zh) * 2016-11-14 2018-05-17 华为技术有限公司 一种图像渲染的方法、装置及vr设备
KR102610030B1 (ko) * 2016-11-15 2023-12-04 매직 립, 인코포레이티드 큐보이드 검출을 위한 딥 러닝 시스템
JP7037561B2 (ja) 2016-11-16 2022-03-16 マジック リープ， インコーポレイテッド ウェアラブルコンポーネントのための熱管理システム
WO2018093923A1 (en) * 2016-11-16 2018-05-24 Magic Leap, Inc. Mixed reality system with reduced power rendering
US10867445B1 (en) * 2016-11-16 2020-12-15 Amazon Technologies, Inc. Content segmentation and navigation
IL312713A (en) 2016-11-18 2024-07-01 Magic Leap Inc Waveguide light multiplexer using crossed gratings
CN110192146B (zh) 2016-11-18 2022-09-23 奇跃公司 空间可变液晶衍射光栅
BR112018074062A2 (pt) * 2016-11-18 2019-03-06 Eyedaptic, Inc. sistemas melhorados para auxílio e ferramentas visuais de realidade aumentada
JP7019695B2 (ja) 2016-11-18 2022-02-15 マジック リープ， インコーポレイテッド 広入射角範囲の光を再指向するための多層液晶回折格子
US20180144554A1 (en) 2016-11-18 2018-05-24 Eyedaptic, LLC Systems for augmented reality visual aids and tools
US11067860B2 (en) 2016-11-18 2021-07-20 Magic Leap, Inc. Liquid crystal diffractive devices with nano-scale pattern and methods of manufacturing the same
CN107066079A (zh) 2016-11-29 2017-08-18 阿里巴巴集团控股有限公司 基于虚拟现实场景的业务实现方法及装置
CN206301289U (zh) * 2016-11-29 2017-07-04 阿里巴巴集团控股有限公司 Vr终端设备
KR20180061956A (ko) * 2016-11-30 2018-06-08 삼성전자주식회사 눈 위치 예측 방법 및 장치
EP4220572B1 (en) 2016-12-05 2025-05-14 Magic Leap, Inc. Virtual user input controls in a mixed reality environment
US10531220B2 (en) 2016-12-05 2020-01-07 Magic Leap, Inc. Distributed audio capturing techniques for virtual reality (VR), augmented reality (AR), and mixed reality (MR) systems
WO2018106963A1 (en) 2016-12-08 2018-06-14 Magic Leap, Inc. Diffractive devices based on cholesteric liquid crystal
US10796147B1 (en) * 2016-12-12 2020-10-06 Keith Hanna Method and apparatus for improving the match performance and user convenience of biometric systems that use images of the human eye
IL299220A (en) 2016-12-13 2023-02-01 Magic Leap Inc Glasses systems for augmented and virtual reality and methods for supplying polarized light and determining glucose levels
KR102497707B1 (ko) 2016-12-13 2023-02-08 매직 립, 인코포레이티드 검출된 특징들을 사용한 3d 객체 렌더링
IL301448B2 (en) 2016-12-14 2024-08-01 Magic Leap Inc Structures of liquid crystals through fine-imprint copying of surface alignment templates
CN114675420A (zh) 2016-12-22 2022-06-28 奇跃公司 用于操纵来自环境光源的光的系统和方法
US10885676B2 (en) 2016-12-27 2021-01-05 Samsung Electronics Co., Ltd. Method and apparatus for modifying display settings in virtual/augmented reality
US10746999B2 (en) 2016-12-28 2020-08-18 Magic Leap, Inc. Dual depth exit pupil expander
EP3563215A4 (en) 2016-12-29 2020-08-05 Magic Leap, Inc. AUTOMATIC CONTROL OF A WEARABLE DISPLAY DEVICE BASED ON EXTERNAL CONDITIONS
US10853775B1 (en) * 2016-12-29 2020-12-01 Wells Fargo Bank, N.A. Computing systems for proximity-based fees
US10650552B2 (en) 2016-12-29 2020-05-12 Magic Leap, Inc. Systems and methods for augmented reality
EP4300160A3 (en) 2016-12-30 2024-05-29 Magic Leap, Inc. Polychromatic light out-coupling apparatus, near-eye displays comprising the same, and method of out-coupling polychromatic light
EP4122897A1 (en) 2017-01-05 2023-01-25 Magic Leap, Inc. Patterning of high refractive index glasses by plasma etching
US11204787B2 (en) 2017-01-09 2021-12-21 Apple Inc. Application integration with a digital assistant
JP7224288B2 (ja) 2017-01-11 2023-02-17 マジック リープ， インコーポレイテッド 医療アシスタント
CA3051239C (en) 2017-01-23 2023-12-19 Magic Leap, Inc. Eyepiece for virtual, augmented, or mixed reality systems
KR20240074923A (ko) 2017-01-27 2024-05-28 매직 립, 인코포레이티드 상이하게 배향된 나노빔들을 갖는 메타표면들에 의해 형성된 회절 격자
CN110476090B (zh) 2017-01-27 2023-04-25 奇跃公司 用于超表面的抗反射涂层
US10404804B2 (en) 2017-01-30 2019-09-03 Global Tel*Link Corporation System and method for personalized virtual reality experience in a controlled environment
US10824703B1 (en) * 2017-02-01 2020-11-03 United Services Automobile Association (Usaa) Authentication based on motion and biometric data
US10140773B2 (en) * 2017-02-01 2018-11-27 Accenture Global Solutions Limited Rendering virtual objects in 3D environments
US10416769B2 (en) * 2017-02-14 2019-09-17 Microsoft Technology Licensing, Llc Physical haptic feedback system with spatial warping
US11347054B2 (en) 2017-02-16 2022-05-31 Magic Leap, Inc. Systems and methods for augmented reality
US10485420B2 (en) * 2017-02-17 2019-11-26 Analog Devices Global Unlimited Company Eye gaze tracking
US11141095B2 (en) 2017-02-17 2021-10-12 Oculogica Inc. Method and system for detecting concussion
US20180239422A1 (en) * 2017-02-17 2018-08-23 International Business Machines Corporation Tracking eye movements with a smart device
IL268630B2 (en) 2017-02-23 2023-09-01 Magic Leap Inc Display system with variable power reflector
CN106932905A (zh) 2017-02-27 2017-07-07 阿里巴巴集团控股有限公司 虚拟现实头戴设备
CN106873159A (zh) 2017-02-27 2017-06-20 阿里巴巴集团控股有限公司 虚拟现实头戴设备
CN106873158A (zh) * 2017-02-27 2017-06-20 阿里巴巴集团控股有限公司 虚拟现实头戴设备
US11214384B2 (en) 2017-03-06 2022-01-04 Textron Innovations, Inc. Hexagonal floor and ceiling system for a vehicle
US10568573B2 (en) * 2017-03-07 2020-02-25 Sony Interactive Entertainment LLC Mitigation of head-mounted-display impact via biometric sensors and language processing
US10628994B2 (en) * 2017-03-07 2020-04-21 Google Llc Reducing visually induced motion sickness in head mounted display systems
JP7057893B2 (ja) * 2017-03-07 2022-04-21 マツダ株式会社 視認状態判定装置
US10169973B2 (en) 2017-03-08 2019-01-01 International Business Machines Corporation Discontinuing display of virtual content and providing alerts based on hazardous physical obstructions
IL301886A (en) 2017-03-14 2023-06-01 Magic Leap Inc Waveguides with light absorbing layers and processes for their creation
US10657838B2 (en) 2017-03-15 2020-05-19 International Business Machines Corporation System and method to teach and evaluate image grading performance using prior learned expert knowledge base
CN107122642A (zh) * 2017-03-15 2017-09-01 阿里巴巴集团控股有限公司 基于虚拟现实环境的身份认证方法及装置
AU2018236433B2 (en) 2017-03-17 2022-03-03 Magic Leap, Inc. Room layout estimation methods and techniques
IL269317B2 (en) 2017-03-21 2023-11-01 Magic Leap Inc An eye imaging device that uses optical refractive elements
CN110462487B (zh) 2017-03-21 2022-07-01 奇跃公司 用于组合视场的具有不同衍射光栅的堆叠波导
CN110651216B (zh) 2017-03-21 2022-02-25 奇跃公司 低轮廓分束器
KR102701690B1 (ko) 2017-03-21 2024-08-30 매직 립, 인코포레이티드 분할된 동공들을 위한 공간 광 변조기 조명을 갖는 디스플레이 시스템
KR102767824B1 (ko) 2017-03-21 2025-02-13 매직 립, 인코포레이티드 공간 광 변조기들을 조명하기 위한 방법들, 디바이스들, 및 시스템들
AU2018237067B2 (en) 2017-03-21 2022-11-10 Magic Leap, Inc. Depth sensing techniques for virtual, augmented, and mixed reality systems
IL300511A (en) 2017-03-22 2023-04-01 Magic Leap Inc Depth-based rendering for display systems
AU2018237688B2 (en) 2017-03-24 2022-08-25 Magic Leap, Inc. Accumulation and confidence assignment of iris codes
US10410349B2 (en) * 2017-03-27 2019-09-10 Microsoft Technology Licensing, Llc Selective application of reprojection processing on layer sub-regions for optimizing late stage reprojection power
KR102578929B1 (ko) * 2017-03-27 2023-09-15 아브간트 코포레이션 조향 가능한 중심와 디스플레이
CN110476139B (zh) 2017-03-28 2024-01-02 奇跃公司 具有关联到用户操纵的虚拟对象的空间化音频的增强现实系统
CN106990843B (zh) * 2017-04-01 2021-01-08 维沃移动通信有限公司 一种眼睛跟踪系统的参数校准方法及电子设备
WO2018187337A1 (en) * 2017-04-04 2018-10-11 Princeton Identity, Inc. Z-dimension user feedback biometric system
US10609025B2 (en) * 2017-04-06 2020-03-31 Htc Corporation System and method for providing simulated environment
CN110520824B (zh) * 2017-04-14 2023-11-24 奇跃公司 多模式眼睛跟踪
CN107097227B (zh) * 2017-04-17 2019-12-06 北京航空航天大学 一种人机协作机器人系统
US10401954B2 (en) 2017-04-17 2019-09-03 Intel Corporation Sensory enhanced augmented reality and virtual reality device
US10242486B2 (en) * 2017-04-17 2019-03-26 Intel Corporation Augmented reality and virtual reality feedback enhancement system, apparatus and method
KR102377377B1 (ko) 2017-04-18 2022-03-21 매직 립, 인코포레이티드 반사 유동성 재료들에 의해 형성된 반사 층들을 갖는 도파관들
US10768693B2 (en) 2017-04-19 2020-09-08 Magic Leap, Inc. Multimodal task execution and text editing for a wearable system
US10564733B2 (en) 2017-04-21 2020-02-18 Htc Corporation Operating method of tracking system, controller, tracking system, and non-transitory computer readable storage medium
US11416600B2 (en) * 2017-04-24 2022-08-16 Siemens Aktiengesellschaft Unlocking passwords in augmented reality based on look
US10620779B2 (en) * 2017-04-24 2020-04-14 Microsoft Technology Licensing, Llc Navigating a holographic image
JP7231556B2 (ja) 2017-04-27 2023-03-01 マジック リープ， インコーポレイテッド 発光ユーザ入力デバイス
KR20180123354A (ko) * 2017-05-08 2018-11-16 엘지전자 주식회사 차량용 사용자 인터페이스 장치 및 차량
DK180048B1 (en) 2017-05-11 2020-02-04 Apple Inc. MAINTAINING THE DATA PROTECTION OF PERSONAL INFORMATION
DK179496B1 (en) 2017-05-12 2019-01-15 Apple Inc. USER-SPECIFIC Acoustic Models
DK201770429A1 (en) 2017-05-12 2018-12-14 Apple Inc. LOW-LATENCY INTELLIGENT AUTOMATED ASSISTANT
DK201770411A1 (en) 2017-05-15 2018-12-20 Apple Inc. Multi-modal interfaces
US10303715B2 (en) 2017-05-16 2019-05-28 Apple Inc. Intelligent automated assistant for media exploration
DK179549B1 (en) 2017-05-16 2019-02-12 Apple Inc. FAR-FIELD EXTENSION FOR DIGITAL ASSISTANT SERVICES
US10432728B2 (en) 2017-05-17 2019-10-01 Google Llc Automatic image sharing with designated users over a communication network
TWI669657B (zh) * 2017-05-17 2019-08-21 宏碁股份有限公司 具自適性控制之主機、頭戴式顯示裝置、攜帶式裝置、虛擬實境系統及其控制方法
EP4465262A3 (en) 2017-05-19 2025-01-08 Magic Leap, Inc. Keyboards for virtual, augmented, and mixed reality display systems
KR102834906B1 (ko) 2017-05-22 2025-07-16 매직 립, 인코포레이티드 컴패니언 디바이스와의 페어링
GB2563004A (en) * 2017-05-23 2018-12-05 Nokia Technologies Oy Methods and apparatuses for handling visual virtual reality content
US10339334B2 (en) * 2017-05-25 2019-07-02 Ca, Inc. Augmented reality captcha
CN107224292B (zh) * 2017-05-27 2019-12-31 西南交通大学 一种调度员的注意广度的测试方法和系统
KR102664361B1 (ko) 2017-05-30 2024-05-10 매직 립, 인코포레이티드 전자 디바이스를 위한 팬 조립체를 갖는 전력 공급기 조립체
KR102670987B1 (ko) 2017-05-31 2024-05-30 매직 립, 인코포레이티드 눈 추적 교정 기술들
DE102017111933A1 (de) * 2017-05-31 2018-12-06 Krohne Messtechnik Gmbh Verfahren zur sicheren Kommunikation mit einem Feldmessgerät der Prozesstechnik und entsprechendes Feldmessgerät
US10242476B2 (en) * 2017-05-31 2019-03-26 Verizon Patent and Licensong Inc. Methods and systems for dynamically representing, within a virtual reality data stream being presented to a user, a proxy object that corresponds to an object in the real-world environment of the user
US11647903B2 (en) * 2017-06-01 2023-05-16 University Of Washington Smartphone-based digital pupillometer
DK180859B1 (en) 2017-06-04 2022-05-23 Apple Inc USER INTERFACE CAMERA EFFECTS
US10528794B2 (en) * 2017-06-05 2020-01-07 Motorola Solutions, Inc. System and method for tailoring an electronic digital assistant inquiry response as a function of previously detected user ingestion of related video information
US10657401B2 (en) 2017-06-06 2020-05-19 Microsoft Technology Licensing, Llc Biometric object spoof detection based on image intensity variations
EP3413226A1 (en) * 2017-06-07 2018-12-12 Gemalto Sa Method for authenticating a user and corresponding device and system
US10853918B2 (en) * 2017-06-09 2020-12-01 Sony Interactive Entertainment Inc. Foveal adaptation of temporal anti-aliasing
IL300301B2 (en) 2017-06-12 2024-08-01 Magic Leap Inc Augmented reality display with multi-component adaptive lenses to change plane depths
CN107633196A (zh) * 2017-06-14 2018-01-26 电子科技大学 一种基于卷积神经网络的眼球移动预测方案
US10810773B2 (en) * 2017-06-14 2020-10-20 Dell Products, L.P. Headset display control based upon a user's pupil state
US10620710B2 (en) * 2017-06-15 2020-04-14 Microsoft Technology Licensing, Llc Displacement oriented interaction in computer-mediated reality
EP3416079A1 (de) * 2017-06-16 2018-12-19 Connexcom Ag Computerimplementiertes verfahren und computerprogrammprodukt zur zugangssteuerung eines endgeräts
US11122258B2 (en) 2017-06-30 2021-09-14 Pcms Holdings, Inc. Method and apparatus for generating and displaying 360-degree video based on eye tracking and physiological measurements
US10482229B2 (en) * 2017-06-30 2019-11-19 Wipro Limited Method of providing content access permission to a user and a device thereof
US20190012552A1 (en) * 2017-07-06 2019-01-10 Yves Lambert Hidden driver monitoring
US10573061B2 (en) 2017-07-07 2020-02-25 Nvidia Corporation Saccadic redirection for virtual reality locomotion
US10319151B2 (en) * 2017-07-07 2019-06-11 Motorola Solutions, Inc. Device and method for hierarchical object recognition
US20190012835A1 (en) * 2017-07-07 2019-01-10 Microsoft Technology Licensing, Llc Driving an Image Capture System to Serve Plural Image-Consuming Processes
US10573071B2 (en) 2017-07-07 2020-02-25 Nvidia Corporation Path planning for virtual reality locomotion
US20190012841A1 (en) 2017-07-09 2019-01-10 Eyedaptic, Inc. Artificial intelligence enhanced system for adaptive control driven ar/vr visual aids
US10908680B1 (en) 2017-07-12 2021-02-02 Magic Leap, Inc. Pose estimation using electromagnetic tracking
US10691945B2 (en) 2017-07-14 2020-06-23 International Business Machines Corporation Altering virtual content based on the presence of hazardous physical obstructions
US10578870B2 (en) 2017-07-26 2020-03-03 Magic Leap, Inc. Exit pupil expander
US11073904B2 (en) * 2017-07-26 2021-07-27 Microsoft Technology Licensing, Llc Intelligent user interface element selection using eye-gaze
WO2019023032A1 (en) 2017-07-26 2019-01-31 Princeton Identity, Inc. METHODS AND SYSTEMS FOR BIOMETRIC SECURITY
KR102368661B1 (ko) 2017-07-26 2022-02-28 매직 립, 인코포레이티드 사용자 인터페이스 디바이스들의 표현들을 이용한 뉴럴 네트워크 트레이닝
US11237691B2 (en) * 2017-07-26 2022-02-01 Microsoft Technology Licensing, Llc Intelligent response using eye gaze
US11355023B2 (en) * 2017-07-27 2022-06-07 Kennesaw State University Research And Service Foundation, Inc. System and method for intervention with attention deficient disorders
CN107360424B (zh) * 2017-07-28 2019-10-25 深圳岚锋创视网络科技有限公司 一种基于视频编码器的码率控制方法、装置及视频服务器
EP3658778A4 (en) 2017-07-28 2021-04-14 Magic Leap, Inc. FAN ARRANGEMENT FOR DISPLAYING AN IMAGE
KR102026526B1 (ko) * 2017-08-03 2019-09-30 주식회사 에스지엠 생체정보를 사용하는 인증 시스템 및 이를 이용한 스크린 골프 시스템
US11587419B2 (en) * 2017-08-04 2023-02-21 Toyota Research Institute, Inc. Methods and systems providing an intelligent camera system
TWI642030B (zh) * 2017-08-09 2018-11-21 宏碁股份有限公司 視覺效用分析方法及相關眼球追蹤裝置與系統
EP3443883B1 (de) * 2017-08-14 2020-07-29 Carl Zeiss Vision International GmbH Vorrichtungen und verfahren zur durchführung augenbezogener messungen
US10812689B2 (en) * 2017-08-16 2020-10-20 Veritaz Inc. Personal display headset for mitigating user access to disallowed resources
US20190057694A1 (en) * 2017-08-17 2019-02-21 Dolby International Ab Speech/Dialog Enhancement Controlled by Pupillometry
CN107610235B (zh) * 2017-08-21 2020-11-10 北京精密机电控制设备研究所 一种基于深度学习的移动平台导航方法和装置
CN109426710A (zh) * 2017-08-22 2019-03-05 上海荆虹电子科技有限公司 一种电子虹膜印章实现方法、系统及电子签章设备
JP7532249B2 (ja) 2017-08-23 2024-08-13 ニューラブル インコーポレイテッド 高速視標追跡機能を有する脳－コンピュータインタフェース
US10313315B2 (en) * 2017-08-25 2019-06-04 Bank Of America Corporation Ensuring information security in data transfers by utilizing proximity keys
US11145124B2 (en) * 2017-08-30 2021-10-12 Ronald H. Winston System and method for rendering virtual reality interactions
US10521661B2 (en) 2017-09-01 2019-12-31 Magic Leap, Inc. Detailed eye shape model for robust biometric applications
CN111033442B (zh) * 2017-09-01 2024-07-02 奇跃公司 用于稳健的生物特征应用的详细的眼睛形状模型
JP6953247B2 (ja) * 2017-09-08 2021-10-27 ラピスセミコンダクタ株式会社 ゴーグル型表示装置、視線検出方法及び視線検出システム
US10729321B2 (en) 2017-09-13 2020-08-04 Oculogica Inc. Eye tracking system
EP3684463B1 (en) 2017-09-19 2025-05-14 Neuroenhancement Lab, LLC Method and apparatus for neuroenhancement
AU2018337653A1 (en) 2017-09-20 2020-01-16 Magic Leap, Inc. Personalized neural network for eye tracking
US11841481B2 (en) 2017-09-21 2023-12-12 Magic Leap, Inc. Augmented reality display with waveguide configured to capture images of eye and/or environment
KR102481884B1 (ko) * 2017-09-22 2022-12-28 삼성전자주식회사 가상 영상을 표시하는 방법 및 장치
WO2019057496A1 (de) * 2017-09-25 2019-03-28 Continental Automotive Gmbh Head-up-display
KR102650507B1 (ko) 2017-09-27 2024-03-21 매직 립, 인코포레이티드 별개의 위상 및 진폭 변조기들을 갖는 근안 3d 디스플레이
US11275920B1 (en) 2017-09-27 2022-03-15 Apple Inc. Elongated fingerprint sensor
US10929993B2 (en) * 2017-09-29 2021-02-23 L'oreal Automated imaging system for evaluating the curl of a keratinous substrate
EP3466338B1 (en) * 2017-10-03 2025-01-01 Tata Consultancy Services Limited Cognitive load estimation based on pupil dilation
ES2901467T3 (es) * 2017-10-06 2022-03-22 Alcon Inc Seguimiento del movimiento de un ojo dentro de un rango de seguimiento
AU2018348229A1 (en) 2017-10-11 2020-04-23 Magic Leap, Inc. Augmented reality display comprising eyepiece having a transparent emissive display
US10712899B2 (en) * 2017-10-17 2020-07-14 Microsoft Technology Licensing, Llc Human-machine interface tethered to a user position in a three-dimensional VR or AR environment
JP7273034B2 (ja) 2017-10-26 2023-05-12 マジック リープ， インコーポレイテッド 液晶可変焦点要素を有する拡張現実ディスプレイおよびそれを形成するためのロールツーロール方法および装置
AU2018355446A1 (en) 2017-10-26 2020-05-14 Magic Leap, Inc. Broadband adaptive lens assembly for augmented reality display
IL273991B2 (en) 2017-10-26 2023-11-01 Magic Leap Inc Gradual normalization systems and methods for adaptive loss balancing in deep multitasking networks
US10839576B2 (en) 2017-10-27 2020-11-17 Magic Leap, Inc. Virtual reticle for augmented reality systems
US10984508B2 (en) 2017-10-31 2021-04-20 Eyedaptic, Inc. Demonstration devices and methods for enhancement for low vision users and systems improvements
US20190129174A1 (en) * 2017-10-31 2019-05-02 Google Llc Multi-perspective eye-tracking for vr/ar systems
CN108038884B (zh) 2017-11-01 2020-12-11 北京七鑫易维信息技术有限公司 校准方法、装置、存储介质和处理器
US11410564B2 (en) 2017-11-07 2022-08-09 The Board Of Trustees Of The University Of Illinois System and method for creating immersive interactive application
US11175736B2 (en) 2017-11-10 2021-11-16 South Dakota Board Of Regents Apparatus, systems and methods for using pupillometry parameters for assisted communication
WO2019094953A1 (en) 2017-11-13 2019-05-16 Neurable Inc. Brain-computer interface with adaptations for high-speed, accurate, and intuitive user interactions
EP3709861B1 (en) 2017-11-14 2024-06-05 Vivid Vision, Inc. Systems for visual field analysis
CA3080005A1 (en) 2017-11-14 2019-05-23 Magic Leap, Inc. Meta-learning for multi-task learning for neural networks
CN109799899B (zh) * 2017-11-17 2021-10-22 腾讯科技（深圳）有限公司 交互控制方法、装置、存储介质和计算机设备
US20190156447A1 (en) * 2017-11-21 2019-05-23 Lorenzo Curci Flight Logging and Resource Management System
US10586360B2 (en) 2017-11-21 2020-03-10 International Business Machines Corporation Changing view order of augmented reality objects based on user gaze
US11282133B2 (en) 2017-11-21 2022-03-22 International Business Machines Corporation Augmented reality product comparison
US10395624B2 (en) 2017-11-21 2019-08-27 Nvidia Corporation Adjusting an angular sampling rate during rendering utilizing gaze information
CN107968937B (zh) * 2017-11-30 2018-08-17 泰州腾翔信息科技有限公司 一种缓解眼球疲劳的系统
US20230368919A1 (en) * 2017-11-30 2023-11-16 Viewmind, Inc. Method for identifying specific alterations in subjects with defined diseases analyzing oculomotor patterns when using specific visual stimuli, where a specific drug or treatment would enhance visual processing, cognitive performance and related brain activities
CN109871674A (zh) * 2017-12-04 2019-06-11 上海聚虹光电科技有限公司 Vr或ar设备分区域操作权限管理方法
US11717686B2 (en) 2017-12-04 2023-08-08 Neuroenhancement Lab, LLC Method and apparatus for neuroenhancement to facilitate learning and performance
US10656706B2 (en) * 2017-12-04 2020-05-19 International Business Machines Corporation Modifying a computer-based interaction based on eye gaze
CN109870873B (zh) * 2017-12-05 2022-04-22 青岛海信激光显示股份有限公司 一种波长转换装置、光源装置及投影系统
KR20190067433A (ko) * 2017-12-07 2019-06-17 주식회사 비주얼캠프 텍스트-리딩 기반의 리워드형 광고 서비스 제공 방법 및 이를 수행하기 위한 사용자 단말
KR20250138816A (ko) 2017-12-10 2025-09-22 매직 립, 인코포레이티드 광학 도파관들 상의 반사―방지 코팅들
US12372793B2 (en) 2017-12-11 2025-07-29 Magic Leap, Inc. Illumination layout for compact projection system
KR102717573B1 (ko) 2017-12-11 2024-10-14 매직 립, 인코포레이티드 도파관 조명기
KR102045743B1 (ko) * 2017-12-11 2019-11-18 상명대학교산학협력단 착용형 디스플레이 장비에서의 눈 영상 기반 생체 인증 장치 및 방법
US11333902B2 (en) * 2017-12-12 2022-05-17 RaayonNova LLC Smart contact lens with embedded display and image focusing system
CN107992896A (zh) * 2017-12-13 2018-05-04 东南大学 一种基于眼动追踪技术的科学概念评测方法
KR102601622B1 (ko) 2017-12-14 2023-11-10 매직 립, 인코포레이티드 가상 아바타들의 콘텍스추얼 기반 렌더링
CA3084057A1 (en) 2017-12-15 2019-06-20 Magic Leap, Inc. Enhanced pose determination for display device
EP4293414A3 (en) 2017-12-15 2024-03-13 Magic Leap, Inc. Eyepieces for augmented reality display system
CN108108019B (zh) * 2017-12-15 2021-03-19 歌尔光学科技有限公司 虚拟现实设备及其显示方法
WO2019126175A1 (en) 2017-12-20 2019-06-27 Vuzix Corporation Augmented reality display system
CA3086206A1 (en) 2017-12-20 2019-06-27 Magic Leap, Inc. Insert for augmented reality viewing device
US11478603B2 (en) 2017-12-31 2022-10-25 Neuroenhancement Lab, LLC Method and apparatus for neuroenhancement to enhance emotional response
US12280219B2 (en) 2017-12-31 2025-04-22 NeuroLight, Inc. Method and apparatus for neuroenhancement to enhance emotional response
CN120539942A (zh) 2018-01-04 2025-08-26 奇跃公司 基于结合有无机材料的聚合物结构的光学元件
CN110022454B (zh) * 2018-01-10 2021-02-23 华为技术有限公司 一种在视频会议中识别身份的方法及相关设备
US10360419B1 (en) 2018-01-15 2019-07-23 Universal City Studios Llc Interactive systems and methods with tracking devices
IL275824B2 (en) 2018-01-17 2024-08-01 Magic Leap Inc Display systems and methods for determining registration between a display and a user's eyes
KR102902962B1 (ko) 2018-01-17 2025-12-22 매직 립, 인코포레이티드 디스플레이 시스템들에서의 눈 회전 중심 결정, 깊이 평면 선택, 및 렌더 카메라 포지셔닝
WO2019144019A1 (en) * 2018-01-18 2019-07-25 Neurable Inc. Brain-computer interface with adaptations for high-speed, accurate, and intuitive user interactions
US10817068B2 (en) * 2018-01-23 2020-10-27 Toyota Research Institute, Inc. Vehicle systems and methods for determining target based on selecting a virtual eye position or a pointing direction
US10706300B2 (en) * 2018-01-23 2020-07-07 Toyota Research Institute, Inc. Vehicle systems and methods for determining a target based on a virtual eye position and a pointing direction
US10853674B2 (en) 2018-01-23 2020-12-01 Toyota Research Institute, Inc. Vehicle systems and methods for determining a gaze target based on a virtual eye position
US10540941B2 (en) 2018-01-30 2020-01-21 Magic Leap, Inc. Eclipse cursor for mixed reality displays
US11567627B2 (en) * 2018-01-30 2023-01-31 Magic Leap, Inc. Eclipse cursor for virtual content in mixed reality displays
JP6601513B2 (ja) * 2018-01-31 2019-11-06 日本電気株式会社 情報処理装置
CN110120229B (zh) * 2018-02-05 2024-09-20 北京三星通信技术研究有限公司 虚拟现实vr音频信号的处理方法及相应设备
CN110115842B (zh) * 2018-02-06 2023-01-13 日本聚逸株式会社 应用处理系统、应用处理方法以及应用处理程序
CN108337430A (zh) * 2018-02-07 2018-07-27 北京联合大学 360度无死角智能眼镜
WO2019154509A1 (en) 2018-02-09 2019-08-15 Pupil Labs Gmbh Devices, systems and methods for predicting gaze-related parameters
US11556741B2 (en) 2018-02-09 2023-01-17 Pupil Labs Gmbh Devices, systems and methods for predicting gaze-related parameters using a neural network
US11393251B2 (en) 2018-02-09 2022-07-19 Pupil Labs Gmbh Devices, systems and methods for predicting gaze-related parameters
CN108764007A (zh) * 2018-02-10 2018-11-06 集智学园（北京）科技有限公司 基于ocr与文本分析技术对注意力的测量方法
US11048785B2 (en) * 2018-02-14 2021-06-29 Samsung Electronics Co., Ltd Method and apparatus of performing authentication
US20190253700A1 (en) * 2018-02-15 2019-08-15 Tobii Ab Systems and methods for calibrating image sensors in wearable apparatuses
US10726765B2 (en) 2018-02-15 2020-07-28 Valve Corporation Using tracking of display device to control image display
US10735649B2 (en) 2018-02-22 2020-08-04 Magic Leap, Inc. Virtual and augmented reality systems and methods using display system control information embedded in image data
CN108537111A (zh) 2018-02-26 2018-09-14 阿里巴巴集团控股有限公司 一种活体检测的方法、装置及设备
EP3759693A4 (en) 2018-02-27 2021-11-24 Magic Leap, Inc. MESH PAIRING FOR VIRTUAL AVATARS
EP3759542B1 (en) 2018-02-28 2023-03-29 Magic Leap, Inc. Head scan alignment using ocular registration
JP7303818B2 (ja) 2018-03-05 2023-07-05 マジック リープ， インコーポレイテッド 低遅延瞳孔トラッカーを伴うディスプレイシステム
CN108491072B (zh) * 2018-03-05 2020-01-21 京东方科技集团股份有限公司 一种虚拟现实交互方法及装置
WO2019172503A1 (ko) * 2018-03-05 2019-09-12 고려대학교 산학협력단 안구추적을 통한 시야장애 평가 장치, 이를 이용한 시야장애 평가 방법 및 컴퓨터 판독 가능한 저장 매체
US11563885B2 (en) 2018-03-06 2023-01-24 Eyedaptic, Inc. Adaptive system for autonomous machine learning and control in wearable augmented reality and virtual reality visual aids
WO2019173390A1 (en) 2018-03-07 2019-09-12 Magic Leap, Inc. Adaptive lens assemblies including polarization-selective lens stacks for augmented reality display
CN110494792B (zh) 2018-03-07 2021-07-09 奇跃公司 外围设备的视觉跟踪
WO2019178060A1 (en) 2018-03-12 2019-09-19 Magic Leap, Inc. Tilting array based display
US10528133B2 (en) * 2018-03-13 2020-01-07 Facebook Technologies, Llc Bracelet in a distributed artificial reality system
US10747312B2 (en) * 2018-03-14 2020-08-18 Apple Inc. Image enhancement devices with gaze tracking
JP7356995B2 (ja) 2018-03-14 2023-10-05 マジック リープ， インコーポレイテッド コンテンツをクリッピングし、視認快適性を増加させるためのディスプレイシステムおよび方法
EP3766039B1 (en) * 2018-03-15 2024-08-14 Magic Leap, Inc. Image correction due to deformation of components of a viewing device
WO2019177870A1 (en) 2018-03-15 2019-09-19 Magic Leap, Inc. Animating virtual avatar facial movements
EP4648015A3 (en) 2018-03-16 2026-01-14 Magic Leap, Inc. Depth based foveated rendering for display systems
JP7344894B2 (ja) 2018-03-16 2023-09-14 マジック リープ， インコーポレイテッド 眼追跡カメラからの顔の表情
WO2019183399A1 (en) 2018-03-21 2019-09-26 Magic Leap, Inc. Augmented reality system and method for spectroscopic analysis
JP6583460B2 (ja) * 2018-03-23 2019-10-02 株式会社セガゲームス 認証システム
US10818288B2 (en) 2018-03-26 2020-10-27 Apple Inc. Natural assistant interaction
CN108416322B (zh) * 2018-03-27 2019-05-17 吉林大学 一种虚拟装配坐式操作中目视动作识别方法
JP7118697B2 (ja) 2018-03-30 2022-08-16 株式会社Preferred Networks 注視点推定処理装置、注視点推定モデル生成装置、注視点推定処理システム、注視点推定処理方法、プログラム、および注視点推定モデル
WO2019195193A1 (en) 2018-04-02 2019-10-10 Magic Leap, Inc. Waveguides having integrated spacers, waveguides having edge absorbers, and methods for making the same
EP3776027B1 (en) 2018-04-02 2025-05-28 Magic Leap, Inc. Waveguides with integrated optical elements
CN112041716A (zh) 2018-04-02 2020-12-04 奇跃公司 混合聚合物波导和用于制造混合聚合物波导的方法
WO2019204164A1 (en) 2018-04-16 2019-10-24 Magic Leap, Inc. Systems and methods for cross-application authoring, transfer, and evaluation of rigging control systems for virtual characters
CN108459720B (zh) * 2018-04-19 2023-11-21 京东方科技集团股份有限公司 视控装置及用视控装置控制终端的方法
US11067805B2 (en) 2018-04-19 2021-07-20 Magic Leap, Inc. Systems and methods for operating a display system based on user perceptibility
US11364361B2 (en) 2018-04-20 2022-06-21 Neuroenhancement Lab, LLC System and method for inducing sleep by transplanting mental states
WO2019209431A1 (en) 2018-04-23 2019-10-31 Magic Leap, Inc. Avatar facial expression representation in multidimensional space
US11257268B2 (en) 2018-05-01 2022-02-22 Magic Leap, Inc. Avatar animation using Markov decision process policies
US11308673B2 (en) 2018-05-03 2022-04-19 Magic Leap, Inc. Using three-dimensional scans of a physical subject to determine positions and/or orientations of skeletal joints in the rigging for a virtual character
JP7277569B2 (ja) 2018-05-04 2023-05-19 グーグル エルエルシー 検出されたジェスチャおよび凝視に基づく自動化アシスタントの機能の呼び出し
KR102714774B1 (ko) 2018-05-04 2024-10-11 구글 엘엘씨 자동화된 어시스턴트 기능(들)의 핫-워드 프리 적응
JP7471279B2 (ja) * 2018-05-04 2024-04-19 グーグル エルエルシー 検出された口運動および／または注視に基づく自動化アシスタントの適応
DK180078B1 (en) 2018-05-07 2020-03-31 Apple Inc. USER INTERFACE FOR AVATAR CREATION
US11722764B2 (en) 2018-05-07 2023-08-08 Apple Inc. Creative camera
JP7099036B2 (ja) * 2018-05-07 2022-07-12 オムロン株式会社 データ処理装置、モニタリングシステム、覚醒システム、データ処理方法、及びデータ処理プログラム
US12033296B2 (en) 2018-05-07 2024-07-09 Apple Inc. Avatar creation user interface
US10375313B1 (en) 2018-05-07 2019-08-06 Apple Inc. Creative camera
KR20250025521A (ko) * 2018-05-07 2025-02-21 애플 인크. 크리에이티브 카메라
US10928918B2 (en) 2018-05-07 2021-02-23 Apple Inc. Raise to speak
WO2019217903A1 (en) * 2018-05-11 2019-11-14 Visionairy Health, Inc. Automated screening of medical data
WO2019221325A1 (ko) * 2018-05-14 2019-11-21 한국과학기술원 눈동자 반응을 이용한 연속 인증 시스템
US11262839B2 (en) 2018-05-17 2022-03-01 Sony Interactive Entertainment Inc. Eye tracking with prediction and late update to GPU for fast foveated rendering in an HMD environment
CN112368719A (zh) 2018-05-17 2021-02-12 奇跃公司 神经网络的梯度对抗性训练
US10942564B2 (en) * 2018-05-17 2021-03-09 Sony Interactive Entertainment Inc. Dynamic graphics rendering based on predicted saccade landing point
CN108763394B (zh) * 2018-05-21 2021-11-23 浙江工业大学 面向协同交互的多用户眼动跟踪数据可视化方法和系统
WO2019226494A1 (en) 2018-05-21 2019-11-28 Magic Leap, Inc. Generating textured polygon strip hair from strand-based hair for a virtual character
CN112437950A (zh) 2018-05-22 2021-03-02 奇跃公司 用于对虚拟头像制作动画的骨架系统
JP7341166B2 (ja) 2018-05-22 2023-09-08 マジック リープ， インコーポレイテッド ウェアラブルシステムのためのトランスモード入力融合
WO2019226549A1 (en) 2018-05-22 2019-11-28 Magic Leap, Inc. Computer generated hair groom transfer tool
CN108854064B (zh) * 2018-05-25 2023-03-28 深圳市腾讯网络信息技术有限公司 交互控制方法、装置、计算机可读介质及电子设备
CN108416341B (zh) * 2018-05-25 2023-11-21 重庆青腾致汇科技有限公司 一种新型生物识别系统
WO2019226865A1 (en) 2018-05-25 2019-11-28 Magic Leap, Inc. Compression of dynamic unstructured point clouds
CN117631307A (zh) 2018-05-29 2024-03-01 爱达扩视眼镜公司 用于低视力用户的混合式透视增强现实系统和方法
WO2019232282A1 (en) 2018-05-30 2019-12-05 Magic Leap, Inc. Compact variable focus configurations
JP7319303B2 (ja) 2018-05-31 2023-08-01 マジック リープ， インコーポレイテッド レーダ頭部姿勢位置特定
DK180639B1 (en) 2018-06-01 2021-11-04 Apple Inc DISABILITY OF ATTENTION-ATTENTIVE VIRTUAL ASSISTANT
KR102701323B1 (ko) * 2018-06-01 2024-08-30 파퉁 인베스트먼츠 엘티디. 인증된 데이터의 캡쳐 및 표시
US12087022B2 (en) 2018-06-01 2024-09-10 Magic Leap, Inc. Compression of dynamic unstructured point clouds
DK201870355A1 (en) 2018-06-01 2019-12-16 Apple Inc. VIRTUAL ASSISTANT OPERATION IN MULTI-DEVICE ENVIRONMENTS
US10509467B1 (en) * 2018-06-01 2019-12-17 Facebook Technologies, Llc Determining fixation of a user's eyes from images of portions of the user's face enclosed by a head mounted display
US10360304B1 (en) * 2018-06-04 2019-07-23 Imageous, Inc. Natural language processing interface-enabled building conditions control system
US11238143B2 (en) * 2018-06-05 2022-02-01 Google Llc Method and system for authenticating a user on a wearable heads-up display
EP3804306B1 (en) 2018-06-05 2023-12-27 Magic Leap, Inc. Homography transformation matrices based temperature calibration of a viewing system
US11157159B2 (en) 2018-06-07 2021-10-26 Magic Leap, Inc. Augmented reality scrollbar
JP7421505B2 (ja) 2018-06-08 2024-01-24 マジック リープ， インコーポレイテッド 自動化された表面選択設置およびコンテンツ配向設置を用いた拡張現実ビューア
WO2019238230A1 (en) * 2018-06-14 2019-12-19 Brainlab Ag Registration of an anatomical body part by detecting a finger pose
WO2019237175A1 (en) * 2018-06-14 2019-12-19 Integrity Advocate Inc. Method and system for assessing participants
CN108962182A (zh) * 2018-06-15 2018-12-07 广东康云多维视觉智能科技有限公司 基于眼球追踪的三维图像显示装置及其实现方法
EP3807711A4 (en) 2018-06-15 2022-02-23 Magic Leap, Inc. WIDE FIELD OF VIEW POLARIZATION SWITCHES AND METHOD OF MANUFACTURING LIQUID CRYSTAL OPTICAL ELEMENTS WITH FORWARD TILT
JP7336470B2 (ja) 2018-06-15 2023-08-31 マジック リープ， インコーポレイテッド プレチルト角を伴う液晶光学要素を用いた広視野偏光スイッチ
US11694435B2 (en) 2018-06-18 2023-07-04 Magic Leap, Inc. Systems and methods for temporarily disabling user control interfaces during attachment of an electronic device
KR102616391B1 (ko) * 2018-06-18 2023-12-20 뉴저지 인스티튜트 오브 테크놀로지 양안 장애의 진단 평가 및 선별을 위한 방법, 시스템 및 장치
JP7378431B2 (ja) 2018-06-18 2023-11-13 マジック リープ， インコーポレイテッド フレーム変調機能性を伴う拡張現実ディスプレイ
WO2019246044A1 (en) 2018-06-18 2019-12-26 Magic Leap, Inc. Head-mounted display systems with power saving functionality
JP7214986B2 (ja) 2018-06-25 2023-01-31 日本電信電話株式会社 反射性判定装置、反射性判定方法、プログラム
WO2020005757A1 (en) 2018-06-26 2020-01-02 Magic Leap, Inc. Waypoint creation in map detection
US12154295B2 (en) 2018-07-02 2024-11-26 Magic Leap, Inc. Methods and systems for interpolation of disparate inputs
WO2020009800A1 (en) 2018-07-02 2020-01-09 Magic Leap, Inc. Methods and systems for interpolation of disparate inputs
WO2020010097A1 (en) 2018-07-02 2020-01-09 Magic Leap, Inc. Pixel intensity modulation using modifying gain values
US11856479B2 (en) 2018-07-03 2023-12-26 Magic Leap, Inc. Systems and methods for virtual and augmented reality along a route with markers
US11510027B2 (en) 2018-07-03 2022-11-22 Magic Leap, Inc. Systems and methods for virtual and augmented reality
KR20200004666A (ko) 2018-07-04 2020-01-14 주식회사 링크트리 머신러닝과 블록체인을 이용한 생체정보 인증 시스템
US12073416B2 (en) 2018-07-04 2024-08-27 Solmaz Gumruk Musavirligi A.S. Method using artificial neural networks to find a unique harmonized system code from given texts and system for implementing the same
US11106033B2 (en) 2018-07-05 2021-08-31 Magic Leap, Inc. Waveguide-based illumination for head mounted display system
EP3821404A1 (en) * 2018-07-10 2021-05-19 Carrier Corporation Applying image analytics and machine learning to lock systems in hotels
JP7374981B2 (ja) 2018-07-10 2023-11-07 マジック リープ， インコーポレイテッド クロス命令セットアーキテクチャプロシージャ呼出のためのスレッドウィービング
US10863812B2 (en) 2018-07-18 2020-12-15 L'oreal Makeup compact with eye tracking for guidance of makeup application
US10795435B2 (en) 2018-07-19 2020-10-06 Samsung Electronics Co., Ltd. System and method for hybrid eye tracker
US11966055B2 (en) 2018-07-19 2024-04-23 Magic Leap, Inc. Content interaction driven by eye metrics
US10884492B2 (en) * 2018-07-20 2021-01-05 Avegant Corp. Relative position based eye-tracking system
WO2020023303A1 (en) 2018-07-23 2020-01-30 Magic Leap, Inc. Coexistence interference avoidance between two different radios operating in the same band
CN112513944A (zh) 2018-07-23 2021-03-16 奇跃公司 用于头部姿势预测的深度预测器循环神经网络
USD930614S1 (en) 2018-07-24 2021-09-14 Magic Leap, Inc. Totem controller having an illumination region
US11067808B2 (en) 2018-07-24 2021-07-20 Magic Leap, Inc. Diffractive optical elements with mitigation of rebounce-induced light loss and related systems and methods
WO2020023491A1 (en) 2018-07-24 2020-01-30 Magic Leap, Inc. Thermal management system for electronic device
US11567336B2 (en) 2018-07-24 2023-01-31 Magic Leap, Inc. Display systems and methods for determining registration between display and eyes of user
US11422620B2 (en) 2018-07-24 2022-08-23 Magic Leap, Inc. Display systems and methods for determining vertical alignment between left and right displays and a user's eyes
WO2020023543A1 (en) 2018-07-24 2020-01-30 Magic Leap, Inc. Viewing device with dust seal integration
USD918176S1 (en) 2018-07-24 2021-05-04 Magic Leap, Inc. Totem controller having an illumination region
WO2020023545A1 (en) 2018-07-24 2020-01-30 Magic Leap, Inc. Temperature dependent calibration of movement detection devices
WO2020023404A1 (en) 2018-07-24 2020-01-30 Magic Leap, Inc. Flicker mitigation when toggling eyepiece display illumination in augmented reality systems
USD924204S1 (en) 2018-07-24 2021-07-06 Magic Leap, Inc. Totem controller having an illumination region
EP3830673A4 (en) 2018-07-27 2022-05-04 Magic Leap, Inc. REDUCTION OF LAY SPACE DIMENSIONALITY INTENDED FOR LAY SPACE DEFORMATION OF A VIRTUAL CHARACTER
EP3831058B1 (en) 2018-08-02 2025-10-08 Magic Leap, Inc. A viewing system with interpupillary distance compensation based on head motion
EP3830631A4 (en) 2018-08-03 2021-10-27 Magic Leap, Inc. DRIFT CORRECTION BASED ON UNMERGED LAYING OF MELTED LAYING OF A TOTEM IN A USER INTERACTION SYSTEM
EP3830674A4 (en) 2018-08-03 2022-04-20 Magic Leap, Inc. Depth plane selection for multi-depth plane display systems by user categorization
US11012659B2 (en) * 2018-08-07 2021-05-18 International Business Machines Corporation Intelligent illumination and sound control in an internet of things (IoT) computing environment
US12016719B2 (en) 2018-08-22 2024-06-25 Magic Leap, Inc. Patient viewing system
CN109165939A (zh) * 2018-08-23 2019-01-08 唐剑虹 基于生物识别技术的区块链vr硬件钱包
WO2020046815A1 (en) * 2018-08-26 2020-03-05 The Research Foundation For The State University Of New York System and method for inter-individual discrimination based on oculomotor kinematics
GB2576904B (en) * 2018-09-06 2021-10-20 Sony Interactive Entertainment Inc Content modification system and method
GB2576910B (en) * 2018-09-06 2021-10-20 Sony Interactive Entertainment Inc User profile generating system and method
CN109145566A (zh) * 2018-09-08 2019-01-04 太若科技(北京)有限公司 基于注视点信息解锁ar眼镜的方法、装置及ar眼镜
DK201870623A1 (en) 2018-09-11 2020-04-15 Apple Inc. User interfaces for simulated depth effects
CN113382683A (zh) 2018-09-14 2021-09-10 纽罗因恒思蒙特实验有限责任公司 改善睡眠的系统和方法
WO2020061042A1 (en) * 2018-09-17 2020-03-26 Facebook Technologies, Llc Eye tracking using reverse-biased light-emitting diode devices
USD934872S1 (en) 2018-09-18 2021-11-02 Magic Leap, Inc. Mobile computing support system having an illumination region
USD934873S1 (en) 2018-09-18 2021-11-02 Magic Leap, Inc. Mobile computing support system having an illumination region
USD950567S1 (en) 2018-09-18 2022-05-03 Magic Leap, Inc. Mobile computing support system having an illumination region
USD955396S1 (en) 2018-09-18 2022-06-21 Magic Leap, Inc. Mobile computing support system having an illumination region
US20200089855A1 (en) * 2018-09-19 2020-03-19 XRSpace CO., LTD. Method of Password Authentication by Eye Tracking in Virtual Reality System
US10664050B2 (en) 2018-09-21 2020-05-26 Neurable Inc. Human-computer interface using high-speed and accurate tracking of user interactions
BR112021004965A2 (pt) 2018-09-24 2021-06-08 Ecolab Usa Inc. método de beneficiamento de minério, e, uso de um polímero catiônico e de um polissacarídeo
US11726561B2 (en) 2018-09-24 2023-08-15 Eyedaptic, Inc. Enhanced autonomous hands-free control in electronic visual aids
WO2020069026A1 (en) 2018-09-26 2020-04-02 Magic Leap, Inc. Diffractive optical elements with optical power
JP7376578B2 (ja) 2018-09-26 2023-11-08 マジック リープ， インコーポレイテッド ピンホールおよびスリットカメラを伴うアイウェア
US11462215B2 (en) * 2018-09-28 2022-10-04 Apple Inc. Multi-modal inputs for voice commands
US11128792B2 (en) 2018-09-28 2021-09-21 Apple Inc. Capturing and displaying images with multiple focal planes
US11321857B2 (en) 2018-09-28 2022-05-03 Apple Inc. Displaying and editing images with depth information
US11055388B2 (en) * 2018-10-08 2021-07-06 Advanced New Technologies Co., Ltd. Passive affective and knowledge-based authentication through eye movement tracking
CN111083299A (zh) * 2018-10-18 2020-04-28 富士施乐株式会社 信息处理装置及存储介质
WO2020082088A1 (en) * 2018-10-19 2020-04-23 Emory University Systems and methods for automated passive assessment of visuospatial memory and/or salience
CN109040604B (zh) * 2018-10-23 2020-09-15 Oppo广东移动通信有限公司 拍摄图像的处理方法、装置、存储介质及移动终端
WO2020086356A2 (en) 2018-10-26 2020-04-30 Magic Leap, Inc. Ambient electromagnetic distortion correction for electromagnetic tracking
CN111127537A (zh) * 2018-10-29 2020-05-08 托比股份公司 用于检测头戴式装置中的阴影的方法和装置
SE542887C2 (en) * 2018-10-31 2020-08-11 Tobii Ab Gaze tracking using mapping of pupil center position
US20220004617A1 (en) * 2018-10-31 2022-01-06 Orchid Sound Technologies LLC Passwordless authentication systems and methods
WO2020089724A1 (en) 2018-11-01 2020-05-07 3M Innovative Properties Company Device, user, or server registration and verification
US10896492B2 (en) 2018-11-09 2021-01-19 Qwake Technologies, Llc Cognitive load reducing platform having image edge enhancement
US10417497B1 (en) 2018-11-09 2019-09-17 Qwake Technologies Cognitive load reducing platform for first responders
US11890494B2 (en) 2018-11-09 2024-02-06 Qwake Technologies, Inc. Retrofittable mask mount system for cognitive load reducing platform
US10833945B2 (en) * 2018-11-13 2020-11-10 International Business Machines Corporation Managing downloading of content
JP7389116B2 (ja) 2018-11-15 2023-11-29 マジック リープ， インコーポレイテッド 深層ニューラルネットワーク姿勢推定システム
CN113196138B (zh) 2018-11-16 2023-08-25 奇跃公司 用于保持图像清晰度的图像尺寸触发的澄清
US11237393B2 (en) 2018-11-20 2022-02-01 Magic Leap, Inc. Eyepieces for augmented reality display system
WO2020107022A1 (en) * 2018-11-23 2020-05-28 Slingshot Aerospace, Inc. Signal processing workflow engine incorporating graphical user interface for space situational awareness
CN109683704B (zh) * 2018-11-29 2022-01-28 武汉中地地科传媒文化有限责任公司 一种ar界面交互方法及ar显示设备
WO2020112561A1 (en) 2018-11-30 2020-06-04 Magic Leap, Inc. Multi-modal hand location and orientation for avatar movement
CN111277857B (zh) * 2018-12-04 2021-04-13 清华大学 一种流媒体调度方法及装置
KR102707598B1 (ko) * 2018-12-04 2024-09-19 삼성전자주식회사 3차원 증강 현실을 위한 캘리브레이션 방법 및 그 장치
US11195067B2 (en) 2018-12-21 2021-12-07 Ambient AI, Inc. Systems and methods for machine learning-based site-specific threat modeling and threat detection
US11443515B2 (en) * 2018-12-21 2022-09-13 Ambient AI, Inc. Systems and methods for machine learning enhanced intelligent building access endpoint security monitoring and management
CN109799838B (zh) * 2018-12-21 2022-04-15 金季春 一种训练方法和系统
WO2020132484A1 (en) 2018-12-21 2020-06-25 Magic Leap, Inc. Air pocket structures for promoting total internal reflection in a waveguide
WO2020132941A1 (zh) * 2018-12-26 2020-07-02 中国科学院深圳先进技术研究院 识别方法及相关装置
CN113490873A (zh) 2018-12-28 2021-10-08 奇跃公司 带有机械致动图像投影仪的可变像素密度显示系统
EP4502710B1 (en) 2018-12-28 2026-01-28 Magic Leap, Inc. Augmented and virtual reality display systems with shared display for left and right eyes
US11139071B2 (en) 2018-12-31 2021-10-05 Cerner Innovation, Inc. Virtual augmentation of clinical care environments
US11537202B2 (en) 2019-01-16 2022-12-27 Pupil Labs Gmbh Methods for generating calibration data for head-wearable devices and eye tracking system
US11036043B2 (en) * 2019-01-17 2021-06-15 Advanced New Technologies Co., Ltd. Identity authentication using lens features
US11107261B2 (en) 2019-01-18 2021-08-31 Apple Inc. Virtual avatar animation based on facial feature movement
US11458040B2 (en) 2019-01-23 2022-10-04 Meta Platforms Technologies, Llc Corneal topography mapping with dense illumination
EP3914997A4 (en) 2019-01-25 2022-10-12 Magic Leap, Inc. Eye-tracking using images having different exposure times
CN109828734A (zh) * 2019-01-29 2019-05-31 深圳市海派通讯科技有限公司 智能终端显示屏幕控制方法、系统及存储介质
US12405464B2 (en) 2019-02-01 2025-09-02 Magic Leap, Inc. Display system having 1-dimensional pixel array with scanning mirror
WO2020160188A1 (en) 2019-02-01 2020-08-06 Magic Leap, Inc. Inline in-coupling optical elements
EP3921720B1 (en) 2019-02-06 2024-05-22 Magic Leap, Inc. Target intent-based clock speed determination and adjustment to limit total heat generated by multiple processors
KR102246408B1 (ko) * 2019-02-14 2021-05-18 엔에이치엔 주식회사 딥러닝 기반 유사상품 제공방법
CN109919065A (zh) * 2019-02-26 2019-06-21 浪潮金融信息技术有限公司 一种使用眼球追踪技术在屏幕上获取关注点的方法
US11138302B2 (en) * 2019-02-27 2021-10-05 International Business Machines Corporation Access control using multi-authentication factors
KR102190527B1 (ko) * 2019-02-28 2020-12-14 현대모비스 주식회사 자동 영상 합성 장치 및 방법
CN113728267A (zh) 2019-02-28 2021-11-30 奇跃公司 使用由光发射器阵列形成的多个瞳孔内视差视图来提供可变适应提示的显示系统和方法
US12117630B2 (en) 2019-03-12 2024-10-15 Magic Leap, Inc. Method of fabricating display device having patterned lithium-based transition metal oxide
EP3938824A4 (en) 2019-03-12 2022-11-23 Magic Leap, Inc. HIGH-INDEX MATERIAL WAVEGUIDES AND METHODS OF MAKING THEM
CN113544766B (zh) 2019-03-12 2024-12-03 奇跃公司 在第一和第二增强现实观看器之间配准本地内容
RU2715300C1 (ru) * 2019-03-12 2020-02-26 Алексей Федорович Хорошев Способ создания данных соответствия объекта и информации о нем
CN110059232B (zh) * 2019-03-15 2021-05-07 杭州电子科技大学 一种基于用户体验度量的数据可视化方法
US11348573B2 (en) 2019-03-18 2022-05-31 Apple Inc. Multimodality in digital assistant systems
JP7564818B2 (ja) 2019-03-20 2024-10-09 マジック リープ， インコーポレイテッド 眼の照明を提供するためのシステム
CN113841005A (zh) 2019-03-20 2021-12-24 奇跃公司 用于收集光的系统
US11099384B2 (en) * 2019-03-27 2021-08-24 Lenovo (Singapore) Pte. Ltd. Adjusting display settings of a head-mounted display
US11644897B2 (en) 2019-04-01 2023-05-09 Evolution Optiks Limited User tracking system using user feature location and method, and digital display device and digital image rendering system and method using same
EP3948402B1 (en) * 2019-04-01 2023-12-06 Evolution Optiks Limited Pupil tracking system and method, and digital display device and digital image rendering system and method using same
TWI754806B (zh) * 2019-04-09 2022-02-11 栗永徽 利用深度學習定位虹膜之裝置與方法
USD916892S1 (en) * 2019-04-09 2021-04-20 Google Llc Display screen or portion thereof with graphical user interface with icon
JP7592024B2 (ja) 2019-04-15 2024-11-29 マジック リープ， インコーポレイテッド 電磁追跡のためのセンサ融合
CN110060678B (zh) * 2019-04-16 2021-09-14 深圳欧博思智能科技有限公司 一种基于智能设备的虚拟角色控制方法及智能设备
JP7060544B6 (ja) * 2019-04-26 2022-05-23 塁 佐藤 運動用設備
WO2020222326A1 (ko) * 2019-04-30 2020-11-05 엘지전자 주식회사 지능형 전자 기기의 제어 방법 및 그 방법을 수행하는 프로그램 코드를 포함하는 컴퓨터 판독 가능 매체
JP2022530900A (ja) 2019-05-01 2022-07-04 マジック リープ， インコーポレイテッド コンテンツプロビジョニングシステムおよび方法
CN111897411A (zh) * 2019-05-05 2020-11-06 Oppo广东移动通信有限公司 基于大气光通信的交互方法、装置和穿戴设备
DK201970509A1 (en) 2019-05-06 2021-01-15 Apple Inc Spoken notifications
US10645294B1 (en) 2019-05-06 2020-05-05 Apple Inc. User interfaces for capturing and managing visual media
US11706521B2 (en) 2019-05-06 2023-07-18 Apple Inc. User interfaces for capturing and managing visual media
US11307752B2 (en) 2019-05-06 2022-04-19 Apple Inc. User configurable task triggers
US11770601B2 (en) 2019-05-06 2023-09-26 Apple Inc. User interfaces for capturing and managing visual media
SE1950580A1 (en) * 2019-05-15 2020-10-13 Tobii Ab Method and system for dwell-less, hands-free interaction with a selectable object
EP3973347B1 (en) 2019-05-20 2025-03-26 Magic Leap, Inc. Systems and techniques for estimating eye pose
US11775836B2 (en) 2019-05-21 2023-10-03 Magic Leap, Inc. Hand pose estimation
WO2020243012A1 (en) 2019-05-24 2020-12-03 Magic Leap, Inc. Variable focus assemblies
CN114174463A (zh) 2019-05-28 2022-03-11 奇跃公司 用于便携式电子设备的热管理系统
JP6830981B2 (ja) * 2019-05-29 2021-02-17 株式会社東芝 ウェアラブル機器及び表示方法
USD962981S1 (en) 2019-05-29 2022-09-06 Magic Leap, Inc. Display screen or portion thereof with animated scrollbar graphical user interface
EP3744227A1 (en) * 2019-05-31 2020-12-02 Essilor International Binocular refraction instrument, set of test images, binocular refraction method and computer program associated thereof
US11227599B2 (en) 2019-06-01 2022-01-18 Apple Inc. Methods and user interfaces for voice-based control of electronic devices
US10885173B2 (en) 2019-06-04 2021-01-05 Nant Holdings Ip, Llc Content authentication and validation via multi-factor digital tokens, systems, and methods
US11676422B2 (en) 2019-06-05 2023-06-13 Pupil Labs Gmbh Devices, systems and methods for predicting gaze-related parameters
CN110338748B (zh) * 2019-06-13 2022-03-08 宁波明星科技发展有限公司 快速定位视力值的方法、存储介质、终端及视力检测仪
US12353617B2 (en) 2019-06-18 2025-07-08 Pupil Labs Gmbh Systems and methods for determining one or more parameters of a user's eye
EP3987343A4 (en) 2019-06-20 2023-07-19 Magic Leap, Inc. EYEWEARS FOR AUGMENTED REALITY DISPLAY SYSTEM
US11803628B2 (en) 2019-06-21 2023-10-31 Magic Leap, Inc. Secure authorization via modal window
EP3987329A4 (en) 2019-06-24 2023-10-11 Magic Leap, Inc. WAVEGUIDES WITH INTEGRATED SPACERS AND RELATED SYSTEMS AND METHODS
US12535685B2 (en) 2019-06-24 2026-01-27 Magic Leap, Inc. Waveguides having integral spacers and related systems and methods
US10976816B2 (en) * 2019-06-25 2021-04-13 Microsoft Technology Licensing, Llc Using eye tracking to hide virtual reality scene changes in plain sight
US11307650B1 (en) * 2019-06-25 2022-04-19 Apple Inc. Modifying virtual content to invoke a target user state
WO2020263876A1 (en) * 2019-06-26 2020-12-30 Twosense, Inc. Continuous authentication using wearable head-mounted devices and gaze tracking
US10901502B2 (en) * 2019-06-27 2021-01-26 Facebook, Inc. Reducing head mounted display power consumption and heat generation through predictive rendering of content
EP3994510A4 (en) * 2019-07-05 2023-08-02 Magic Leap, Inc. Eye tracking latency enhancements
US11029805B2 (en) 2019-07-10 2021-06-08 Magic Leap, Inc. Real-time preview of connectable objects in a physically-modeled virtual space
US11379610B2 (en) * 2019-07-10 2022-07-05 Blackberry Limited Methods and devices for automatically encrypting files
KR20220033507A (ko) * 2019-07-12 2022-03-16 오리온 코포레이션 가상 또는 증강 현실을 활용하는 치료 개입을 위한 전자적 배열체 및 관련된 방법
US20210015583A1 (en) * 2019-07-15 2021-01-21 Surgical Theater, Inc. Augmented reality system and method for tele-proctoring a surgical procedure
US11868525B2 (en) 2019-07-16 2024-01-09 Magic Leap, Inc. Eye center of rotation determination with one or more eye tracking cameras
EP3999883A4 (en) 2019-07-19 2023-08-30 Magic Leap, Inc. METHOD FOR MANUFACTURING DIFFRACTION GRATINGS
WO2021016045A1 (en) 2019-07-19 2021-01-28 Magic Leap, Inc. Display device having diffraction gratings with reduced polarization sensitivity
US11907417B2 (en) 2019-07-25 2024-02-20 Tectus Corporation Glance and reveal within a virtual environment
CN114174895B (zh) 2019-07-26 2025-07-08 奇跃公司 用于增强现实的系统和方法
US11354805B2 (en) 2019-07-30 2022-06-07 Apple Inc. Utilization of luminance changes to determine user characteristics
EP4003681A4 (en) 2019-07-30 2023-08-30 Magic Leap, Inc. ANGULAR SEGMENTED HOT MIRROR FOR EYE TRACKING
WO2021021942A1 (en) 2019-07-31 2021-02-04 Magic Leap, Inc. User data management for augmented reality using a distributed ledger
CN110572632A (zh) * 2019-08-15 2019-12-13 中国人民解放军军事科学院国防科技创新研究院 一种基于视线跟踪的增强现实显示系统、头盔和方法
US11263634B2 (en) 2019-08-16 2022-03-01 Advanced New Technologies Co., Ltd. Payment method and device
US11380065B2 (en) * 2019-08-20 2022-07-05 Red Pacs, Llc Advanced head display unit for fire fighters
US11915376B2 (en) 2019-08-28 2024-02-27 Qwake Technologies, Inc. Wearable assisted perception module for navigation and communication in hazardous environments
US11282297B2 (en) * 2019-09-10 2022-03-22 Blue Planet Training, Inc. System and method for visual analysis of emotional coherence in videos
EP4028354A4 (en) 2019-09-11 2023-11-22 Magic Leap, Inc. DISPLAY DEVICE WITH DIFFRACTION GRIDING HAVING REDUCED POLARIZATION SENSITIVITY
US11295309B2 (en) * 2019-09-13 2022-04-05 International Business Machines Corporation Eye contact based financial transaction
US11010980B2 (en) 2019-09-25 2021-05-18 International Business Machines Corporation Augmented interface distraction reduction
JP2022549853A (ja) 2019-09-27 2022-11-29 マジック リープ， インコーポレイテッド 共有空間内の個々の視認
US11354910B2 (en) * 2019-09-27 2022-06-07 Ncr Corporation Frictionless authentication and monitoring
US11601693B2 (en) 2019-09-30 2023-03-07 Kyndryl, Inc. Automatic adaptation of digital content
CN110751064B (zh) * 2019-09-30 2022-06-24 四川大学 基于图像处理的眨眼次数分析方法和系统
US12153505B2 (en) * 2019-10-01 2024-11-26 Weiland Innovations Llc Automated system for generating properly tagged training data for and verifying the efficacy of artificial intelligence algorithms
US11436655B2 (en) * 2019-10-01 2022-09-06 Ebay Inc. Different action user-interface components in a comparison view
US11176757B2 (en) 2019-10-02 2021-11-16 Magic Leap, Inc. Mission driven virtual character for user interaction
US11276246B2 (en) 2019-10-02 2022-03-15 Magic Leap, Inc. Color space mapping for intuitive surface normal visualization
KR102128894B1 (ko) * 2019-10-10 2020-07-01 주식회사 메디씽큐 스마트 안경의 시선 트래킹 시스템 및 그 방법
CN110837294B (zh) * 2019-10-14 2023-12-12 成都西山居世游科技有限公司 一种基于眼球追踪的面部表情控制方法及系统
JP7423248B2 (ja) * 2019-10-23 2024-01-29 キヤノン株式会社 電子機器、電子機器の制御方法、プログラム及び記憶媒体
US10901505B1 (en) 2019-10-24 2021-01-26 Tectus Corporation Eye-based activation and tool selection systems and methods
US11662807B2 (en) * 2020-01-06 2023-05-30 Tectus Corporation Eye-tracking user interface for virtual tool control
US10607077B1 (en) * 2019-10-28 2020-03-31 EyeVerify Inc. Identity authentication using an inlier neural network
CN110745000B (zh) * 2019-10-29 2021-09-28 上海天马有机发光显示技术有限公司 一种车辆仪表及其显示方法、车速监控显示系统
US11830318B2 (en) 2019-10-31 2023-11-28 8 Bit Development Inc. Method of authenticating a consumer or user in virtual reality, thereby enabling access to controlled environments
CN110727352A (zh) * 2019-10-31 2020-01-24 哈雷医用(广州)智能技术有限公司 一种对抑郁症具有改善作用的电子产品及其控制方法
TWI731461B (zh) * 2019-11-01 2021-06-21 宏碁股份有限公司 真實人臉的識別方法與真實人臉的識別裝置
US10795984B1 (en) 2019-11-01 2020-10-06 Capital One Services, Llc Active locking mechanism using machine learning
WO2021092211A1 (en) * 2019-11-05 2021-05-14 The Regents Of The University Of Colorado, A Body Corporate Systems and methods to probe ocular structures
US11493989B2 (en) 2019-11-08 2022-11-08 Magic Leap, Inc. Modes of user interaction
CN114641713A (zh) 2019-11-08 2022-06-17 奇跃公司 具有包括多种材料的光重定向结构的超表面以及制造方法
USD982593S1 (en) 2019-11-08 2023-04-04 Magic Leap, Inc. Portion of a display screen with animated ray
JP7635230B2 (ja) 2019-11-14 2025-02-25 マジック リープ， インコーポレイテッド 仮想および拡張現実のためのシステムおよび方法
US12400750B1 (en) * 2019-11-15 2025-08-26 Verily Life Sciences Llc Automatic content tagging in videos of minimally invasive surgeries
WO2021097323A1 (en) 2019-11-15 2021-05-20 Magic Leap, Inc. A viewing system for use in a surgical environment
EP4062380A4 (en) 2019-11-18 2023-11-29 Magic Leap, Inc. CARTOGRAPHY AND LOCALIZATION OF A PASSABLE WORLD
US12094139B2 (en) 2019-11-22 2024-09-17 Magic Leap, Inc. Systems and methods for enhanced depth determination using projection spots
CN114730111A (zh) 2019-11-22 2022-07-08 奇跃公司 用于对液晶层进行图案化的方法和系统
US11665379B2 (en) * 2019-11-26 2023-05-30 Photo Sensitive Cinema (PSC) Rendering image content as time-spaced frames
US11681362B2 (en) 2019-11-26 2023-06-20 Magic Leap, Inc. Enhanced eye tracking for augmented or virtual reality display systems
US11273341B2 (en) * 2019-11-27 2022-03-15 Ready 2 Perform Technology LLC Interactive visualization system for biomechanical assessment
CN112904997B (zh) * 2019-12-04 2023-05-26 Oppo广东移动通信有限公司 设备控制方法及相关产品
US10871825B1 (en) * 2019-12-04 2020-12-22 Facebook Technologies, Llc Predictive eye tracking systems and methods for variable focus electronic displays
US11442593B2 (en) 2019-12-06 2022-09-13 Magic Leap, Inc. Dynamic browser stage
EP4070538B1 (en) 2019-12-06 2025-11-12 Magic Leap, Inc. Encoding stereo splash screen in static image
USD940189S1 (en) 2019-12-09 2022-01-04 Magic Leap, Inc. Portion of a display screen with transitional graphical user interface for guiding graphics
IL271287B2 (en) 2019-12-09 2025-06-01 Eyeway Vision Ltd Eye tracking systems and methods
USD940749S1 (en) 2019-12-09 2022-01-11 Magic Leap, Inc. Portion of a display screen with transitional graphical user interface for guiding graphics
USD941307S1 (en) 2019-12-09 2022-01-18 Magic Leap, Inc. Portion of a display screen with graphical user interface for guiding graphics
USD940748S1 (en) 2019-12-09 2022-01-11 Magic Leap, Inc. Portion of a display screen with transitional graphical user interface for guiding graphics
USD952673S1 (en) 2019-12-09 2022-05-24 Magic Leap, Inc. Portion of a display screen with transitional graphical user interface for guiding graphics
USD941353S1 (en) 2019-12-09 2022-01-18 Magic Leap, Inc. Portion of a display screen with transitional graphical user interface for guiding graphics
US11288876B2 (en) 2019-12-13 2022-03-29 Magic Leap, Inc. Enhanced techniques for volumetric stage mapping based on calibration object
EP4076142A1 (en) * 2019-12-19 2022-10-26 Sanofi An eye-tracking device and method
US11928632B2 (en) * 2019-12-19 2024-03-12 Senseye, Inc. Ocular system for deception detection
US20210192853A1 (en) * 2019-12-20 2021-06-24 Abdul Zalil Method and system for wireless transmission of audio/video media content to a display device
CN113010066B (zh) * 2019-12-20 2022-11-11 华为技术有限公司 显示参数确定方法及装置
CN111159678B (zh) * 2019-12-26 2023-08-18 联想(北京)有限公司 一种身份识别方法、装置及存储介质
CN111292850A (zh) * 2020-01-22 2020-06-16 福建中医药大学 一种adhd儿童注意力智能康复系统
US11340695B2 (en) 2020-01-24 2022-05-24 Magic Leap, Inc. Converting a 2D positional input into a 3D point in space
JP7496424B2 (ja) 2020-01-24 2024-06-06 マジック リープ， インコーポレイテッド 単一コントローラを使用したコンテンツ移動および相互作用
US11226678B2 (en) 2020-01-27 2022-01-18 Magic Leap, Inc. Gaze timer based augmentation of functionality of a user input device
EP4097684B1 (en) 2020-01-27 2025-12-31 Magic Leap, Inc. ENHANCED STATE CONTROL FOR ANCHOR-BASED EXTENSION REALITY APPLICATIONS
US11380072B2 (en) 2020-01-27 2022-07-05 Magic Leap, Inc. Neutral avatars
USD949200S1 (en) 2020-01-27 2022-04-19 Magic Leap, Inc. Portion of a display screen with a set of avatars
USD948574S1 (en) 2020-01-27 2022-04-12 Magic Leap, Inc. Portion of a display screen with a set of avatars
US11574424B2 (en) 2020-01-27 2023-02-07 Magic Leap, Inc. Augmented reality map curation
USD936704S1 (en) 2020-01-27 2021-11-23 Magic Leap, Inc. Portion of a display screen with avatar
USD948562S1 (en) 2020-01-27 2022-04-12 Magic Leap, Inc. Portion of a display screen with avatar
JP7534420B2 (ja) 2020-01-31 2024-08-14 マジック リープ， インコーポレイテッド 眼球運動測定査定のための拡張および仮想現実ディスプレイシステム
CN111402100A (zh) * 2020-02-03 2020-07-10 重庆特斯联智慧科技股份有限公司 一种通过目标追踪实现的人口登记方法和系统
CN111880663A (zh) * 2020-02-06 2020-11-03 北京师范大学 一种应用于交互式地图的眼动控制方法及装置
CN111880662A (zh) * 2020-02-06 2020-11-03 北京师范大学 一种应用于交互式地图的眼动控制系统
US11538199B2 (en) * 2020-02-07 2022-12-27 Lenovo (Singapore) Pte. Ltd. Displaying a window in an augmented reality view
EP4104034A4 (en) 2020-02-10 2024-02-21 Magic Leap, Inc. Body-centric content positioning relative to three-dimensional container in a mixed reality environment
US11709363B1 (en) 2020-02-10 2023-07-25 Avegant Corp. Waveguide illumination of a spatial light modulator
CN115398894A (zh) 2020-02-14 2022-11-25 奇跃公司 用于虚拟和增强现实显示系统的虚拟对象运动速度曲线
US11016656B1 (en) * 2020-02-14 2021-05-25 International Business Machines Corporation Fault recognition self-learning graphical user interface
EP3973346B1 (en) 2020-02-19 2024-12-25 Pupil Labs GmbH Eye tracking module and head-wearable device
US11300784B2 (en) * 2020-02-21 2022-04-12 Fotonation Limited Multi-perspective eye acquisition
JP7515604B2 (ja) 2020-02-26 2024-07-12 マジック リープ， インコーポレイテッド 手続型電子ビームリソグラフィ
JP7251614B2 (ja) * 2020-02-28 2023-04-04 アステラス製薬株式会社 ウェアラブル機器、情報処理装置、情報処理システム、及びプログラム
WO2021174062A1 (en) 2020-02-28 2021-09-02 Magic Leap, Inc. Method of fabricating molds for forming eyepieces with integrated spacers
KR102379350B1 (ko) * 2020-03-02 2022-03-28 주식회사 비주얼캠프 페이지 턴 방법 및 이를 수행하기 위한 컴퓨팅 장치
US11262588B2 (en) 2020-03-10 2022-03-01 Magic Leap, Inc. Spectator view of virtual and physical objects
KR102359602B1 (ko) * 2020-03-10 2022-02-08 한국과학기술원 디스플레이를 위한 시선 입력 방법 및 이를 수행하는 장치들
EP3883235A1 (en) 2020-03-17 2021-09-22 Aptiv Technologies Limited Camera control modules and methods
JP7795472B2 (ja) 2020-03-20 2026-01-07 マジック リープ， インコーポレイテッド 網膜結像および追跡のためのシステムおよび方法
US11940639B2 (en) 2020-03-25 2024-03-26 Magic Leap, Inc. Optical device with one-way mirror
CN111383313B (zh) * 2020-03-31 2023-05-12 歌尔股份有限公司 一种虚拟模型渲染方法、装置、设备及可读存储介质
US11537701B2 (en) 2020-04-01 2022-12-27 Toyota Motor North America, Inc. Transport related n-factor authentication
CN115769174A (zh) * 2020-04-03 2023-03-07 奇跃公司 用于最佳注视辨别的化身定制
EP4127822A4 (en) 2020-04-03 2024-06-26 Magic Leap, Inc. Wearable display systems with nanowire led micro-displays
US11536970B1 (en) * 2020-04-07 2022-12-27 Google Llc Tracking of item of interest using wearable heads up display
US12504809B2 (en) 2020-04-17 2025-12-23 Apple Inc. Gaze-based control
US11587388B2 (en) 2020-04-22 2023-02-21 Igt Determining a player's emotional state using player gaze movement at gaming devices
CN111399659B (zh) * 2020-04-24 2022-03-08 Oppo广东移动通信有限公司 界面显示方法及相关装置
US11950022B1 (en) 2020-04-24 2024-04-02 Apple Inc. Head-mounted devices with forward facing cameras
US11189248B1 (en) * 2020-05-06 2021-11-30 Apple Inc. Systems and methods for switching vision correction graphical outputs on a display of an electronic device
JP7529242B2 (ja) * 2020-05-07 2024-08-06 株式会社ジンズホールディングス プログラム、情報処理方法、情報処理装置、及び情報処理システム
US12301635B2 (en) 2020-05-11 2025-05-13 Apple Inc. Digital assistant hardware abstraction
DK202070625A1 (en) 2020-05-11 2022-01-04 Apple Inc User interfaces related to time
US11921998B2 (en) 2020-05-11 2024-03-05 Apple Inc. Editing features of an avatar
US11061543B1 (en) 2020-05-11 2021-07-13 Apple Inc. Providing relevant data items based on context
DE102020113579B4 (de) * 2020-05-19 2025-11-06 Audi Aktiengesellschaft Kameravorrichtung zum Erzeugen eines Abbilds einer Umgebung sowie Scheinwerferanordnung
EP4154050A4 (en) 2020-05-22 2024-06-05 Magic Leap, Inc. Augmented and virtual reality display systems with correlated in-coupling and out-coupling optical regions
US11615205B2 (en) * 2020-05-28 2023-03-28 Bank Of America Corporation Intelligent dynamic data masking on display screens based on viewer proximity
US11195490B1 (en) * 2020-05-29 2021-12-07 International Business Machines Corporation Smart contact lens with adjustable light transmittance
US11054973B1 (en) 2020-06-01 2021-07-06 Apple Inc. User interfaces for managing media
WO2021247312A1 (en) 2020-06-03 2021-12-09 Limonox Projects Llc Eye-gaze based biofeedback
EP4162766A4 (en) * 2020-06-03 2023-11-15 Lucomm Technologies, Inc. PHYSICAL VIRTUAL ENVIRONMENT FUSION SYSTEM
WO2021247435A1 (en) 2020-06-05 2021-12-09 Magic Leap, Inc. Enhanced eye tracking techniques based on neural network analysis of images
JP7218978B2 (ja) * 2020-06-15 2023-02-07 株式会社mediVR リハビリテーション支援システム、リハビリテーション支援方法およびリハビリテーション支援プログラム
GB202010326D0 (en) * 2020-07-06 2020-08-19 Palakollu Vamsee Krishna A virtual reality headset
US11690435B2 (en) 2020-07-07 2023-07-04 Perfect Mobile Corp. System and method for navigating user interfaces using a hybrid touchless control mechanism
WO2022015847A1 (en) 2020-07-15 2022-01-20 Magic Leap, Inc. Eye tracking using aspheric cornea model
US11490204B2 (en) 2020-07-20 2022-11-01 Apple Inc. Multi-device audio adjustment coordination
US11438683B2 (en) 2020-07-21 2022-09-06 Apple Inc. User identification using headphones
US12236920B2 (en) * 2020-07-27 2025-02-25 International Business Machines Corporation Augmented reality sessions responsive to eye behavior
WO2022025921A1 (en) * 2020-07-31 2022-02-03 Hewlett-Packard Development Company, L.P. Change blindness detection via bio-analytics
JP2023537486A (ja) 2020-08-07 2023-09-01 マジック リープ， インコーポレイテッド 調整可能円柱レンズおよびそれを含む頭部搭載型ディスプレイ
JP7154259B2 (ja) * 2020-08-11 2022-10-17 株式会社トプコン 眼科装置
JP7154260B2 (ja) * 2020-08-11 2022-10-17 株式会社トプコン 眼科装置
US11321797B2 (en) * 2020-08-25 2022-05-03 Kyndryl, Inc. Wearable watermarks
US12029483B2 (en) * 2020-08-27 2024-07-09 Revieve Oy System and method for finding an area of an eye from a facial image
WO2022046120A1 (en) * 2020-08-31 2022-03-03 Hewlett-Packard Development Company, L.P. User authentication using event cameras
US11620855B2 (en) 2020-09-03 2023-04-04 International Business Machines Corporation Iterative memory mapping operations in smart lens/augmented glasses
US12593982B2 (en) * 2020-09-03 2026-04-07 Senbiosys Earbud sensing system and method employing light steering and spatial diversity
CN116569095B (zh) 2020-09-08 2026-03-27 苹果公司 具有近场通信的设备
CN114531904B (zh) * 2020-09-09 2025-01-21 京东方科技集团股份有限公司 Ar/vr图像显示方法、ar/vr图像显示设备和计算机程序产品
EP4214554A4 (en) 2020-09-16 2024-10-09 Magic Leap, Inc. EYEPIECES FOR AN AUGMENTED REALITY DISPLAY SYSTEM
CN112084990A (zh) * 2020-09-16 2020-12-15 重庆科技学院 一种基于卷积神经网络及回溯的课堂抬头率统计系统
KR102230797B1 (ko) * 2020-09-23 2021-03-22 국방과학연구소 적외선 이미지를 이용한 딥러닝 학습 방법 및 시스템
US20230367857A1 (en) * 2020-09-25 2023-11-16 Apple Inc. Pose optimization in biometric authentication systems
US11212449B1 (en) 2020-09-25 2021-12-28 Apple Inc. User interfaces for media capture and management
CN116529786A (zh) * 2020-09-25 2023-08-01 苹果公司 多相机生物识别成像系统
US20230334909A1 (en) * 2020-09-25 2023-10-19 Apple Inc. Multi-wavelength biometric imaging system
CN116472564A (zh) * 2020-09-25 2023-07-21 苹果公司 基于所获取图像的质量自动选择生物识别
WO2022066813A1 (en) 2020-09-25 2022-03-31 Sterling Labs Llc Flexible illumination for imaging systems
EP4222551A4 (en) 2020-09-29 2024-10-23 Avegant Corp. ARCHITECTURE FOR ILLUMINATION OF A SCREENBOARD
WO2022074973A1 (ja) * 2020-10-05 2022-04-14 ソニーグループ株式会社 視線検出装置及び表示装置
GB2599900B (en) * 2020-10-09 2023-01-11 Sony Interactive Entertainment Inc Data processing system and method for image enhancement
JP7790749B2 (ja) * 2020-10-12 2025-12-23 株式会社Fove 視線検出のための較正
US11320903B1 (en) 2020-10-20 2022-05-03 Rovi Guides, Inc. Methods and systems of extended reality environment interaction based on eye motions
US12373029B2 (en) 2020-10-20 2025-07-29 Adeia Guides Inc. Methods and systems of extended reality environment interaction based on eye motions
US11609629B2 (en) * 2020-10-20 2023-03-21 Rovi Guides, Inc. Methods and systems of extended reality environment interaction based on eye motions
US11281291B1 (en) 2020-10-20 2022-03-22 Rovi Guides, Inc. Methods and systems of extended reality environment interaction based on eye motions
US11747896B2 (en) 2020-10-20 2023-09-05 Rovi Guides, Inc. Methods and systems of extended reality environment interaction based on eye motions
US11392198B2 (en) 2020-10-20 2022-07-19 ROVl GUIDES, INC. Methods and systems of extended reality environment interaction based on eye motions
US11803237B2 (en) 2020-11-14 2023-10-31 Facense Ltd. Controlling an eye tracking camera according to eye movement velocity
JP7252296B2 (ja) * 2020-12-09 2023-04-04 株式会社トプコン 眼科装置及び眼科測定方法
WO2022125898A1 (en) 2020-12-10 2022-06-16 Orchid Sound Technologies LLC Systems and methods including user authentication
KR102876731B1 (ko) * 2020-12-16 2025-10-27 삼성전자 주식회사 저지연으로 복수의 어플리케이션 데이터 전송 방법 및 장치
EP4213482A4 (en) * 2020-12-16 2024-03-20 Samsung Electronics Co., Ltd. Method and device for transmitting plurality of pieces of application data with low latency
GB202020521D0 (en) 2020-12-23 2021-02-03 British Telecomm Extended Reality Access Control
US11289196B1 (en) 2021-01-12 2022-03-29 Emed Labs, Llc Health testing and diagnostics platform
US11869650B2 (en) * 2021-01-12 2024-01-09 Tandem Diabetes Care, Inc. Remote access for medical device therapy
US20220221932A1 (en) 2021-01-12 2022-07-14 Microsoft Technology Licensing, Llc Controlling a function via gaze detection
US11625095B2 (en) 2021-01-22 2023-04-11 Zinn Labs, Inc. Gaze sensors and display elements for detection of gaze vectors and user control at headset
US12437869B2 (en) * 2021-01-22 2025-10-07 Sesame Ai, Inc. Headset integrated into healthcare platform
JP7119145B2 (ja) * 2021-01-25 2022-08-16 株式会社東芝 ウェアラブル機器及び表示方法
US20220236795A1 (en) * 2021-01-27 2022-07-28 Facebook Technologies, Llc Systems and methods for signaling the onset of a user's intent to interact
KR102715596B1 (ko) 2021-02-05 2024-10-11 호서대학교 산학협력단 장애인을 위한 전자책 제어 장치 및 제어 방법
US20220293241A1 (en) * 2021-03-12 2022-09-15 Facebook Technologies, Llc Systems and methods for signaling cognitive-state transitions
CN117043660A (zh) 2021-03-15 2023-11-10 奇跃公司 采用可调谐柱面透镜的光学器件和头戴式显示器
US11373756B1 (en) 2021-05-24 2022-06-28 Emed Labs, Llc Systems, devices, and methods for diagnostic aid kit apparatus
US11615888B2 (en) 2021-03-23 2023-03-28 Emed Labs, Llc Remote diagnostic testing and treatment
US11929168B2 (en) 2021-05-24 2024-03-12 Emed Labs, Llc Systems, devices, and methods for diagnostic aid kit apparatus
US11273074B1 (en) * 2021-03-24 2022-03-15 Stroma Medical Corporation Systems and methods for for physical and electronic security of medical devices
WO2022203620A1 (en) * 2021-03-25 2022-09-29 Dm Dayanikli Tüketi̇m Mallari Sanayi̇ Ve Ti̇caret Li̇mi̇ted Şi̇rketi̇ Digital cinema system
CN113077795B (zh) * 2021-04-06 2022-07-15 重庆邮电大学 一种通道注意力传播与聚合下的声纹识别方法
US11823148B2 (en) 2021-04-15 2023-11-21 Bank Of America Corporation Augmented reality-enabled ATM for secure augmented reality check realization
US11778339B2 (en) 2021-04-30 2023-10-03 Apple Inc. User interfaces for altering visual media
US11539876B2 (en) 2021-04-30 2022-12-27 Apple Inc. User interfaces for altering visual media
US12118825B2 (en) * 2021-05-03 2024-10-15 NeuraLight Ltd. Obtaining high-resolution oculometric parameters
CN113297994B (zh) * 2021-05-31 2023-08-18 中国航天科工集团第二研究院 一种飞行员行为分析方法及系统
US12112024B2 (en) 2021-06-01 2024-10-08 Apple Inc. User interfaces for managing media styles
US11776190B2 (en) 2021-06-04 2023-10-03 Apple Inc. Techniques for managing an avatar on a lock screen
US20220398302A1 (en) * 2021-06-10 2022-12-15 Trivver, Inc. Secure wearable lens apparatus
FR3123794B1 (fr) * 2021-06-14 2024-03-15 Centre Hospitalier Regional Univ De Tours Interface de communication adaptee en fonction d’une evaluation cognitive pour patients prives de la parole
US12099654B1 (en) 2021-06-21 2024-09-24 Apple Inc. Adaptation of electronic content
WO2022271668A1 (en) 2021-06-22 2022-12-29 Emed Labs, Llc Systems, methods, and devices for non-human readable diagnostic tests
US12321428B2 (en) * 2021-07-08 2025-06-03 Nippon Telegraph And Telephone Corporation User authentication device, user authentication method, and user authentication computer program
CN113434511B (zh) * 2021-07-12 2023-08-29 北京林业大学 一种基于希尔伯特曲线的聚类索引方法
US20230040163A1 (en) * 2021-08-09 2023-02-09 Jpmorgan Chase Bank, N.A. Systems and methods for processing intelligence of users captured through quantitative data collection
EP4387720A4 (en) * 2021-08-18 2025-08-20 Advanced Neuromodulation Systems Inc SYSTEMS AND METHODS FOR PROVIDING DIGITAL HEALTH SERVICES
KR102644877B1 (ko) * 2021-08-20 2024-03-08 주식회사 경신 차량 제어 장치 및 방법
CN113655927B (zh) * 2021-08-24 2024-04-26 亮风台（上海）信息科技有限公司 一种界面交互方法与设备
US11651404B2 (en) 2021-08-31 2023-05-16 Kyndryl, Inc. Virtual shopping assistant
US12014829B2 (en) 2021-09-01 2024-06-18 Emed Labs, Llc Image processing and presentation techniques for enhanced proctoring sessions
CN113679335B (zh) * 2021-09-02 2024-10-22 重庆远视科技有限公司 一种验光仪
US12422933B2 (en) 2021-09-03 2025-09-23 Apple Inc. Multi-device gesture control
US12135471B2 (en) 2021-09-10 2024-11-05 Tectus Corporation Control of an electronic contact lens using eye gestures
US20230097716A1 (en) * 2021-09-25 2023-03-30 FiveGen, LLC Authenticating Individuals Based on Game Decisions and Behaviors
US20230102506A1 (en) * 2021-09-25 2023-03-30 FiveGen, LLC Selective Recommendation by Mapping Game Decisions and Behaviors to Predefined Attributes
US20240054194A1 (en) 2021-09-27 2024-02-15 Nec Corporation Authentication system, authentication apparatus, authentication method and recording medium
CN113923252B (zh) * 2021-09-30 2023-11-21 北京蜂巢世纪科技有限公司 图像显示装置、方法和系统
US11592899B1 (en) * 2021-10-28 2023-02-28 Tectus Corporation Button activation within an eye-controlled user interface
WO2023075771A1 (en) * 2021-10-28 2023-05-04 Hewlett-Packard Development Company, L.P. Avatar training images for training machine learning model
US12197877B2 (en) * 2021-11-03 2025-01-14 Virginia Tech Intellectual Properties, Inc. Visual language processing modeling framework via an attention-on-attention mechanism
WO2023091403A2 (en) * 2021-11-17 2023-05-25 Meta Platforms Technologies, Llc Gaze-based user interface with assistant features for smart glasses in immersive reality applications
US11789530B2 (en) 2021-11-17 2023-10-17 Meta Platforms Technologies, Llc Gaze-based user interface with assistant features for smart glasses in immersive reality applications
KR20230072757A (ko) 2021-11-18 2023-05-25 삼성전자주식회사 웨어러블 전자 장치 및 웨어러블 전자 장치의 동작 방법
US12299206B2 (en) 2021-12-02 2025-05-13 SoftEye, Inc. Systems, apparatus, and methods for gesture-based augmented reality, extended reality
EP4411637A4 (en) * 2021-12-14 2024-11-13 Huawei Technologies Co., Ltd. METHOD AND APPARATUS FOR TARGET TRACKING
GB2628281A (en) * 2022-01-07 2024-09-18 Jumio Corp Biometric authentication using head-mounted devices
US11619994B1 (en) 2022-01-14 2023-04-04 Tectus Corporation Control of an electronic contact lens using pitch-based eye gestures
US12548558B2 (en) 2022-01-19 2026-02-10 Google Llc Mitigating false positives and/or false negatives in hot word free adaptation of automated assistant
US12020704B2 (en) 2022-01-19 2024-06-25 Google Llc Dynamic adaptation of parameter set used in hot word free adaptation of automated assistant
US12354251B2 (en) * 2022-01-21 2025-07-08 Baker Hughes Holdings Llc Detection of structures
US12118138B2 (en) 2022-02-14 2024-10-15 Tectus Corporation Vergence authentication
US11852825B1 (en) * 2022-03-08 2023-12-26 Meta Platforms Technologies, Llc Selective notifications from eye measurements
US12267434B2 (en) * 2022-03-29 2025-04-01 O&BSolutions LLC System and method for deploying a generated work
KR102681180B1 (ko) * 2022-04-23 2024-07-03 (주)인스웨이브시스템즈 사용자 인터페이스 공유를 통한 비대면 원격 업무 처리 시스템 및 방법
US20230360057A1 (en) * 2022-05-04 2023-11-09 AT&T Communications Services India Private Limited System for augmented intelligence for sentiment analysis in a virtual agent
US11874961B2 (en) 2022-05-09 2024-01-16 Tectus Corporation Managing display of an icon in an eye tracking augmented reality device
US20230368328A1 (en) 2022-05-11 2023-11-16 SoftEye, Inc. Methods and apparatus for scalable processing
US12423917B2 (en) 2022-06-10 2025-09-23 Apple Inc. Extended reality based digital assistant interactions
US12504863B2 (en) 2022-06-15 2025-12-23 Apple Inc. Home automation device control and designation
EP4540648A1 (en) * 2022-06-17 2025-04-23 Magic Leap, Inc. Method and system for performing eye tracking in augmented reality devices
US20240012920A1 (en) * 2022-07-05 2024-01-11 Bank Of America Corporation System and method for controlling access security protocols in a database management system
CN115457964B (zh) * 2022-08-19 2025-02-25 厦门快商通科技股份有限公司 一种自监督声纹识别方法和系统
US12287913B2 (en) 2022-09-06 2025-04-29 Apple Inc. Devices, methods, and graphical user interfaces for controlling avatars within three-dimensional environments
US20240086059A1 (en) * 2022-09-12 2024-03-14 Luxsonic Technologies Inc. Gaze and Verbal/Gesture Command User Interface
US12242672B1 (en) 2022-10-21 2025-03-04 Meta Platforms Technologies, Llc Triggering actions based on detected motions on an artificial reality device
US12135429B2 (en) 2022-12-08 2024-11-05 Meta Platforms Technologies, Llc Pupil-steering for three-dimensional (3D) resolution enhancement in single photon avalanche diode (SPAD) eye tracking (ET)
CN115981538A (zh) * 2022-12-23 2023-04-18 广州博冠信息科技有限公司 设备显示的控制方法、装置、存储介质和电子设备
CN116010782B (zh) * 2022-12-27 2025-08-26 杭州电子科技大学 一种基于双向回溯最大信息系数的脑肌耦合分析方法
CN115658933B (zh) * 2022-12-28 2023-04-07 四川大学华西医院 心理状态知识库构建方法、装置、计算机设备及存储介质
US12400240B2 (en) * 2023-01-13 2025-08-26 GM Global Technology Operations LLC Interactive conjoint environment
CN117524123B (zh) * 2023-01-31 2025-12-05 武汉华星光电技术有限公司 场色序显示驱动方法及显示设备
GB2627210A (en) * 2023-02-15 2024-08-21 Sony Interactive Entertainment Inc Graphics rendering apparatus and method
US12186663B2 (en) * 2023-03-01 2025-01-07 Tencent America LLC Build element availability for real-time strategy game
US20240302902A1 (en) * 2023-03-07 2024-09-12 Sony Interactive Entertainment Inc. Leveraging eye gestures to enhance game experience
WO2024187070A2 (en) * 2023-03-08 2024-09-12 Arizona Board Of Regents On Behalf Of The University Of Arizona Method and system for eye tracking using deflectometric information
CN116308424B (zh) * 2023-03-21 2026-04-07 上海诺标信息技术有限公司 纳米隐形mqr点光漂移信息双向加密认证防伪方法
US12112511B1 (en) * 2023-04-05 2024-10-08 Sony Interactive Entertainment Inc. Optimization of eye capture conditions for each user and use case
US12306408B2 (en) 2023-05-11 2025-05-20 SoftEye, Inc. Applications for anamorphic lenses
US12554323B2 (en) 2023-05-15 2026-02-17 Apple Inc. Head mountable display
GB2638041A (en) * 2023-05-15 2025-08-13 Apple Inc Head mountable display
US12455621B1 (en) * 2023-06-02 2025-10-28 Apple Inc. Optimizations in associating user gaze with user interface elements
CN116436919B (zh) * 2023-06-13 2023-10-10 深圳市明源云科技有限公司 云资源消耗优化方法、装置、电子设备及可读存储介质
US12556546B2 (en) * 2023-06-16 2026-02-17 Jonathan Snyder Method for identifying trusted users
CN119225573A (zh) * 2023-06-30 2024-12-31 微软技术许可有限责任公司 在侧边栏中动态配置的快速动作
US12573081B2 (en) * 2023-06-30 2026-03-10 Rockwell Collins, Inc. Online correction for context-aware image analysis for object classification
WO2025028998A1 (ko) * 2023-08-03 2025-02-06 삼성전자 주식회사 안구 이미지의 특징을 이용하여 보안성을 강화하는 전자 장치 및 그 제어 방법
TWI839285B (zh) * 2023-08-04 2024-04-11 上弘醫療設備股份有限公司 影像轉語音之視障輔助裝置
AU2024322777A1 (en) * 2023-08-08 2026-01-29 Squid Eye Pty Ltd Remote eye gaze cursor control technology
US12530669B2 (en) 2023-08-31 2026-01-20 Toshiba Global Commerce Solutions, Inc. Activity detection at point of sale
DE102023208772A1 (de) * 2023-09-11 2025-03-13 Robert Bosch Gesellschaft mit beschränkter Haftung Augen- und/oder Pupillenverfolgungsverfahren, Augen- und/oder Pupillenverfolgungsvorrichtung und virtuelle Netzhautanzeige
US12456391B1 (en) * 2023-10-19 2025-10-28 Christoper Scott D'Angelo Reader comprehension assessment and electronic book content generation system
WO2025099876A1 (ja) * 2023-11-08 2025-05-15 日本電信電話株式会社 情報処理装置、情報処理方法、および、情報処理プログラム
WO2025111381A1 (en) * 2023-11-20 2025-05-30 Morphosis Inc. Methods and apparatuses for secure, real-time human computer interfacing using dense opticomyography
CN117370534A (zh) * 2023-11-21 2024-01-09 中山大学 一种面向虚拟现实的多源融合情感支持对话方法
US20250273014A1 (en) * 2024-02-26 2025-08-28 Bi Incorporated Systems and methods for detecting fraudulent facial recognition attempt
CN118053196B (zh) * 2024-04-15 2024-07-05 北京航空航天大学 基于扫视与凝视的单波段骨干网络架构的特征提取方法
US12326971B1 (en) 2024-10-03 2025-06-10 Bansen Labs, Llc System and method for facilitating adaptive recentering in virtual reality environments
US12572204B1 (en) 2024-12-17 2026-03-10 Sony Interactive Entertainment Inc. Switching tracking modes in motion control
CN120144698B (zh) * 2025-02-13 2025-11-14 派达科技盐城有限公司 基于物联网和大数据分析的智能设备管理云平台及方法
CN119918040A (zh) * 2025-03-19 2025-05-02 迪爱斯(辽宁)信息技术有限公司 面向多维数据的安全防护控制方法及系统
CN120371677B (zh) * 2025-06-25 2025-08-26 深圳市海淇展示文化有限公司 基于ai的用户桌面交互控制装置及其方法

Citations (3)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US20140096077A1 (en) * 2012-09-28 2014-04-03 Michal Jacob System and method for inferring user intent based on eye movement during observation of a display screen
US20140289834A1 (en) * 2013-03-22 2014-09-25 Rolf Lindemann System and method for eye tracking during authentication
US20140289833A1 (en) * 2013-03-22 2014-09-25 Marc Briceno Advanced authentication techniques and applications

Family Cites Families (182)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US3863243A (en) 1972-01-19 1975-01-28 Max Skolnick Sleep inhibiting alarm
US3798599A (en) 1972-02-24 1974-03-19 H Kafafian Single input controller for a communication system
US4359724A (en) 1980-04-28 1982-11-16 Ronald R. Zimmerman Eyelid movement detector
US4737040A (en) 1985-02-15 1988-04-12 Moon Tag Y Keyboard device and method for entering Japanese language text utilizing Romaji character notation
US4953111A (en) 1987-02-12 1990-08-28 Omron Tateisi Electronics Co. Doze detector
US4850691A (en) 1987-03-18 1989-07-25 University Of Illinois Method and apparatus for determining pupillary response parameters
US4815839A (en) 1987-08-03 1989-03-28 Waldorf Ronald A Infrared/video electronystagmographic apparatus
US5291560A (en) * 1991-07-15 1994-03-01 Iri Scan Incorporated Biometric personal identification system based on iris analysis
US5214456A (en) 1991-10-09 1993-05-25 Computed Anatomy Incorporated Mapping of corneal topography with display of pupil perimeter
US5345281A (en) 1992-12-17 1994-09-06 John Taboada Eye tracking system and method
US5517021A (en) 1993-01-19 1996-05-14 The Research Foundation State University Of New York Apparatus and method for eye tracking interface
US5402109A (en) 1993-04-29 1995-03-28 Mannik; Kallis H. Sleep prevention device for automobile drivers
US5481622A (en) 1994-03-01 1996-01-02 Rensselaer Polytechnic Institute Eye tracking apparatus and method employing grayscale threshold values
JPH086708A (ja) 1994-04-22 1996-01-12 Canon Inc 表示装置
CA2126142A1 (en) 1994-06-17 1995-12-18 David Alexander Kahn Visual communications apparatus
US5469143A (en) 1995-01-10 1995-11-21 Cooper; David E. Sleep awakening device for drivers of motor vehicles
US5566067A (en) 1995-03-23 1996-10-15 The President And Fellows Of Harvard College Eyelid vigilance detector system
US5689241A (en) 1995-04-24 1997-11-18 Clarke, Sr.; James Russell Sleep detection and driver alert apparatus
US5570698A (en) 1995-06-02 1996-11-05 Siemens Corporate Research, Inc. System for monitoring eyes for detecting sleep behavior
US5682144A (en) 1995-11-20 1997-10-28 Mannik; Kallis Hans Eye actuated sleep prevention devices and other eye controlled devices
US6003991A (en) 1996-02-17 1999-12-21 Erik Scott Viirre Eye examination apparatus and method for remote examination of a patient by a health professional
US5912721A (en) 1996-03-13 1999-06-15 Kabushiki Kaisha Toshiba Gaze detection apparatus and its method as well as information display apparatus
US5886683A (en) 1996-06-25 1999-03-23 Sun Microsystems, Inc. Method and apparatus for eyetrack-driven information retrieval
US5748113A (en) 1996-08-19 1998-05-05 Torch; William C. Method and apparatus for communication
US6163281A (en) 1996-08-19 2000-12-19 Torch; William C. System and method for communication using eye movement
US6542081B2 (en) 1996-08-19 2003-04-01 William C. Torch System and method for monitoring eye movement
US6246344B1 (en) 1996-08-19 2001-06-12 William C. Torch Method and apparatus for voluntary communication
US5867587A (en) 1997-05-19 1999-02-02 Northrop Grumman Corporation Impaired operator detection and warning system employing eyeblink analysis
AU1091099A (en) 1997-10-16 1999-05-03 Board Of Trustees Of The Leland Stanford Junior University Method for inferring mental states from eye movements
US6007202A (en) 1997-10-23 1999-12-28 Lasersight Technologies, Inc. Eye illumination system and method
DE19803158C1 (de) 1998-01-28 1999-05-06 Daimler Chrysler Ag Vorrichtung zur Vigilanzzustandsbestimmung
US6204828B1 (en) 1998-03-31 2001-03-20 International Business Machines Corporation Integrated gaze/manual cursor positioning system
US6867752B1 (en) 1998-08-31 2005-03-15 Semiconductor Energy Laboratory Co., Ltd. Portable information processing system
US6243076B1 (en) 1998-09-01 2001-06-05 Synthetic Environments, Inc. System and method for controlling host system interface with point-of-interest data
US6087941A (en) 1998-09-01 2000-07-11 Ferraz; Mark Warning device for alerting a person falling asleep
AUPP612998A0 (en) 1998-09-23 1998-10-15 Canon Kabushiki Kaisha Multiview multimedia generation system
US6526159B1 (en) 1998-12-31 2003-02-25 Intel Corporation Eye tracking for resource and power management
US6433760B1 (en) * 1999-01-14 2002-08-13 University Of Central Florida Head mounted display with eyetracking capability
US6577329B1 (en) 1999-02-25 2003-06-10 International Business Machines Corporation Method and system for relevance feedback through gaze tracking and ticker interfaces
GB2348520B (en) 1999-03-31 2003-11-12 Ibm Assisting user selection of graphical user interface elements
US6116736A (en) 1999-04-23 2000-09-12 Neuroptics, Inc. Pupilometer with pupil irregularity detection capability
JP3636927B2 (ja) * 1999-05-18 2005-04-06 三菱電機株式会社 顔画像処理装置
JP2001197400A (ja) * 2000-01-12 2001-07-19 Mixed Reality Systems Laboratory Inc 表示装置、頭部装着型表示装置、頭部装着型表示装置の制御方法、頭部装着型表示装置のための画像生成方法、コンピュータおよびプログラム記憶媒体
US6456262B1 (en) 2000-05-09 2002-09-24 Intel Corporation Microdisplay with eye gaze detection
PT1285409E (pt) 2000-05-16 2005-08-31 Swisscom Mobile Ag Processo de identificacao ou autenticacao biometrico
US6608615B1 (en) 2000-09-19 2003-08-19 Intel Corporation Passive gaze-driven browsing
ES2401132T3 (es) 2000-10-07 2013-04-17 Metaio Gmbh Dispositivo y procedimiento para la determinación de la orientación de un ojo
DE10103922A1 (de) 2001-01-30 2002-08-01 Physoptics Opto Electronic Gmb Interaktives Datensicht- und Bediensystem
JP3586431B2 (ja) * 2001-02-28 2004-11-10 松下電器産業株式会社 個人認証方法および装置
US20030038754A1 (en) 2001-08-22 2003-02-27 Mikael Goldstein Method and apparatus for gaze responsive text presentation in RSVP display
AUPR872301A0 (en) 2001-11-08 2001-11-29 Sleep Diagnostics Pty Ltd Alertness monitor
US6712468B1 (en) 2001-12-12 2004-03-30 Gregory T. Edwards Techniques for facilitating use of eye tracking data
US7715595B2 (en) * 2002-01-16 2010-05-11 Iritech, Inc. System and method for iris identification using stereoscopic face recognition
KR100954640B1 (ko) * 2002-02-05 2010-04-27 파나소닉 주식회사 개인인증방법 및 개인인증장치
US6873714B2 (en) 2002-02-19 2005-03-29 Delphi Technologies, Inc. Auto calibration and personalization of eye tracking system using larger field of view imager with higher resolution
US6919907B2 (en) 2002-06-20 2005-07-19 International Business Machines Corporation Anticipatory image capture for stereoscopic remote viewing with foveal priority
US20040061680A1 (en) 2002-07-10 2004-04-01 John Taboada Method and apparatus for computer control
US7400782B2 (en) * 2002-08-28 2008-07-15 Arcsoft, Inc. Image warping correction in forming 360 degree panoramic images
JP3574653B2 (ja) * 2002-09-13 2004-10-06 松下電器産業株式会社 虹彩コード化方法、個人認証方法、虹彩コード登録装置、虹彩認証装置、および虹彩認証プログラム
WO2004025565A1 (ja) * 2002-09-13 2004-03-25 Matsushita Electric Industrial Co., Ltd. 虹彩コード化方法、個人認証方法、虹彩コード登録装置、虹彩認証装置、および虹彩認証プログラム
CN101317763B (zh) 2002-10-15 2013-04-03 沃尔沃技术公司 解释对象的头部和眼睛活动的方法和装置
US6932090B1 (en) 2003-02-06 2005-08-23 The United States Of America As Represented By The United States National Aeronautics And Space Administration Motion sickness treatment apparatus and method
US7347551B2 (en) 2003-02-13 2008-03-25 Fergason Patent Properties, Llc Optical system for monitoring eye movement
US7881493B1 (en) 2003-04-11 2011-02-01 Eyetools, Inc. Methods and apparatuses for use of eye interpretation information
US7401920B1 (en) * 2003-05-20 2008-07-22 Elbit Systems Ltd. Head mounted eye tracking and display system
US20050047629A1 (en) 2003-08-25 2005-03-03 International Business Machines Corporation System and method for selectively expanding or contracting a portion of a display using eye-gaze tracking
US9274598B2 (en) 2003-08-25 2016-03-01 International Business Machines Corporation System and method for selecting and activating a target object using a combination of eye gaze and key presses
JP2007504562A (ja) * 2003-09-04 2007-03-01 サーノフ コーポレーション １つの画像から虹彩認証を行う方法および装置
US8098901B2 (en) * 2005-01-26 2012-01-17 Honeywell International Inc. Standoff iris recognition system
US7365738B2 (en) 2003-12-02 2008-04-29 International Business Machines Corporation Guides and indicators for eye movement monitoring systems
US7561143B1 (en) 2004-03-19 2009-07-14 The University of the Arts Using gaze actions to interact with a display
MXPA06011168A (es) * 2004-04-01 2007-04-16 William C Torch Biosensores, comunicadores, y controladores que verifican el movimiento del ojo y metodos para utilizarlos.
CA2562599A1 (en) 2004-04-28 2005-11-10 Neurocom International, Inc. Isolating and quantifying functional impairments of the gaze stabilization system
DK1607840T3 (da) 2004-06-18 2015-02-16 Tobii Technology Ab Øjenstyring af et computerapparat
US7797040B2 (en) * 2004-12-16 2010-09-14 California Institute Of Technology Prosthetic devices and methods and systems related thereto
ATE526866T1 (de) 2005-03-04 2011-10-15 Sleep Diagnostics Pty Ltd Wachheitsmessung
WO2006132686A2 (en) * 2005-06-03 2006-12-14 Sarnoff Corporation Method and apparatus for designing iris biometric systems for use in minimally
JP2007006393A (ja) * 2005-06-27 2007-01-11 Institute Of Physical & Chemical Research 情報提示システム
US7438414B2 (en) 2005-07-28 2008-10-21 Outland Research, Llc Gaze discriminating electronic control apparatus, system, method and computer program product
WO2007025258A2 (en) * 2005-08-25 2007-03-01 Sarnoff Corporation Methods and systems for biometric identification
US8284985B2 (en) * 2005-10-24 2012-10-09 Itesoft S.A. Interactive device for processing documents
EP1943583B1 (en) * 2005-10-28 2019-04-10 Tobii AB Eye tracker with visual feedback
US7429108B2 (en) 2005-11-05 2008-09-30 Outland Research, Llc Gaze-responsive interface to enhance on-screen user reading tasks
US8260008B2 (en) * 2005-11-11 2012-09-04 Eyelock, Inc. Methods for performing biometric recognition of a human eye and corroboration of same
JP2007159610A (ja) * 2005-12-09 2007-06-28 Matsushita Electric Ind Co Ltd 登録装置、認証装置、登録認証装置、登録方法、認証方法、登録プログラムおよび認証プログラム
US7760910B2 (en) 2005-12-12 2010-07-20 Eyetools, Inc. Evaluation of visual stimuli using existing viewing data
JP4367424B2 (ja) * 2006-02-21 2009-11-18 沖電気工業株式会社 個人識別装置，個人識別方法
US8793620B2 (en) 2011-04-21 2014-07-29 Sony Computer Entertainment Inc. Gaze-assisted computer interface
JP2007319174A (ja) * 2006-05-30 2007-12-13 Matsushita Electric Ind Co Ltd 撮影装置およびそれを用いた認証装置
US20070297653A1 (en) * 2006-06-22 2007-12-27 Rudolf Maarten Bolle Fingerprint representation using localized texture features
US7574021B2 (en) * 2006-09-18 2009-08-11 Sarnoff Corporation Iris recognition for a secure facility
US7970179B2 (en) * 2006-09-25 2011-06-28 Identix Incorporated Iris data extraction
JP2008206143A (ja) * 2007-01-23 2008-09-04 Kanazawa Univ 画像処理機能を備える撮像装置
JP2008198028A (ja) * 2007-02-14 2008-08-28 Sony Corp ウェアラブル装置、認証方法、およびプログラム
JP2008288767A (ja) 2007-05-16 2008-11-27 Sony Corp 情報処理装置および方法、並びにプログラム
IL184399A0 (en) * 2007-07-03 2007-10-31 Yossi Tsuria Content delivery system
US8553948B2 (en) * 2007-09-01 2013-10-08 Eyelock, Inc. System and method for iris data acquisition for biometric identification
WO2009073584A1 (en) 2007-11-29 2009-06-11 Oculis Labs, Inc. Method and apparatus for display of secure visual content
WO2009093435A1 (ja) 2008-01-25 2009-07-30 Panasonic Corporation 脳波インタフェースシステム、脳波インタフェース装置、方法およびコンピュータプログラム
US8259169B2 (en) * 2008-02-28 2012-09-04 Panasonic Corporation Eye-gaze detecting device and eye-gaze detecting method
US20100045596A1 (en) 2008-08-21 2010-02-25 Sony Ericsson Mobile Communications Ab Discreet feature highlighting
US7850306B2 (en) 2008-08-28 2010-12-14 Nokia Corporation Visual cognition aware display and visual data transmission architecture
WO2010042557A2 (en) 2008-10-06 2010-04-15 Neuro Kinetics, Inc. Method and apparatus for corrective secondary saccades analysis with video oculography system
EP2238889B1 (en) 2009-04-01 2011-10-12 Tobii Technology AB Adaptive camera and illuminator eyetracker
WO2010118292A1 (en) 2009-04-09 2010-10-14 Dynavox Systems, Llc Calibration free, motion tolerant eye-gaze direction detector with contextually aware computer interaction and communication methods
US8472681B2 (en) * 2009-06-15 2013-06-25 Honeywell International Inc. Iris and ocular recognition system using trace transforms
CN101943982B (zh) * 2009-07-10 2012-12-12 北京大学 基于被跟踪的眼睛运动的图像操作
WO2011008793A1 (en) * 2009-07-13 2011-01-20 Emsense Corporation Systems and methods for generating bio-sensory metrics
ES2746378T3 (es) 2009-07-16 2020-03-05 Tobii Ab Unidad de detección ocular que usa flujo de datos paralelo
US20110047377A1 (en) * 2009-08-19 2011-02-24 Harris Corporation Secure digital communications via biometric key generation
JP5613025B2 (ja) * 2009-11-18 2014-10-22 パナソニック株式会社 視線検出装置、視線検出方法、眼電位計測装置、ウェアラブルカメラ、ヘッドマウントディスプレイ、電子めがねおよび眼科診断装置
US9507418B2 (en) 2010-01-21 2016-11-29 Tobii Ab Eye tracker based contextual action
US8922342B1 (en) * 2010-02-15 2014-12-30 Noblis, Inc. Systems, apparatus, and methods for continuous authentication
AU2011220382A1 (en) * 2010-02-28 2012-10-18 Microsoft Corporation Local advertising content on an interactive head-mounted eyepiece
US9759917B2 (en) * 2010-02-28 2017-09-12 Microsoft Technology Licensing, Llc AR glasses with event and sensor triggered AR eyepiece interface to external devices
US9091851B2 (en) * 2010-02-28 2015-07-28 Microsoft Technology Licensing, Llc Light control in head mounted displays
US8467133B2 (en) * 2010-02-28 2013-06-18 Osterhout Group, Inc. See-through display with an optical assembly including a wedge-shaped illumination system
US8890946B2 (en) 2010-03-01 2014-11-18 Eyefluence, Inc. Systems and methods for spatially controlled scene illumination
KR20110125460A (ko) * 2010-05-13 2011-11-21 김석수 시선추적을 이용한 제품 정보 제공 시스템 및 방법
US8593375B2 (en) 2010-07-23 2013-11-26 Gregory A Maltz Eye gaze user interface and method
US9916006B2 (en) 2010-07-23 2018-03-13 Telepatheye Inc. Eye-wearable device user interface and method
US9213405B2 (en) 2010-12-16 2015-12-15 Microsoft Technology Licensing, Llc Comprehension and intent-based content for augmented reality displays
US9690099B2 (en) * 2010-12-17 2017-06-27 Microsoft Technology Licensing, Llc Optimized focal area for augmented reality displays
EP2499962B1 (en) * 2011-03-18 2015-09-09 SensoMotoric Instruments Gesellschaft für innovative Sensorik mbH Optical measuring device and method for capturing at least one parameter of at least one eye wherein an illumination characteristic is adjustable
US8643680B2 (en) 2011-04-08 2014-02-04 Amazon Technologies, Inc. Gaze-based content display
US8682073B2 (en) * 2011-04-28 2014-03-25 Sri International Method of pupil segmentation
WO2012159070A2 (en) * 2011-05-18 2012-11-22 Nextgenid, Inc. Multi-biometric enrollment kiosk including biometric enrollment and verification, face recognition and fingerprint matching systems
US9256720B2 (en) * 2011-05-18 2016-02-09 Nextgenid, Inc. Enrollment kiosk including biometric enrollment and verification, face recognition and fingerprint matching systems
US8911087B2 (en) * 2011-05-20 2014-12-16 Eyefluence, Inc. Systems and methods for measuring reactions of head, eyes, eyelids and pupils
US8885877B2 (en) 2011-05-20 2014-11-11 Eyefluence, Inc. Systems and methods for identifying gaze tracking scene reference locations
WO2013001143A2 (en) * 2011-06-30 2013-01-03 Nokia Corporation Method, apparatus and computer program product for generating panorama images
US20130021374A1 (en) * 2011-07-20 2013-01-24 Google Inc. Manipulating And Displaying An Image On A Wearable Computing System
RU2623795C2 (ru) * 2011-08-22 2017-06-29 АЙЛОК ЭлЭлСи Системы и способы для захвата безартефактных изображений
US9342610B2 (en) * 2011-08-25 2016-05-17 Microsoft Technology Licensing, Llc Portals: registered objects as virtualized, personalized displays
EP2751609B1 (en) * 2011-08-30 2017-08-16 Microsoft Technology Licensing, LLC Head mounted display with iris scan profiling
US8223024B1 (en) * 2011-09-21 2012-07-17 Google Inc. Locking mechanism based on unnatural movement of head-mounted display
ES2620762T3 (es) * 2011-10-27 2017-06-29 Tobii Ab Gestión de potencia en un sistema de rastreo ocular
US20130258089A1 (en) * 2011-11-03 2013-10-03 Intel Corporation Eye Gaze Based Image Capture
US8929589B2 (en) 2011-11-07 2015-01-06 Eyefluence, Inc. Systems and methods for high-resolution gaze tracking
KR101891786B1 (ko) 2011-11-29 2018-08-27 삼성전자주식회사 아이 트래킹 기반의 사용자 기능 운용 방법 및 이를 지원하는 단말기
US8235529B1 (en) * 2011-11-30 2012-08-07 Google Inc. Unlocking a screen using eye tracking information
US8955973B2 (en) * 2012-01-06 2015-02-17 Google Inc. Method and system for input detection using structured light projection
EP2807605A2 (en) * 2012-01-26 2014-12-03 Umoove Services Ltd. Eye tracking
US9001030B2 (en) 2012-02-15 2015-04-07 Google Inc. Heads up display
KR101158501B1 (ko) * 2012-02-16 2012-06-20 김유정 홍채 이미지 캡쳐 장치
CN104159497B (zh) * 2012-03-09 2018-01-12 奥斯派克特公司 用于评估视觉系统的功能的方法及其装置
US11169611B2 (en) * 2012-03-26 2021-11-09 Apple Inc. Enhanced virtual touchpad
US9082011B2 (en) 2012-03-28 2015-07-14 Texas State University—San Marcos Person identification using ocular biometrics with liveness detection
US8864310B2 (en) 2012-05-01 2014-10-21 RightEye, LLC Systems and methods for evaluating human eye tracking
CN104395857A (zh) * 2012-05-09 2015-03-04 英特尔公司 显示器的部分的基于眼球追踪的选择性强调
DE102012105664A1 (de) 2012-06-28 2014-04-10 Oliver Hein Verfahren und Vorrichtung zur Kodierung von Augen- und Blickverlaufsdaten
JP2014044654A (ja) * 2012-08-28 2014-03-13 Nikon Corp 情報入出力装置
US9189064B2 (en) 2012-09-05 2015-11-17 Apple Inc. Delay of display event based on user gaze
US20140092006A1 (en) 2012-09-28 2014-04-03 Joshua Boelter Device and method for modifying rendering based on viewer focus area from eye tracking
WO2014057618A1 (ja) 2012-10-09 2014-04-17 パナソニック株式会社 ３次元表示装置、３次元画像処理装置および３次元表示方法
JP2014092941A (ja) * 2012-11-02 2014-05-19 Sony Corp 情報処理装置及び情報処理方法、並びにコンピューター・プログラム
JP2014092940A (ja) * 2012-11-02 2014-05-19 Sony Corp 画像表示装置及び画像表示方法、並びにコンピューター・プログラム
US9626072B2 (en) 2012-11-07 2017-04-18 Honda Motor Co., Ltd. Eye gaze control system
US9083757B2 (en) 2012-11-21 2015-07-14 Telefonaktiebolaget L M Ericsson LLP Multi-objective server placement determination
US9674510B2 (en) 2012-11-21 2017-06-06 Elwha Llc Pulsed projection system for 3D video
JP5652886B2 (ja) * 2012-11-28 2015-01-14 Ｎｅｃカシオモバイルコミュニケーションズ株式会社 顔認証装置、認証方法とそのプログラム、情報機器
CN104903818B (zh) 2012-12-06 2018-12-14 谷歌有限责任公司 眼睛跟踪佩戴式设备和使用方法
US9195890B2 (en) * 2012-12-10 2015-11-24 Sri International Iris biometric matching system
US20140173407A1 (en) 2012-12-17 2014-06-19 Empire Technology Development Llc Progressively triggered auto-fill
WO2014111924A1 (en) 2013-01-15 2014-07-24 Poow Innovation Ltd. Dynamic icons
US9829971B2 (en) 2013-01-21 2017-11-28 Facebook, Inc. Systems and methods of eye tracking control
US9070015B2 (en) * 2013-02-07 2015-06-30 Ittiam Systems (P) Ltd. System and method for iris detection in digital images
US9791921B2 (en) 2013-02-19 2017-10-17 Microsoft Technology Licensing, Llc Context-aware augmented reality object commands
KR102093198B1 (ko) 2013-02-21 2020-03-25 삼성전자주식회사 시선 인식을 이용한 사용자 인터페이스 방법 및 장치
KR102175853B1 (ko) 2013-02-22 2020-11-06 삼성전자주식회사 동작 제어 방법 및 그 전자 장치
EP2962175B1 (en) 2013-03-01 2019-05-01 Tobii AB Delay warp gaze interaction
WO2014145166A2 (en) * 2013-03-15 2014-09-18 Eyecam, LLC Autonomous computing and telecommunications head-up displays glasses
KR101627290B1 (ko) * 2013-04-16 2016-06-21 구태언 보안강화 머리착용형 디스플레이 장치 및 그 장치를 통해 암호화된 정보에 액세스 하는 방법
US9979547B2 (en) * 2013-05-08 2018-05-22 Google Llc Password management
US10025378B2 (en) * 2013-06-25 2018-07-17 Microsoft Technology Licensing, Llc Selecting user interface elements via position signal
CN105682539B (zh) * 2013-09-03 2018-03-16 托比股份公司 便携式眼睛追踪设备
US9582716B2 (en) * 2013-09-09 2017-02-28 Delta ID Inc. Apparatuses and methods for iris based biometric recognition
JP6929644B2 (ja) 2013-12-31 2021-09-01 グーグル エルエルシーＧｏｏｇｌｅ ＬＬＣ 注視によるメディア選択及び編集のためのシステム並びに方法
US9552060B2 (en) * 2014-01-28 2017-01-24 Microsoft Technology Licensing, Llc Radial selection by vestibulo-ocular reflex fixation
EP3140780B1 (en) 2014-05-09 2020-11-04 Google LLC Systems and methods for discerning eye signals and continuous biometric identification
US10564714B2 (en) 2014-05-09 2020-02-18 Google Llc Systems and methods for biomechanically-based eye signals for interacting with real and virtual objects
US20160364609A1 (en) * 2015-06-12 2016-12-15 Delta ID Inc. Apparatuses and methods for iris based biometric recognition

Patent Citations (3)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US20140096077A1 (en) * 2012-09-28 2014-04-03 Michal Jacob System and method for inferring user intent based on eye movement during observation of a display screen
US20140289834A1 (en) * 2013-03-22 2014-09-25 Rolf Lindemann System and method for eye tracking during authentication
US20140289833A1 (en) * 2013-03-22 2014-09-25 Marc Briceno Advanced authentication techniques and applications

Non-Patent Citations (1)

* Cited by examiner, † Cited by third party
Title
Dario D. Salvucci, Inferring Intent in Eye-Based Interfaces: Tracing Eye Movements with Process Models, Human Factors in Computing Systems: CHI 99 Conference Proceedsings (pp.254-261), New York, ACM Press. *

Cited By (104)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US10620700B2 (en) 2014-05-09 2020-04-14 Google Llc Systems and methods for biomechanically-based eye signals for interacting with real and virtual objects
US10564714B2 (en) 2014-05-09 2020-02-18 Google Llc Systems and methods for biomechanically-based eye signals for interacting with real and virtual objects
US9823744B2 (en) 2014-05-09 2017-11-21 Google Inc. Systems and methods for biomechanically-based eye signals for interacting with real and virtual objects
US10325083B2 (en) * 2014-06-27 2019-06-18 Intel Corporation Wearable electronic devices
US20160246054A1 (en) * 2015-02-23 2016-08-25 International Business Machines Corporation Interfacing via heads-up display using eye contact
US20160246365A1 (en) * 2015-02-23 2016-08-25 International Business Machines Corporation Interfacing via heads-up display using eye contact
US9652035B2 (en) * 2015-02-23 2017-05-16 International Business Machines Corporation Interfacing via heads-up display using eye contact
US9658689B2 (en) * 2015-02-23 2017-05-23 International Business Machines Corporation Interfacing via heads-up display using eye contact
US10305895B2 (en) * 2015-04-14 2019-05-28 Blubox Security, Inc. Multi-factor and multi-mode biometric physical access control device
US20160308859A1 (en) * 2015-04-14 2016-10-20 Blub0X Technology Holdings, Inc. Multi-factor and multi-mode biometric physical access control device
US11595479B2 (en) 2015-06-15 2023-02-28 Blubøx Security, Inc. Web-cloud hosted unified physical security system
US10554758B2 (en) 2015-06-15 2020-02-04 Blub0X Security, Inc. Web-cloud hosted unified physical security system
US10757194B2 (en) 2015-06-15 2020-08-25 Blubøx Security, Inc. Web-cloud hosted unified physical security system
US12425479B2 (en) 2015-06-15 2025-09-23 Blubox Security, Inc. Web-cloud hosted unified physical security system
US20200293744A1 (en) * 2015-08-21 2020-09-17 Magic Leap, Inc. Eyelid shape estimation using eye pose measurement
US11538280B2 (en) * 2015-08-21 2022-12-27 Magic Leap, Inc. Eyelid shape estimation using eye pose measurement
US20190155896A1 (en) * 2015-08-31 2019-05-23 Ayla Networks, Inc. Compact schedules for resource-constrained devices
US10949255B2 (en) * 2015-08-31 2021-03-16 Ayla Networks, Inc. Compact schedules for resource-constrained devices
US11099645B2 (en) 2015-09-04 2021-08-24 Sony Interactive Entertainment Inc. Apparatus and method for dynamic graphics rendering based on saccade detection
US11416073B2 (en) 2015-09-04 2022-08-16 Sony Interactive Entertainment Inc. Apparatus and method for dynamic graphics rendering based on saccade detection
US11703947B2 (en) 2015-09-04 2023-07-18 Sony Interactive Entertainment Inc. Apparatus and method for dynamic graphics rendering based on saccade detection
US20170069159A1 (en) * 2015-09-04 2017-03-09 Musigma Business Solutions Pvt. Ltd. Analytics system and method
US20170090588A1 (en) * 2015-09-29 2017-03-30 Kabushiki Kaisha Toshiba Electronic device and method
US11749025B2 (en) 2015-10-16 2023-09-05 Magic Leap, Inc. Eye pose identification using eye features
US20170123489A1 (en) * 2015-10-28 2017-05-04 Microsoft Technology Licensing, Llc Adjusting image frames based on tracking motion of eyes
US10338677B2 (en) * 2015-10-28 2019-07-02 Microsoft Technology Licensing, Llc Adjusting image frames based on tracking motion of eyes
CN114927184A (zh) * 2015-11-18 2022-08-19 全球样本解决方案股份有限公司 用于人类标本研究的知情同意数据的编纂、跟踪和使用的方法和系统
US11231775B2 (en) 2016-01-19 2022-01-25 Magic Leap, Inc. Eye image selection
US10831264B2 (en) 2016-01-19 2020-11-10 Magic Leap, Inc. Eye image combination
US11579694B2 (en) 2016-01-19 2023-02-14 Magic Leap, Inc. Eye image selection
US10466778B2 (en) 2016-01-19 2019-11-05 Magic Leap, Inc. Eye image selection
US11436625B2 (en) 2016-03-22 2022-09-06 Magic Leap, Inc. Head mounted display system configured to exchange biometric information
EP3979106A1 (en) * 2016-03-22 2022-04-06 Magic Leap, Inc. Head mounted display system configured to exchange biometric information
EP3779740B1 (en) 2016-03-22 2021-12-08 Magic Leap, Inc. Head mounted display system configured to exchange biometric information
EP3433707B1 (en) 2016-03-22 2020-10-28 Magic Leap, Inc. Head mounted display system configured to exchange biometric information
US10733275B1 (en) * 2016-04-01 2020-08-04 Massachusetts Mutual Life Insurance Company Access control through head imaging and biometric authentication
US10353465B2 (en) * 2016-06-08 2019-07-16 South China University Of Technology Iris and pupil-based gaze estimation method for head-mounted device
EP3940559A1 (de) * 2016-09-07 2022-01-19 Bundesdruckerei GmbH Datenbrille zum kryptographischen signieren von bilddaten
WO2018046347A1 (de) * 2016-09-07 2018-03-15 Bundesdruckerei Gmbh Datenbrille zum kryptographischen signieren von bilddaten
US10650621B1 (en) 2016-09-13 2020-05-12 Iocurrents, Inc. Interfacing with a vehicular controller area network
US11232655B2 (en) 2016-09-13 2022-01-25 Iocurrents, Inc. System and method for interfacing with a vehicular controller area network
US10750560B2 (en) 2016-09-27 2020-08-18 Extreme Networks, Inc. IoT device management using multi-protocol infrastructure network devices
US11170087B2 (en) 2017-02-23 2021-11-09 Advanced New Technologies Co., Ltd. Virtual reality scene-based business verification method and device
US10996477B2 (en) 2017-02-27 2021-05-04 Advanced New Technologies Co., Ltd. Virtual reality head-mounted apparatus
US10866633B2 (en) 2017-02-28 2020-12-15 Microsoft Technology Licensing, Llc Signing with your eyes
EP3376367A1 (de) * 2017-03-13 2018-09-19 Siemens Aktiengesellschaft Quittieren eines überführens eines gutes
US11461444B2 (en) 2017-03-31 2022-10-04 Advanced New Technologies Co., Ltd. Information processing method and device based on internet of things
US10397594B2 (en) 2017-04-28 2019-08-27 Hewlett Packard Enterprise Development Lp Real-time processing of IoT data
US10748340B1 (en) * 2017-07-31 2020-08-18 Apple Inc. Electronic device with coordinated camera and display operation
US12198276B2 (en) 2017-07-31 2025-01-14 Apple Inc. Electronic device with coordinated camera and display operation
KR102577681B1 (ko) 2017-08-23 2023-09-14 한국전자통신연구원 자기 수치화 서비스 장치
KR20190022376A (ko) * 2017-08-23 2019-03-06 한국전자통신연구원 자기 수치화 서비스 장치
US20190125264A1 (en) * 2017-10-29 2019-05-02 Orlando Efrain Abreu Oramas Method and system of facilitating monitoring of an individual based on at least one wearable device
US10492725B2 (en) * 2017-10-29 2019-12-03 Orlando Efrain Abreu Oramas Method and system of facilitating monitoring of an individual based on at least one wearable device
US11533272B1 (en) * 2018-02-06 2022-12-20 Amesite Inc. Computer based education methods and apparatus
US20190266427A1 (en) * 2018-02-23 2019-08-29 Samsung Electronics Co., Ltd Method of biometric authenticating using plurality of camera with different field of view and electronic apparatus thereof
US10867202B2 (en) * 2018-02-23 2020-12-15 Samsung Electronics Co., Ltd. Method of biometric authenticating using plurality of camera with different field of view and electronic apparatus thereof
CN112262373A (zh) * 2018-06-26 2021-01-22 苹果公司 基于视图的断点
US11861145B2 (en) 2018-07-17 2024-01-02 Methodical Mind, Llc Graphical user interface system
US12405708B2 (en) 2018-07-17 2025-09-02 Methodical Mind, Llc Graphical user interface system
EP3824379A1 (en) * 2018-07-17 2021-05-26 Methodical Mind, LLC Graphical user interface system
WO2020048778A1 (de) * 2018-09-04 2020-03-12 Robert Bosch Gmbh Verfahren zur steuerung einer multimedia-einrichtung sowie computerprogramm und einrichtung dazu
US12164687B2 (en) 2018-09-28 2024-12-10 Apple Inc. Pupil modulation as a cognitive control signal
EP3648069A1 (en) * 2018-10-29 2020-05-06 Baidu Online Network Technology (Beijing) Co., Ltd. Method and apparatus for selling commodity, vending machine and storage medium
US11501299B2 (en) 2018-10-29 2022-11-15 Baidu Online Network Technology (Beijing) Co., Ltd. Method for selling commodity, vending machine and storage medium
US11271745B2 (en) 2019-03-19 2022-03-08 Advanced New Technologies Co., Ltd. Method and system for operating internet of things device
US20250306835A1 (en) * 2019-04-09 2025-10-02 Maxell, Ltd. Head mounted processing apparatus
US20240303018A1 (en) * 2019-04-09 2024-09-12 Maxell, Ltd. Head mounted processing apparatus
US12353779B2 (en) * 2019-04-09 2025-07-08 Maxell, Ltd. Head mounted processing apparatus
US11786694B2 (en) 2019-05-24 2023-10-17 NeuroLight, Inc. Device, method, and app for facilitating sleep
CN114223194A (zh) * 2019-08-06 2022-03-22 爱尔康公司 用于玻璃体视网膜手术的场景相机系统和方法
US12231613B2 (en) 2019-11-06 2025-02-18 Hes Ip Holdings, Llc System and method for displaying an object with depths
CN111091595A (zh) * 2019-12-23 2020-05-01 吉林省广播电视研究所(吉林省广播电视局科技信息中心) 斜视三维测绘方法及测绘系统
US12210731B2 (en) 2019-12-27 2025-01-28 Methodical Mind, Llc Graphical user interface system
US12248656B2 (en) 2020-01-22 2025-03-11 Methodical Mind, Llc Graphical user interface system
US12298512B2 (en) 2020-06-19 2025-05-13 Oomii Inc. Image display systems for eyebox expansion and methods of making the same
US11706656B2 (en) 2020-06-29 2023-07-18 Qualcomm Incorporated Downlink data prioritization for time-sensitive applications
WO2022015812A1 (en) * 2020-07-14 2022-01-20 Surgical Theater, Inc. System and method for four-dimensional angiography
CN115885237A (zh) * 2020-07-17 2023-03-31 惠普发展公司，有限责任合伙企业 头戴式显示器图像和中心凹区亮度计算
US11822089B2 (en) 2020-08-14 2023-11-21 Hes Ip Holdings, Llc Head wearable virtual image module for superimposing virtual image on real-time image
US11698535B2 (en) 2020-08-14 2023-07-11 Hes Ip Holdings, Llc Systems and methods for superimposing virtual image on real-time image
US11774759B2 (en) 2020-09-03 2023-10-03 Hes Ip Holdings, Llc Systems and methods for improving binocular vision
US20230370475A1 (en) * 2020-09-30 2023-11-16 Sartorius Stedim Biotech Gmbh Method for conducting a bioprocess
US11953689B2 (en) 2020-09-30 2024-04-09 Hes Ip Holdings, Llc Virtual image display system for virtual reality and augmented reality devices
US12445456B2 (en) * 2020-09-30 2025-10-14 Sartorius Stedim Biotech Gmbh Method for conducting a bioprocess
CN116324682A (zh) * 2020-10-21 2023-06-23 高通股份有限公司 至少部分地基于用户眼睛移动的功率控制
US11811513B2 (en) * 2020-12-04 2023-11-07 Capital One Services, Llc Methods and systems for managing multiple content delivery networks
US12068974B2 (en) * 2020-12-04 2024-08-20 Capital One Services, Llc Methods and systems for managing multiple content delivery networks
US20230403243A1 (en) * 2020-12-04 2023-12-14 Capital One Services, Llc Methods and systems for managing multiple content delivery networks
US11838419B2 (en) 2021-01-15 2023-12-05 Delta Electronics, Inc. Method and system for monitoring industrial devices
US12315632B2 (en) * 2021-01-19 2025-05-27 Interstat LLC Systems and methods for ophthalmic digital diagnostics via telemedicine
US20220230749A1 (en) * 2021-01-19 2022-07-21 Interstat LLC Systems and methods for ophthalmic digital diagnostics via telemedicine
US12260580B2 (en) 2021-02-08 2025-03-25 Oomii Inc. System and method for enhancing visual acuity of head wearable displays
WO2022182916A1 (en) * 2021-02-24 2022-09-01 Lifebrand, Llc System and method for determining the impact of a social media post across multiple social media platforms
US12455447B2 (en) 2021-05-20 2025-10-28 Ams International Ag Eye tracking
US12585372B2 (en) 2021-07-21 2026-03-24 Methodical Mind, Llc Graphical user interface system guide module
US12411598B2 (en) 2021-09-24 2025-09-09 Apple Inc. Interaction events based on physiological response to illumination
US12501225B2 (en) 2022-01-02 2025-12-16 Poltorak Technologies Llc Bluetooth enabled intercom with hearing aid functionality
US12293837B2 (en) 2022-03-14 2025-05-06 O/D Vision Inc. Systems and methods for artificial intelligence based warning of potential health concerns
US12381009B2 (en) 2022-03-14 2025-08-05 O/D Vision Inc. Systems and methods for artificial intelligence based standard of care support
US12285243B2 (en) 2022-03-14 2025-04-29 O/D Vision Inc. Multi sensor handheld medical diagnostic device
US12380735B2 (en) * 2022-03-14 2025-08-05 O/D Vision Inc. Systems and methods for biometric identification using patterns and blood flow characteristics of the outer eye
US12257025B2 (en) 2022-03-14 2025-03-25 O/D Vision Inc. AI enabled multisensor connected telehealth system
US12536265B2 (en) 2022-07-18 2026-01-27 Bank Of America Corporation Systems and methods for performing non-contact authorization verification for access to a network

Also Published As

Publication number Publication date
KR20170047195A (ko) 2017-05-04
EP3140719A2 (en) 2017-03-15
US10156900B2 (en) 2018-12-18
KR102173699B1 (ko) 2020-11-03
WO2016018488A9 (en) 2016-03-24
EP3140780B1 (en) 2020-11-04
WO2016018488A2 (en) 2016-02-04
AU2015297035B2 (en) 2018-06-28
JP2017526079A (ja) 2017-09-07
US20160085302A1 (en) 2016-03-24
KR20170046108A (ko) 2017-04-28
EP3140719A4 (en) 2017-12-27
CN106462743A (zh) 2017-02-22
EP3140779A1 (en) 2017-03-15
JP6550460B2 (ja) 2019-07-24
US20160274660A1 (en) 2016-09-22
AU2015255652A1 (en) 2016-11-24
WO2016018488A3 (en) 2016-05-12
US9600069B2 (en) 2017-03-21
US20170235931A1 (en) 2017-08-17
KR20200127267A (ko) 2020-11-10
CN107087431B (zh) 2021-02-05
AU2015297036B2 (en) 2017-09-28
CN106537290A (zh) 2017-03-22
KR20170045149A (ko) 2017-04-26
AU2015297036A1 (en) 2016-11-24
WO2016018487A2 (en) 2016-02-04
US20150338915A1 (en) 2015-11-26
WO2015172124A1 (en) 2015-11-12
EP3140780A4 (en) 2018-04-11
KR102230172B1 (ko) 2021-03-19
AU2015255652B2 (en) 2018-03-29
CN106537290B (zh) 2019-08-27
EP3140719B1 (en) 2021-07-07
CN107087431A8 (zh) 2017-12-22
JP2017527036A (ja) 2017-09-14
JP2017526078A (ja) 2017-09-07
WO2016018487A3 (en) 2016-05-19
US20160062459A1 (en) 2016-03-03
AU2015297035A1 (en) 2016-11-24
EP3140780A2 (en) 2017-03-15
US9823744B2 (en) 2017-11-21
WO2016018487A8 (en) 2016-12-08
CN107087431A (zh) 2017-08-22
US20150326570A1 (en) 2015-11-12
US10620700B2 (en) 2020-04-14
EP3140779A4 (en) 2017-11-29
WO2016018487A9 (en) 2016-03-24

Similar Documents

Publication Publication Date Title
AU2015255652B2 (en) Systems and methods for using eye signals with secure mobile communications
Zhang et al. Continuous authentication using eye movement response of implicit visual stimuli
US12554815B2 (en) Devices, methods, and graphical user interfaces for authorizing a secure operation
EP3284016B1 (en) Authentication of a user of a device
Shrestha et al. An offensive and defensive exposition of wearable computing
John et al. The security-utility trade-off for iris authentication and eye animation for social virtual avatars
CN116910725A (zh) 已认证设备辅助的用户认证
US20250130636A1 (en) Methods, apparatuses and computer program products for gaze-driven adaptive content generation
Alt et al. Human-centered behavioral and physiological security
EP4508510A1 (en) Gaze behavior detection
Sluganovic Security of mixed reality systems: authenticating users, devices, and data
US12555111B1 (en) Extended reality account management with iris scanner biometric authentication
Sturgess Authentication in systems with limited input capabilities
Li Empowering Security and Privacy-Preserving Interactions for Smart Device Users
US20250036206A1 (en) Hand tracking based on wrist rotation and arm movement
KR20200093392A (ko) 생체 인식 기술을 활용한 사용자 식별, 인증 및 암호화 장치 및 그의 동작 방법
Nguyen Security from Implicit Information
JP2026062239A (ja) システム
Machado Smart and Secure Augmented Reality for Assisted Living
WO2025090689A1 (en) Methods, apparatuses and computer program products for gaze-driven adaptive content generation
JP2026045344A (ja) システム
Hashmi et al. Multi-dimensional Identity Construction and Continuous Authentication Methods: A Survey
NZ736861A (en) Augmented reality systems and methods for tracking biometric data
NZ736861B2 (en) Augmented reality systems and methods for tracking biometric data

Legal Events

Date Code Title Description
AS Assignment

Owner name: EYEFLUENCE, INC., CALIFORNIA

Free format text: ASSIGNMENT OF ASSIGNORS INTEREST;ASSIGNORS:MARGGRAFF, LEWIS JAMES;DRAKE, ELIOT FRANCIS;PUBLICOVER, NELSON GEORGE;SIGNING DATES FROM 20160819 TO 20160826;REEL/FRAME:039569/0330

AS Assignment

Owner name: GOOGLE INC., CALIFORNIA

Free format text: ASSIGNMENT OF ASSIGNORS INTEREST;ASSIGNOR:EYEFLUENCE, INC.;REEL/FRAME:041160/0867

Effective date: 20170127

AS Assignment

Owner name: GOOGLE LLC, CALIFORNIA

Free format text: CHANGE OF NAME;ASSIGNOR:GOOGLE INC.;REEL/FRAME:044129/0001

Effective date: 20170929

STPP Information on status: patent application and granting procedure in general

Free format text: RESPONSE AFTER FINAL ACTION FORWARDED TO EXAMINER

STPP Information on status: patent application and granting procedure in general

Free format text: ADVISORY ACTION MAILED

STCB Information on status: application discontinuation

Free format text: ABANDONED -- FAILURE TO RESPOND TO AN OFFICE ACTION